Communal storage for on-premises Eon Mode databases

If you create an Eon Mode database, you must plan for your use of communal storage to store your database's data.

If you create an Eon Mode database, you must plan for your use of communal storage to store your database's data. Communal storage is based on a shared storage, such as AWS S3 or Pure Storage FlashBlade servers.

Whatever communal storage platform you use, you must ensure that it is durable (protected against data loss). The data in your Eon Mode database is only as safe as the communal storage that contains it. Most cloud provider's object stores come with a guaranteed redundancy to prevent data loss. When you install an Eon Mode database on-premises, you may have to take additional steps to prevent data loss.

Planning communal storage capacity for on-premises databases

Most cloud providers do not limit the amount of data you can store in their object stores. The only real limit is your budget; storing more data costs more money.

When you create an Eon Mode database on-premises, your storage is limited to the size of your communal storage. Unlike the cloud, you must plan ahead for the amount of storage you will need. For example, if you have a Pure Admin FlashBlade installation with three 8TB blades, then in theory, your database can grow up to 24TB. In practice, you need to account other uses of your object store, as well as factors such as data compression, and space consumed by unreaped ROS containers (storage containers no longer used by Vertica but not yet deleted by the object store).

The following calculator helps you determine the size for your communal storage needs, based on your estimated data size and additional uses of your communal storage. The values with white backgrounds in the Value column are editable. Change them to reflect your environment.

DescriptionValueUnitNotes
1Expected size of uncompressed data100TBThe amount of data you expect to have after a year, or possibly the end of the amortization period
2Expected compression of data5xCompressed data will be 20% of its original size.
3Expected compressed data size20TB
4Number of projections2xProjections are copies of the data sorted differently to support different queries.
5Expected database size with projections40TB
6Staging area for loading data20TBThe amount of space you will use to stage data to be loaded into Vertica.
7Space for external tables50TBThe amount of space you will use in the object store to hold external Vertica tables.
8Space for unreaped ROS files5TBSpace consumed by storage containers Vertica no longer needs but have not yet been deleted. This value is affected by the size and distribution of daily loads, which triggers the tuple mover to merge-out and combine files
9Estimated total data size115TB
10Headroom for spikes or unexpected situations10%As a percent of the estimated total data size.
11Safety margin5%An additional safety margin to cover unforseen circumstances.
12Recommended size for communal storage132.25TB