Data load

Improvements to automatic loading from SQS

When using data loaders with SQS, Vertica continuously polls all SQS queues that have at least one active data loader and collects SQS messages into an internal queue. Data loaders, in turn, read from this internal queue. This separation allows Vertica to receive messages as quickly as SQS generates them while controlling the frequency of loader executions.

More than one data loader can now read from the same SQS queue.

When defining an SQS trigger for automatic data load, you can set parameters to control the timing and frequency of loads. See CREATE DATA LOADER.

You can now use ALTER DATA LOADER to change or drop triggers.

For details, see Automatic load and SQS integration.