Troubleshooting slow load speeds
Here are some potential issues that could cause messages to load slowly from Kafka.
Verify you have disabled the API version check when communicating with Kafka 0.9 or earlier
If your Kafka cluster is running 0.9 or earlier, be sure you have disable the rdkafka library's api.version.request
option. If you do not, every OpenText™ Analytics Database connection to Kafka will pause for 10 seconds until the API version request times out. Depending on the frame size of your load or other timeout settings, this delay can either reduce the throughput of your data loads. It can even totally prevent messages from being loaded. See Configuring OpenText Analytics Database for Apache Kafka version 0.9 and earlier for more information.
Eon Mode and cloud latency
Eon Mode separates compute from storage in a database cluster, which can cause a small amount of latency when the database loads and saves data. Cloud computing infrastructure can also cause latency. This latency can eat into the frame duration for your schedulers, causing them to load less data in each frame. For this reason, you should consider increasing frame durations when loading data from Kafka in an Eon Mode database. See OpenText Analytics Database Eon Mode and Kafka for more information.