Testing

Dev tests

To test if the Elasticsearch sink connector works as it supposed to work, we copied different Kafka topic to Elasticsearch and checked that the number of documents written on every Elasticsearch index was the same as the number of messages in the Kafka topic from which the connector read data.

What we did - Setup part

We started from a situation in which the log generator was running from a couple of days, so the topics from which the Elasticsearch connector was reading were already full of messages and the schemas on the schema registry were already created.

We only needed to make a configuration in order to start the Elasticsearch connector. This configuration was submitted to a running distributed worker, as explained in the Setup part of the wiki.