Loader Kafka

Loader Kafka exports data to the Kafka server.

Data In/Data Out

Data In

The component reads the configuration, loads the data from the input files and then send data to the Kafka server.

Files that need to be uploaded should be in the folder /data/in/files/folder_name

The format of files should be newline delimited JSON file. 

Data Out N/A

Learn more: about the folder structure here.

Parameters

kafka.png

Bootstrap.Server (required) Kafka's server address.
Path (required) Path to data files. Example: *.data/in/files/folder_name/file_name.ndjson
Topic (required) Name of topic in Kafka for which you want to assign loaded files.
Key (required) A specific key name will be used in the data file. The key will be used in Kafka.