Kafka Loader Question

Drivers and Connectors Kafka Loader
#1

Hello everybody,

I try to use the kafka loader with a kafka topic, filled by an application and I encounter two challenges:

  • I use for the data serialization and deserialization avro and confluent schema registry. I try to create a loading job in order to persist the events in tigergraph. Can tigergraph support avro schemas or should I first transform the events in csv-format and persist them in an intermediate topic?

  • Can the kafka loader automatically check if new events are pushed in the topics or should we trigger the kafka loader manually?

Greetings

#2

Hi Salvatore,

Thanks for the questions. The loading job now only support csv or JSON format as input so that KAFKA loader only support these two formats. KAFKA Loader will automatically fetch new event if it is available in that topic.

Best Wishes,

Dan