Loading Data To Graph Using Kafka

Hello,

We are trying to load data into our graph schema using Kafka. However, we can’t use the loadVertex method because the vertices have extra attributes whose data isn’t present in the dataset. These attribute values are actually inserted by running some queries for our ML models.

  1. We can’t send NULL or 0 in the loading job because if the ID is already present, some of the values will be replaced with NULL or 0.

The only solution seems to be using DataFrames, but we can’t find any resources on inserting data using Kafka and the upsertVertices method.

Additionally, when we use the upsertVerticesDataFrame method, it is straightforward and directly inserts the data into the graph, which adds to our confusion about the approach.

It would be great if someone could help us with this problem.

Thank you!