How to use S3 compatible data source other than AWS

GSQL Loading
1

Is there any way to specify data endpoint for the s3 data loader? I could not find such option

1 Like
3

Thank you for your quick response. I watched all 3 videos, they show how to use AWS S3 credentials. Do you know is it possible to use another S3 Compatible Storage provider like MinIO, SeaweedFS etc? We are running TG enterprise on premise and have an internal S3 Compatible Storage solution, we cannot use AWS.

4

Hi @Orkhan_Alikhanov ,

We got some responses from the Engineering team. They tried doing it with MinIO. Can you try configure the s3 data source like this?

CREATE DATA_SOURCE s1 = """{
    "type": "s3",
    "file.reader.settings.fs.s3a.endpoint": <S3-compatible storage endpoint to connect to>,
    "access.key": <Access key>,
    "secret.key": <Secret key>
}""" FOR GRAPH test_graph

The other parts, like specifying the file path in the loading job, should be the same (Load from Cloud Storage :: TigerGraph DB).

Best,
Supawish Limprasert (Jim)
Solution Engineer, TigerGraph

1 Like