GSQL memory issue

TigerGraph DB Database Operations
#1

Hi team I am facing an issue please guide
I have large number of data set in my GRAPH (on my EKS Setup) which contains about 2 lakh customers and 7 lakh of orders
Running only one node m1

and I have Query which will create a Segment on a certain conditions and about 80,000 users falls under in that segment condition, In my Graph I have a segment vertex and profile Vertex which will connect with the edge of segment_profiles so the given segment name (Spenders) all 80,000 customers are attach with an edge of segment_profiles so while showing this use case to anyone, first i deleted the created segment (Spenders) and then within a second I execute my Segment query again with the same configuration and with the same name (Spenders),

Now here the thing is GSQL post accum delete will give the response in GSQL (“delete works”, but behind the scene it will deleting , deleting is still in progress ZOOKEEPER is checking after 30 seconds node is alive or not and here you trigger the QUERY again to create the segment. and the create query last print statement says “CREATE segment works”, but behind the scene it wont work I mean vertex and edge wont be created in DB because i think delete is in progress and this will unable to take new insertion in that edge that time?

and if we do the above case First delete query and then wait for atleast 5-10 min and then trigger create Query everything works fine.

My question is why this one is not taking new request in a Queue, while deleting
As I debug gadmin log for the same, But im unable to find out why this happens.

and if you cant wait after delete then sometimes machine needs to be restart, because only that query wont be able to create again

Thanks

#2

@pkr2 I’ve not run into this myself so we might need to try troubleshooting the issue. Can you run the following to see what results you have Built-in Endpoints :: TigerGraph Server

Check Deleted Vertices (Endpoint):

curl --location --request GET 'https://covid-test.i.tgcloud.io:443/restpp/deleted_vertex_check/' \
--header 'Authorization: Bearer REPLACE_WITH_TOKEN'

Additional paramters you could pass:
/?threadnum=6&segid=&vertextype=region&verbose=0&log=0

#3

@Jon_Herke thanks for your response
you are right, this check fails GPE and GSE they are not in sync
It contains many elements inside UnSyncList
Below is the snippet of output which I’m getting, About 90 vertex are in unsync list

{
    "version": {
        "edition": "enterprise",
        "api": "v2",
        "schema": 16
    },
    "error": false,
    "message": "check failed",
    "results": [
        {
            "GPE": "GPE_1_1",
            "PassCheck": false,
            "UnSyncList": [
                {
                    "Segid": 419,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 361410037753634782,
                    "IDSDelHash": 14186115616850519828
                },
                {
                    "Segid": 456,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 2563194194065955056,
                    "IDSDelHash": 11936211385748805033
                },
                {
                    "Segid": 462,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 1245877479819879664,
                    "IDSDelHash": 13201369870264192184
                },
                {
                    "Segid": 478,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 8224586731943183461,
                    "IDSDelHash": 11558633509877760013
                },
                {
                    "Segid": 491,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 12952885011566756669,
                    "IDSDelHash": 15283755654412680001
                },
                {
                    "Segid": 493,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 3631262739247081392,
                    "IDSDelHash": 10040382204334446040
                },
                {
                    "Segid": 495,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 7378034581580932891,
                    "IDSDelHash": 10662373699750988157
                },
                {
                    "Segid": 497,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 5245269925021878279,
                    "IDSDelHash": 12509446829984185644
                },
                {
                    "Segid": 499,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 17412915016861284223,
                    "IDSDelHash": 3181503803378693655
                },
                {
                    "Segid": 503,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 16531273456979006069,
                    "IDSDelHash": 15087475315091566828
                },
                {
                    "Segid": 504,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 14368535472473135377,
                    "IDSDelHash": 9203980252858450363
                },
                {
                    "Segid": 505,
                    "IsRemote": false,
                    "VertexType": "profile_calendar",
                    "GPEDelHash": 11054897609493179976,
                    "IDSDelHash": 4008994269758539348
                },
                {
                    "Segid": 506,
                    "IsRemote": false,
                    "VertexType": "visit_group",
                    "GPEDelHash": 17909454533677749147,
                    "IDSDelHash": 3595704766644955654
                }
            ]
        }
    ],
    "code": "REST-0000"
}

These are not in sync (How we can delete it from GPE as well) How we can make both sync able before running my Query.