Data load getting stuck for 16 MB file

I am trying to load 16 MB data (0.3 million records) in Graphstudio but it is getting stuck, actually not starting at all.

I am able to load subbset of data though, around 1000 records within few seconds.

Kindly help!

@Szilard_Barany @Parker_Erickson @Dan_Barkus @Vladimir_Slesarev @Jon_Herke

@AnuroopAjmera if you’re around for a Zoom session today let me know

Yes @Mohamed_Zrouga I am available, let me know when to join

can anyone help?

I am able to load 10,000 records (5.4 MB) but not able to load 0.3 million (160 MB) of file in Graph Studio running on my laptop.

@Mohamed_Zrouga @Dan_Barkus @Parker_Erickson @Szilard_Barany @Jon_Herke @Vladimir_Slesarev

Please check if there is an edge with empty value (""), this would kill the upload.

All the NODE and EDGE attributes are assigned. Even any kind of schema changes take 5 to 15 minutes to get published.

Tigergraph is extremely slow on 8 GB RAM machines and also has sync-up issues.

@Mohamed_Zrouga @Dan_Barkus @Parker_Erickson @Vladimir_Slesarev @Jon_Herke @Szilard_Barany

That’s true. Especially if you are importing data on the same machine (Disk reading and writing is using CPU too!)

@Bruno
There could be some issue with my docker setup, could you suggest some pointers here? Some configuration to check and correct?

can you share your config please?
are you using docker-compose?

I am using docker desktop, what exactly you want to check?

@Bruno

versions, your docker desktop settings (CPU, memory, disk space, …)
docker system info
docker system df

If you are using compose, how your yaml file looks like.

PS C:\Users\anuro> docker system info
Client:
Context: default
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc., v0.7.1)
compose: Docker Compose (Docker Inc., v2.2.3)
scan: Docker Scan (Docker Inc., v0.17.0)

Server:
Containers: 4
Running: 1
Paused: 0
Stopped: 3
Images: 3
Server Version: 20.10.12
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Cgroup Version: 1
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7b11cfaabd73bb80907dd23182b9347b4245eb5d
runc version: v1.0.2-0-g52b36a2
init version: de40ad0
Security Options:
seccomp
Profile: default
Kernel Version: 5.10.16.3-microsoft-standard-WSL2
Operating System: Docker Desktop
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 3.75GiB
Name: docker-desktop
ID: PBUA:VDB5:ITDG:F4DO:J2MP:3VND:TME2:HYMA:PRUF:IAZS:K6JR:CDMB
Docker Root Dir: /var/lib/docker
Debug Mode: false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
hubproxy.docker.internal:5000
127.0.0.0/8
Live Restore Enabled: false

WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support

PS C:\Users\anuro> docker system df
TYPE TOTAL ACTIVE SIZE RECLAIMABLE
Images 3 3 11.01GB 0B (0%)
Containers 4 1 6.099GB 1.097kB (0%)
Local Volumes 1 1 10.42MB 0B (0%)
Build Cache 31 0 85.49MB 85.49MB

@Bruno Let me know if you need any other info

Your total memory (RAM) for all Docker containers running on your machine is 4GB, 8GB is minimum for TG.

How to increase the same? I am using docker desktop.

My windows laptop has 8 GB RAM, shall I mention 6 GB for docker?

Regards

You can try.

Maybe it would be better to use free TG instances ?

Neither I am not able to find wsl.conf file in /etc, nor I can see .wslconfig file in my user area in C drive. Could you please suggest how to change memory settings?

Client has suggested not to go to cloud for now.

@Bruno

Hi @Bruno, can you please suggest?

@Mohamed_Zrouga @Dan_Barkus @Jon_Herke @Parker_Erickson

@AnuroopAjmera Do you have Docker Desktop for Windows?
https://hub.docker.com/editions/community/docker-ce-desktop-windows

@Bruno
I got this link from initial email from Tigergraph - https://docs.tigergraph.com/tigergraph-server/current/getting-started/docker which suggests to follow youtube video - * To install Docker for Windows OS, follow this video: Docker Beginner Tutorial 6 - How to install DOCKER on WINDOWS ? Step by Step - YouTube

This video suggests to download docker desktop from below link -