Problem installing TigerGraph Developer Edition on Ubuntu

Jon_Herke · April 8, 2020, 8:32pm

My installation on ubuntu:

$ uname -a

Linux brejnak 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

fails with:

Failed to push local config repo to dict server (Ret:200)!!!

Failed to config-apply

Failed to install TigerGraph platform

A bigger fragment of the log placed at the end of this post.

Any suggestion on what is happening, what to check?

Regards,

Karol

…

=== zk ===

[SUMMARY][ZK] process is up

[SUMMARY][ZK] /home/tigergraph/tigergraph/zk is ready

=== kafka ===

[SUMMARY][KAFKA] process is up

[SUMMARY][KAFKA] queue is ready

=== gse ===

[SUMMARY][GSE] process is down

[SUMMARY][GSE] id service has NOT been initialized

=== dict ===

[SUMMARY][DICT] process is up

[SUMMARY][DICT] dict server is ready

=== ts3 ===

[SUMMARY][TS3] process is down

[SUMMARY][TS3] ts3 is ready

=== graph ===

[SUMMARY][GRAPH] graph has NOT been initialized

=== nginx ===

[SUMMARY][NGINX] process is down

[SUMMARY][NGINX] nginx has NOT been initialized

=== restpp ===

[SUMMARY][RESTPP] process is down

[SUMMARY][RESTPP] restpp has NOT been initialized

=== gpe ===

[SUMMARY][GPE] process is down

[SUMMARY][GPE] graph has NOT been initialized

=== gsql ===

[SUMMARY][GSQL] process is down

[SUMMARY][GSQL] gsql has NOT been initialized

=== Visualization ===

[SUMMARY][VIS] process is down (VIS server PID: )

[SUMMARY][VIS] gui server is down

[RUN ] rm -rf /home/tigergraph/tigergraph/bin/lib; ln -s /home/tigergraph/tigergraph/dev/gdk/gsql/lib /home/tigergraph/tigergraph/bin/lib

Done the library setup: /home/tigergraph/tigergraph/bin/lib

[RUN ] rm -rf /home/tigergraph/tigergraph/logs/DICT*.pid

=== zk ===

[SUMMARY][ZK] process is up

[SUMMARY][ZK] /home/tigergraph/tigergraph/zk is ready

[SKIP ] Skip launch_zookeepers as zk is already up

=== dict ===

[SUMMARY][DICT] process is up

[SUMMARY][DICT] dict server is ready

[SKIP ] Skip launch_gsql_subsystems:DICT as dict is already up

=== zk ===

[SUMMARY][ZK] process is up

[SUMMARY][ZK] /home/tigergraph/tigergraph/zk is ready

=== kafka ===

[SUMMARY][KAFKA] process is up

[SUMMARY][KAFKA] queue is ready

=== gse ===

[SUMMARY][GSE] process is down

[SUMMARY][GSE] id service has NOT been initialized

=== dict ===

[SUMMARY][DICT] process is up

[SUMMARY][DICT] dict server is ready

=== ts3 ===

[SUMMARY][TS3] process is down

[SUMMARY][TS3] ts3 is ready

=== graph ===

[SUMMARY][GRAPH] graph has NOT been initialized

=== nginx ===

[SUMMARY][NGINX] process is down

[SUMMARY][NGINX] nginx has NOT been initialized

=== restpp ===

[SUMMARY][RESTPP] process is down

[SUMMARY][RESTPP] restpp has NOT been initialized

=== gpe ===

[SUMMARY][GPE] process is down

[SUMMARY][GPE] graph has NOT been initialized

=== gsql ===

[SUMMARY][GSQL] process is down

[SUMMARY][GSQL] gsql has NOT been initialized

=== Visualization ===

[SUMMARY][VIS] process is down (VIS server PID: )

[SUMMARY][VIS] gui server is down

[RUN ] rm -rf ~/.gsql/gstore_gs*_autostart_flag

Done.

[RUN ] rm -rf /home/tigergraph/tigergraph/document

[RUN ] cp -r /home/tigergraph/tigergraph/pkg_pool/workspace/tigergraph_2018.06.21-14.18.50/deploy_pkg/document /home/tigergraph/tigergraph/document

[FAB ][2018-06-21 14:21:48] check_config

[RUN ] mkdir -p /home/tigergraph/tigergraph/bin/admin_server/;echo "ADMIN_CRON_SCRIPT=/home/tigergraph/tigergraph/.gium/GSQL/service/…/scripts/admin_crontab.sh

ADMIN_SERVICE_SCRIPT=/home/tigergraph/tigergraph/.gium/GSQL/service/…/scripts/admin_service.sh

WORK_HOME=/home/tigergraph/tigergraph

ZK_ADDRESS=127.0.0.1:19999

WORK_IP=127.0.0.1

CLUSTER_MACHINES=‘127.0.0.1’

" > /home/tigergraph/tigergraph/bin/admin_server/config.sh

[FAB ][2018-06-21 14:21:49] update_config_all

Local config modification Found, will restart dict server and update configures.

[FAB ][2018-06-21 14:22:03] launch_zookeepers

[FAB ][2018-06-21 14:22:14] launch_gsql_subsystems:DICT

[FAB ][2018-06-21 14:22:16] launch_zookeepers

[FAB ][2018-06-21 14:22:27] launch_gsql_subsystems:DICT

Failed to push local config repo to dict server (Ret:200)!!!

Welcome to TigerGraph Developer Edition, for non-commercial use only.

[FAB ][2018-06-21 14:22:47] check_config

[RUN ] mkdir -p /home/tigergraph/tigergraph/bin/admin_server/;echo "ADMIN_CRON_SCRIPT=/home/tigergraph/tigergraph/.gium/GSQL/service/…/scripts/admin_crontab.sh

ADMIN_SERVICE_SCRIPT=/home/tigergraph/tigergraph/.gium/GSQL/service/…/scripts/admin_service.sh

WORK_HOME=/home/tigergraph/tigergraph

ZK_ADDRESS=127.0.0.1:19999

WORK_IP=127.0.0.1

CLUSTER_MACHINES=‘127.0.0.1’

" > /home/tigergraph/tigergraph/bin/admin_server/config.sh

[FAB ][2018-06-21 14:22:49] update_config_all

Local config modification Found, will restart dict server and update configures.

[FAB ][2018-06-21 14:23:03] launch_zookeepers

[FAB ][2018-06-21 14:23:14] launch_zookeepers

[FAB ][2018-06-21 14:23:25] launch_gsql_subsystems:DICT

Failed to push local config repo to dict server (Ret:200)!!!

Failed to config-apply

Failed to install TigerGraph platform

Jon_Herke · April 8, 2020, 8:32pm

Hi, Karol,

From the error message, we suppose the problem is related to zk connection issues.

Can you please upload some related logs for us to do some further investigation? Once you upload the logs, we can make sure.

The related file/dir we need are:

/home/tigergraph/tigergraph/logs/dict/
/home/tigergraph/tigergraph/zk/zookeeper.out*

Thanks,

Yihao

Jon_Herke · April 8, 2020, 8:33pm

Hi, Karol,

From the error message, we suppose the problem is related to zk connection issues.

Can you please upload some related logs for us to do some further investigation? Once you upload the logs, we can make sure.

The related file/dir we need are:

/home/tigergraph/tigergraph/logs/dict/

/home/tigergraph/tigergraph/zk/zookeeper.out*

Zookeeper logs are pretty monotonous: a couple of warnings and repetitive error.

Warning:

2018-06-21 14:20:10,580 [myid:] - WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:19999:NIOServerCnxn@357] - caught end of stream exception

EndOfStreamException: Unable to read additional data from client sessionid 0x164224971c40000, likely client has closed socket

    at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)

    at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)

    at java.lang.Thread.run(Thread.java:748)

2018-06-21 14:20:10,582 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:19999:NIOServerCnxn@1007] - Closed socket connection for client /127.0.0.1:53438 which had sessionid 0x164224971c40000

Errors:

2018-06-21 14:20:46,638 [myid:] - INFO [ProcessThread(sid:0 cport:-1)::PrepRequestProcessor@494] - Processed session termination for sessionid: 0x164224971c40008

2018-06-21 14:20:46,638 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:19999:NIOServerCnxn@1007] - Closed socket connection for client /127.0.0.1:53522 which had sessionid 0x164224971c40008

2018-06-21 14:20:46,639 [myid:] - ERROR [SyncThread:0:NIOServerCnxn@178] - Unexpected Exception:

java.nio.channels.CancelledKeyException

    at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)

    at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)

    at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)

    at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)

    at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)

    at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)

    at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)

2018-06-21 14:21:01,511 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:19999:NIOServerCnxnFactory@197] - Accepted socket connection from /127.0.0.1:53524

Quite a few dict logs (gdict_client_.ERROR*), but most errors/messages are like this:

Running on machine: xxx

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

E0621 14:18:19.428499 29430 address_resolver.cpp:68] AddressResolver-Resolve:Can not connect to ZK server, rc: operation timeout

E0621 14:18:19.430287 29430 gdict.cpp:311] Dictionary initialize failed.Cannot initialize resolver. Zk server: 127.0.0.1:19999, root: /tigergraph/dict/objects/__services/DICT/addresses, rc: kTimeout. Took 2058 milliseconds

…

Log file created at: 2018/06/21 14:20:38

Running on machine: xxx

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

E0621 14:20:38.280681 31923 address_resolver.cpp:96] AddressResolver cannot resolve path:/tigergraph/dict/objects/__services/DICT/addresses/DICT, rc:kNotFound

E0621 14:20:39.280998 31923 heartbeat_client.cpp:454] CLIENT: Cannot set up client session: can not resolve server , rc: kNotFound, retried: 0

E0621 14:20:39.281621 31923 address_resolver.cpp:96] AddressResolver cannot resolve path:/tigergraph/dict/objects/__services/DICT/addresses/DICT, rc:kNotFound

E0621 14:20:40.281798 31923 heartbeat_client.cpp:454] CLIENT: Cannot set up client session: can not resolve server , rc: kNotFound, retried: 1

…

Running on machine: xxx

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

E0621 14:20:44.635870 31957 address_resolver.cpp:96] AddressResolver cannot resolve path:/tigergraph/dict/objects/__services/DICT/addresses/DICT, rc:kNotFound

E0621 14:20:45.636169 31957 heartbeat_client.cpp:454] CLIENT: Cannot set up client session: can not resolve server , rc: kNotFound, retried: 0

E0621 14:20:45.637459 31957 address_resolver.cpp:96] AddressResolver cannot resolve path:/tigergraph/dict/objects/__services/DICT/addresses/DICT, rc:kNotFound

E0621 14:20:46.637643 31957 heartbeat_client.cpp:454] CLIENT: Cannot set up client session: can not resolve server , rc: kNotFound, retried: 1

E0621 14:21:27.449321 31957 gdict.cpp:635] Error found in RPC, code: 14, error msg: Endpoint read failed

E0621 14:21:27.449367 31957 gdict.cpp:635] Retry on error, retry times: 0, channel state: 3

E0621 14:21:28.435075 31957 gdict.cpp:635] Error found in RPC, code: 14, error msg: Endpoint read failed

E0621 14:21:28.435132 31957 gdict.cpp:635] Retry on error, retry times: 1, channel state: 3

E0621 14:21:29.432013 31957 gdict.cpp:635] Error found in RPC, code: 14, error msg: Endpoint read failed

E0621 14:21:29.432065 31957 gdict.cpp:635] Retry on error, retry times: 2, channel state: 3

E0621 14:21:30.431991 31957 gdict.cpp:635] Error found in RPC, code: 14, error msg: Endpoint read failed

E0621 14:21:30.432024 31957 gdict.cpp:635] Retry on error, retry times: 3, channel state: 3

E0621 14:21:31.434494 31957 gdict.cpp:635] Error found in RPC, code: 14, error msg: Endpoint read failed

E0621 14:21:31.434597 31957 gdict.cpp:635] Retry on error, retry times: 4, channel state: 3

There are no gdict_server.ERROR logs, though.

Some warnings found:

~/tigergraph/logs/dict$ cat WARNING.20180621-142125.32976

Log file created at: 2018/06/21 14:21:25

Running on machine: xxx

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

W0621 14:21:25.271512 32976 dict_core.cpp:112] Initialize Dictionary Service finished, rc: ok , dictionary root: /tigergraph/dict/objects, root node created: 0

W0621 14:21:25.329078 32976 dict_service.cpp:81] DictService started, rc: kOk

W0621 14:21:25.329097 32976 dict_service.cpp:82] Service is binded to address: 127.0.0.1:17797

And some info:

tigergraph@xxx:~/tigergraph/logs/dict$ cat gdict_server.INFO

Log file created at: 2018/06/21 14:21:25

Running on machine: xxx

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

I0621 14:21:25.212453 32976 gconfig.cpp:28] Engine_GConfig|GInfo_v set to 21845

I0621 14:21:25.212574 32976 gconfig.cpp:28] Engine_GConfig|GASSERT_v set to 0

I0621 14:21:25.212586 32976 completion_queue_manager.cpp:12] Server CQManager(0x7ffc166b92f8) constructing

I0621 14:21:25.212767 32976 dict_service.cpp:72] DictService starting…

I0621 14:21:25.215740 32981 zookeeper_context.cpp:230] Root Watcher SESSION_EVENT state = CONNECTED_STATE for path: NA

I0621 14:21:25.215749 32981 zookeeper_context.cpp:81] ZooKeeper Connection is setup. Session id: 164224971c4000b, previous client id:0

I0621 14:21:25.215752 32981 zookeeper_watcher.cpp:314] Zk Session connected, notifying watchers

I0621 14:21:25.215755 32981 zookeeper_watcher.cpp:321] → Number of watchers: 0

I0621 14:21:25.215759 32981 zookeeper_watcher.cpp:322] → Callback time used(us): 3

I0621 14:21:25.269830 32976 brain_daemon.cpp:273] Brain daemon initialized. rc: ok, zkserver: 127.0.0.1:19999, timeoutMS: 3000

W0621 14:21:25.271512 32976 dict_core.cpp:112] Initialize Dictionary Service finished, rc: ok , dictionary root: /tigergraph/dict/objects, root node created: 0

I0621 14:21:25.278863 32976 brain_daemon.cpp:443] Comm_Daemon|Election node:/tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000

I0621 14:21:25.278890 32976 brain_daemon.cpp:498] Starting Daemon, type: DICT, seq: /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000 @127.0.0.1:17797

I0621 14:21:25.279127 32981 brain_daemon.cpp:17] BRAINDAEMON Handling Leader watcher event, watch path: /tigergraph/dict/objects/__services/DICT/_election_nodes, added size: 1, removed size: 0, children count: 1, context: 0x26dfe70

I0621 14:21:25.283201 32981 brain_daemon.cpp:60] Daemon list for type DICT has changed. There are now 1 of us, original 0. I am /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000 my leader is 127.0.0.1:17797

I0621 14:21:25.285337 32981 brain_daemon.cpp:89] BRAINDAEMON Election found myself: 127.0.0.1:17797, in node: DICT@0000000000 term:0

I0621 14:21:25.294715 32981 zookeeper_context.cpp:789] Parents to create: /gdbms/addresses

I0621 14:21:25.299448 32981 brain_daemon.cpp:591] Comm_Daemon|BRAINDAEMON Assigned Leader: Brain Daemon with seq ID: /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000, became the leader of type: DICT, my id: 127.0.0.1:17797, updated to: 127.0.0.1:17797, rc: kOk

I0621 14:21:25.299458 32981 brain_daemon.cpp:576] Comm_Daemon|BRAINDAEMON Become Leader: Brain Daemon with seq ID: /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000, became the leader of type: DICT, my id: 127.0.0.1:17797, updated to: 127.0.0.1:17797

I0621 14:21:25.299460 32981 dict_core.cpp:370] Becoming Dictionary Service primary, my id: /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000, my address: 127.0.0.1:17797, my leader: 127.0.0.1:17797

I0621 14:21:25.329062 32976 brain_daemon.cpp:515] Daemon @127.0.0.1:17797 of type DICT with ID /tigergraph/dict/objects/__services/DICT/_election_nodes/DICT@0000000000 started with leader 127.0.0.1:17797

I0621 14:21:25.329074 32976 dict_core.cpp:361] Dictionary Daemon is starting…

W0621 14:21:25.329078 32976 dict_service.cpp:81] DictService started, rc: kOk

W0621 14:21:25.329097 32976 dict_service.cpp:82] Service is binded to address: 127.0.0.1:17797

I0621 14:21:25.330451 32987 completion_queue_manager.cpp:89] Server CompletionQueue (0x26dbf00) begin processing.

I0621 14:21:25.330471 32976 async_server.cpp:39] Server listening on 127.0.0.1:17797

I0621 14:21:25.330559 32988 completion_queue_manager.cpp:89] Server CompletionQueue (0x26d98f0) begin processing.

I0621 14:21:25.330600 32989 single_thread_worker.cpp:85] SingleThreadWorker start: HeartbeatSessionManager

Jon_Herke · April 8, 2020, 8:33pm

Hi, Karol,

What’s your OS?

Do you have linux command “nc" in your system?

Can you provide the output of ~/.gsql/fab_dir/cmd_logs/launch_zookeepers.log?

Thanks,

Yihao

Jon_Herke · April 8, 2020, 8:33pm

Hi, Karol,

What’s your OS?

Do you have linux command “nc" in your system?

Can you provide the output of ~/.gsql/fab_dir/cmd_logs/launch_zookeepers.log?

Thanks,

Yihao

OS:

$ lsb_release -a

LSB Version: core-9.20160110ubuntu0.2-amd64:core-9.20160110ubuntu0.2-noarch:printing-9.20160110ubuntu0.2-amd64:printing-9.20160110ubuntu0.2-noarch:security-9.20160110ubuntu0.2-amd64:security-9.20160110ubuntu0.2-noarch

Distributor ID: Ubuntu

Description: Ubuntu 16.04.4 LTS

Release: 16.04

Codename: xenial

The log:

tigergraph@brejnak:~/.gsql/fab_dir/cmd_logs$ cat launch_zookeepers.log

2018-06-21 14:19:54 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:19:54 [localhost] local: ps -eo uname:10,pid,cmd | grep ‘tigergraph.*[o]rg.apache.zookeeper.server.quorum.QuorumPeerMain’ | awk ‘{ print $2 }’

2018-06-21 14:19:54 On host 127.0.0.1, no zookeeper is running.

2018-06-21 14:19:54 [localhost] local: /bin/netstat -tulnp | grep LISTEN || true

2018-06-21 14:19:55 On host 127.0.0.1, while starting zookeeper, port: 19999 is free.

2018-06-21 14:19:55 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:19:55 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:19:56 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:20:06 Fabric Cmd Result:{‘’: None}

2018-06-21 14:21:02 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:21:02 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:21:02 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:21:02 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:21:12 Fabric Cmd Result:{‘’: None}

2018-06-21 14:21:12 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:21:12 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:21:13 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:21:13 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:21:23 Fabric Cmd Result:{‘’: None}

2018-06-21 14:22:03 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:22:03 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:22:03 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:22:04 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:22:14 Fabric Cmd Result:{‘’: None}

2018-06-21 14:22:16 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:22:16 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:22:16 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:22:16 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:22:27 Fabric Cmd Result:{‘’: None}

2018-06-21 14:23:03 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:23:03 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:23:03 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:23:04 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:23:14 Fabric Cmd Result:{‘’: None}

2018-06-21 14:23:14 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:23:14 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:23:14 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:23:15 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:23:25 Fabric Cmd Result:{‘’: None}

2018-06-21 14:28:30 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:28:30 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:28:31 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:28:31 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:28:41 Fabric Cmd Result:{‘’: None}

2018-06-21 14:28:41 [[tiger…@127.0.0.1](javascript:)] Executing task ‘launch_zookeeper’

2018-06-21 14:28:41 [localhost] local: if [ -f zookeeper.out ]; then mv zookeeper.out zookeeper.out.date +%Y.%m.%d-%H.%M.%S; fi

2018-06-21 14:28:42 [localhost] local: export JVMFLAGS=‘-Djute.maxbuffer=8388608’;unset ZOOCFGDIR;/home/tigergraph/tigergraph/zk/bin/zkServer.sh start;

2018-06-21 14:28:42 [localhost] local: which nc > /dev/null 2>&1; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

2018-06-21 14:28:52 Fabric Cmd Result:{‘’: None}

Jon_Herke · April 8, 2020, 8:33pm

Hi, Karol,

Can you try to use “nc” in your OS? It should be installed in your system.

Thanks,

Yihao

Jon_Herke · April 8, 2020, 8:35pm

Hi, Karol,

Can you run the following command for me?

which nc; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

Thanks,

Yihao

Jon_Herke · April 8, 2020, 8:35pm

Hi Karol,

‘nc’ should be included in our system prerequisite package, before you run this command, please:

source ~/.bash_tigergraph

to add it into the PATH.

Thanks,

Dadong

Jon_Herke · April 8, 2020, 8:35pm

Here is the output:

~/workspace/tigergraph-2.1.2-developer$ which nc; if [ ? -eq 0 ]; then echo stat | nc 127.0.0.1 19999; if [ ? -ne 0 ]; then echo; fi; else echo Zxid; fi

/bin/nc

Zookeeper version: 3.4.6-1569965, built on 02/20/2014 09:09 GMT

Clients:

/127.0.0.1:459001

/127.0.0.1:458781

/127.0.0.1:460460

Latency min/avg/max: 0/0/8

Received: 1719

Sent: 1723

Connections: 3

Outstanding: 0

Zxid: 0x91

Mode: standalone

Node count: 100

Jon_Herke · April 8, 2020, 8:35pm

Zookeeper seems to be working. So is Kafka.

See:

~/workspace/tigergraph-2.1.2-developer$ kafka-topics.sh --list --zookeeper 127.0.0.1:19999

deltaQ_GPE_1Q

post_log_Q_RESTPP_1Q

Jon_Herke · April 8, 2020, 8:35pm

Hi, Karol,

Thanks for the details.

The environment of tigergraph system looks all right. I suppose your installation is succeeded now, right?

So go back to the original problem, the zookeeper seems not work around 2018-06-21 14:22:27 and 2018-06-21 14:23:25.

Can you provide more logging of tigergraph services around this two time period (better if you can upload the logging files)?

Thanks,

Yihao

Jon_Herke · April 8, 2020, 8:35pm

Hey I got the same issue. How did you resolve it?

Jon_Herke · April 8, 2020, 8:35pm

Never resolved it.

I stopped trying after a docker image was provided for TigerGraph…

I’d be interested in a solution, though…

Jon_Herke · April 8, 2020, 8:35pm

Hi Karol,

Can you please check if you have proxy set in your environment? If yes, please disable it and retry installation.

Thanks,

Chengbiao

Jon_Herke · April 8, 2020, 8:36pm

The proxy is definitely set in my env.

Will check if unsetting it works for me in a few days.

Thanks!

Jon_Herke · April 8, 2020, 8:36pm

Hello

I am getting a similar error. My dict, ngnix, restpp, and gsql processes fail to start. II am not using any container, it is installed directly on UBUNTU 16.04.

The logs are as below:

dict:

log file created at: 2019/10/15 15:59:32

Running on machine:

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

E1015 15:59:32.500828 261653 channel_pool.cpp:55] Can not create channel to target: 127.0.0.1:17797, State:3

E1015 15:59:34.502842 261653 channel_pool.cpp:55] Can not create channel to target: 127.0.0.1:17797, State:3

ngnix, respp: no logs created

gsql_server:

GSQL Shell log

2019-10-15 15:32:38.732

2.4,tg_2.4.0_dev,f422d403dab4db5c96bd22822e79e7fd5a581283,f6b4892ad3be8e805d49ffd05ee2bc7e7be10dff

DEVELOPER_EDITION

PATH:/.syspre/usr/lib/jvm/java-8-openjdk-amd64-1.8.0.171/jre/bin:/proj/isi_group/isim/anaconda2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin://.gium

BuildTime: Tue Jun 11 10:53:31 PDT 2019

I@20191015 15:32:38.748 (Util.java:262) gcc path: //.syspre/usr/bin/g++

I@20191015 15:32:38.753 (Util.java:2064) /scratch/tigergraph/.license/lic_endpoint exists false

I@20191015 15:32:38.757 (Util.java:2091) license expires at 31/12/2265

I@20191015 15:32:38.757 (Util.java:2101) lic: 9340876800 cur: 1571178758

I have following OS:

NAME=“Ubuntu”

VERSION=“16.04.5 LTS (Xenial Xerus)”

ID=ubuntu

ID_LIKE=debian

PRETTY_NAME=“Ubuntu 16.04.5 LTS”

VERSION_ID=“16.04”

It worked a month back on the same machine. I have not upgraded OS since then. Any help in finding a workaround/fix would be greatly appreciated.

Thank you,

Kumar

Jon_Herke · April 8, 2020, 8:36pm

Can you confirm that all ports are reachable? Many of the processes communicate w/each other over a myriad of ports. Perhaps some firewall rules have changed recently.

Brian Hall

[bria…@experoinc.com](javascript:)

917-287-4506

Jon_Herke · April 8, 2020, 8:37pm

Hi Kumar,

Can you also share your env settings if possible?

Jon_Herke · April 8, 2020, 8:37pm

Hello Brian,

Thank you for responding to my email! I was assuming that ~/.bashrc modified by install.sh would have sourced right scripts. But, it turns out that I still manually needed to source ~/.bash_tigergraph.

I am able to run tigergraph now. Thanks again for your help!
Kumar