Dremio Hangs on startup!

1
  1. The Mapr version i m using is 5.2.0
  2. i downloaded the tarball from dremio: dremio-community-1.3.1-201712020435270019-a7af5c8-mapr.tar.gz ; logged in to root user and installed the tarball with commands from: https://docs.dremio.com/deployment/standalone-tarball.html (removing the sudo part as i am already root)
  3. once all the installation was done i used this command: service dremio start to start dremio
  4. when i do jps i see the Dremio running. HOwever, if i open its logs i see that its stuck at: Starting ZKClusterClient (full log attached) --its stuck there for ever (even after 1hr its there only) – nor is the page : http://:9047/ … opening
  5. The thread dump made no sense to me (attached)

Any help is appreciated.

dremio.zip (2.8 KB)

2

Any message in server.out? Also, do you have a zookeeper instance already (maybe provided by the MapR distribution) and running on the same port?

3

Yes… but of hardly any help

Mon Jan 15 23:56:57 IST 2018 Starting dremio on hyd-lab4
core file size          (blocks, -c) unlimited
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 30
file size               (blocks, -f) unlimited
pending signals                 (-i) 256914
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 65535
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) unlimited
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

We have zookeeper already running on port 2181. infact the serverl.log says it has connected to zookeeper already…

2018-01-15 23:57:00,780 [main] INFO  com.dremio.dac.daemon.ZkServer - Starting Zookeeper
2018-01-15 23:57:01,786 [main] INFO  com.dremio.dac.daemon.ZkServer - Zookeeper is up at localhost:2181
2018-01-15 23:57:01,873 [main] INFO  c.d.s.coordinator.zk.ZKClusterClient - Starting ZKClusterClient

I have installed dremio on mapr community servers. Our mapr server version is 5.2.2 – may be it could be of some help

4

In MapR distro you need to use MapR zookeeper for Dremio. I suggest you follow Dremio MapR documentation (https://docs.dremio.com/deployment/yarn-deployment.html#mapr-deployment-yarn).

Update dremio.conf with following

zookeeper: “<ZOOKEEPER_HOST>:5181”
services: {
coordinator.embedded_master_zk.enabled:false
}

1 Like
5

hey!

thank u very much. It worked. Now i would like to query the mapr json db. Let me tryout. Thank you onceagain for the help extended.

Super!