Dremio not starting getting Address already in use

1

Fri Sep 8 14:21:12 MDT 2017 Starting dremio
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 63397
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 4096
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Catastrophic failure occurred. Exiting. Information follows: Failed to start services, daemon exiting.
java.lang.RuntimeException: java.net.BindException: Address already in use
at com.google.common.base.Throwables.propagate(Throwables.java:160)
at com.dremio.dac.daemon.ZkServer.init(ZkServer.java:111)
at com.dremio.dac.daemon.ZkServer.start(ZkServer.java:74)
at com.dremio.service.SingletonRegistry$AbstractServiceReference.start(SingletonRegistry.java:137)
at com.dremio.service.ServiceRegistry.start(ServiceRegistry.java:74)
at com.dremio.service.SingletonRegistry.start(SingletonRegistry.java:33)
at com.dremio.dac.daemon.DACDaemon.startPreServices(DACDaemon.java:165)
at com.dremio.dac.daemon.DACDaemon.init(DACDaemon.java:175)
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:110)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:90)
at org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:117)
at com.dremio.dac.daemon.ZkServer$ZkEmbeddedServer.run(ZkServer.java:142)
at java.lang.Thread.run(Thread.java:748)

2

Dremio starts Zookeeper server unless one specifies external Zookeeper server to use.
Saying that - do you have Zookeeper server running on the same node (it uses port 2181 by default) or any other process running on port 2181?

3

Thanks. That was the issue. Zookeeper from Drill was running.

1 Like
4

Hi,

how one can point dremio to use external zookeeper? I did not find any option in /etc/dremio/dremo.conf file

5

You can check the reference for dremio.conf configuration file at https://docs.dremio.com/advanced-administration/configuration-files.html#dremio-configuration-file

There are two settings of interest in your case:

  • zookeeper which points to the zookeeper quorum to use for coordination
  • services.coordinator.embedded_master_zk.enabled which turns on/off the embedded zookeeper server (running by default on port 2181)
6

I think @laurent replied already
Let me know if you need more info

1 Like