Failed to start services, daemon exiting

1

Hi
I cannot start Dremio

dremio.conf

services: {
coordinator.enabled: true,
coordinator.master.enabled: true,
executor.enabled: true,
services.coordinator.master.embedded-zookeeper.enabled: false,

services.coordinator.embedded_master_zk.enabled: false,

zookeeper: “10.60.241.31:2181,10.60.241.32:2181”

Could you help me?

2

Hi @dsidi

Can you please send us the sever.log and server.out?

Dremio Logs

Thanks,
@balaji.ramaswamy

3

Server.zip (7.6 KB)

Done
server.log and server.out upload

4

image
image.png1305×613 45.4 KB

Zookeeper is up and running, port 2181

5

It feels like you have last property inside curly braces - if it is, word “services” should NOT be prepending coordinator.master.embedded-zookeeper.enabled: false

services: {
coordinator.enabled: true,
coordinator.master.enabled: true,
executor.enabled: true,
coordinator.master.embedded-zookeeper.enabled: false
}

zookeeper: “10.60.241.31:2181,10.60.241.32:2181”

It feels that Dremio tries to start embedded Zookeeper while you have one running

6

Hi
Is not working
[root@swarm-manager-dev01 conf]# sudo service dremio start
starting dremio, logging to /var/log/dremio/server.out
[root@swarm-manager-dev01 conf]# sudo service dremio status
dremio is running.
[root@swarm-manager-dev01 conf]# sudo service dremio status
/var/run/dremio/dremio.pid file is present but dremio not running.
[root@swarm-manager-dev01 conf]#

services: {
coordinator.enabled: true,
coordinator.master.enabled: true,
executor.enabled: true,
coordinator.master.embedded-zookeeper.enabled: false
}
zookeeper: “10.60.241.31:2181,10.60.241.32:2181”

Could you help me?

7

Hi
I putted down Zookeeper with Ambari and Dremio Started
So, coordinator.master.embedded-zookeeper.enabled: false is not workig

Could you help me?

9

It look like the problem is this

Catastrophic failure occurred. Exiting. Information follows: Failed to start services, daemon exiting.
java.lang.RuntimeException: java.net.BindException: Address already in use
at com.google.common.base.Throwables.propagate(Throwables.java:160)
at com.dremio.dac.daemon.ZkServer.init(ZkServer.java:111)

It looks like the port specified is already in use?

Can you kill the Dremio process and upload netstat -an output?

10

output.zip (4.4 KB)

[root@swarm-manager-dev01 hive]# sudo service dremio status
dremio not running.

11

It looks like 2181 is already established on the IP u have given,

10.60.241.31:2181 ESTABLISHED

So when you try to start it fails with “Address already in use”

12

Yes you are correct
Zookeeper is using this port.

How can I make Dremio not use port 2181 or disable the embedded zookeeper and use the external one?

13

Please make you you have following settings in your dremio.conf:

zookeeper: "<ZOOKEEPER_HOST_1>:2181,<ZOOKEEPER_HOST_2>:2181"
services.coordinator.master.embedded-zookeeper.enabled: false

And NO other settings about embedded Zookeeper under any sections (to simplify things).

  1. Please make sure dremio.conf you modify is the one that dremio is using while starting
    a. If you installed using rpm dremio.conf that will be used is located here: /etc/dremio/dremio.conf
  2. Make sure you restart dremio after dremio.conf update
14

Hi
I made these changes in
/etc/dremio/dremio.conf
and
/home/hive/dremio/dremio-community-1.4.4-201801230630490666-6d69d32/conf
but did not work

15

Please look at the logs regarding errors - are they the same as before or different?
Also if you don’t mind post content of your dremio.conf
and
result of the command ps -aef | grep Dremio

16

Hi
dremio.conf
zookeeper: “10.60.241.31:2182,10.60.241.32:2182”
services.coordinator.master.embedded-zookeeper.enabled: false

[root@swarm-manager-dev01 dremio]# sudo service dremio status
dremio is running.

Regards

I’m trying to start using Dremio http://10.60.241.31:9047/
But Firefox could not establish the connection
Could you help me?