# I can't find way thru deploying on premises clusters

**URL:** <https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775>\
**Category:** Uncategorized\
**Created:** [July 29, 2019, 2:37pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775 "2019-07-29T14:37:50Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![victorbertoldo](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/victorbertoldo/32/2744_2.png) [@victorbertoldo](https://community.dremio.com/u/victorbertoldo)\
**Post date:** [July 29, 2019, 2:37pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/1 "2019-07-29T14:37:50Z")

</div>

# I’m trying to deploy a local cluster on my datacenter, but isn’t work.

I Did a deploy on 2 Servers on same network, disabled the firewall from bolth hosts, but its not working.

##On Coordinator, I have these log mensages:

```
2019-07-29 14:32:55,575 [out-of-band-observer] INFO query.logger - {"queryId":"22c0fc67-8be5-4e2e-ed4f-e62fee35a800","schema":"[sys]","queryText":"select\n 'green' as status,\n nodes.hostname name,\n nodes.ip_address ip,\n nodes.fabric_port port,\n cpu cpu,\n memory memory \nfrom\n sys.nodes,\n (select\n hostname,\n fabric_port,\n sum(cast(cpuTime as float) / cores) cpu \n from\n sys.threads \n group by\n hostname,\n fabric_port) cpu,\n (select\n hostname,\n fabric_port,\n direct_current * 100.0 / direct_max as memory \n from\n sys.memory) memory \nwhere\n nodes.hostname = cpu.hostname \n and nodes.fabric_port = cpu.fabric_port \n and nodes.hostname = memory.hostname \n and nodes.fabric_port = memory.fabric_port \norder by\n name,\n port","start":1564410775271,"finish":1564410775572,"outcome":"FAILED","username":"dremio"}
2019-07-29 14:32:55,576 [qtp1735356636-84] WARN c.dremio.dac.resource.SystemResource - No executors currently available.

```

##On Executor node:

```
 Caused By (java.lang.UnsupportedOperationException) non-master coordinators or executors do not support dataset listing
    com.dremio.service.listing.DatasetListingService$1.getSources():83
    com.dremio.service.listing.DatasetListingInvoker$3.handle():174
    com.dremio.service.listing.DatasetListingInvoker$3.handle():168
    com.dremio.services.fabric.simple.ProtocolBuilder$SimpleProtocol.handle():171
    com.dremio.services.fabric.FabricMessageHandler.handle():77
    com.dremio.services.fabric.FabricServer.handle():84
    com.dremio.services.fabric.FabricServer.handle():39
    com.dremio.exec.rpc.RpcBus$RequestEvent.run():462
    com.dremio.common.SerializedExecutor$RunnableProcessor.run():96
    com.dremio.exec.rpc.RpcBus$SameExecutor.execute():328
    com.dremio.common.SerializedExecutor.execute():129
    com.dremio.exec.rpc.RpcBus$InboundHandler.decode():362
    com.dremio.exec.rpc.RpcBus$InboundHandler.decode():333
    io.netty.handler.codec.MessageToMessageDecoder.channelRead():88
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():362
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():348
    io.netty.channel.AbstractChannelHandlerContext.fireChannelRead():340
    io.netty.handler.timeout.IdleStateHandler.channelRead():286
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():362
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():348
    io.netty.channel.AbstractChannelHandlerContext.fireChannelRead():340
    io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead():310
    io.netty.handler.codec.ByteToMessageDecoder.channelRead():284
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():362
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():348
    io.netty.channel.AbstractChannelHandlerContext.fireChannelRead():340
    io.netty.channel.ChannelInboundHandlerAdapter.channelRead():86
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():362
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():348
    io.netty.channel.AbstractChannelHandlerContext.fireChannelRead():340
    io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead():1414
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():362
    io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead():348
    io.netty.channel.DefaultChannelPipeline.fireChannelRead():945
    io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read():146
    io.netty.channel.nio.NioEventLoop.processSelectedKey():645
    io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized():580
    io.netty.channel.nio.NioEventLoop.processSelectedKeys():497
    io.netty.channel.nio.NioEventLoop.run():459
    io.netty.util.concurrent.SingleThreadEventExecutor$5.run():886
    java.lang.Thread.run():748

        at com.dremio.service.listing.DatasetListingInvoker.getSources(DatasetListingInvoker.java:321) ~[dremio-services-namespace-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.exec.catalog.PluginsManager.start(PluginsManager.java:148) ~[dremio-sabot-kernel-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.exec.catalog.CatalogServiceImpl.start(CatalogServiceImpl.java:162) ~[dremio-sabot-kernel-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.service.SingletonRegistry$AbstractServiceReference.start(SingletonRegistry.java:137) ~[dremio-common-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.dac.daemon.NonMasterSingletonRegistry.start(NonMasterSingletonRegistry.java:54) ~[dremio-dac-backend-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.dac.daemon.DACDaemon.startServices(DACDaemon.java:183) ~[dremio-dac-backend-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.dac.daemon.DACDaemon.init(DACDaemon.java:189) ~[dremio-dac-backend-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]
        at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:102) ~[dremio-dac-daemon-3.2.8-201907180222520740-08f2b54.jar:3.2.8-201907180222520740-08f2b54]

```

Please, somebody help me! This thing its driving me crasy

---

<div class="post-metadata">

**Author:** ![ben](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/ben/32/1367_2.png) [@ben](https://community.dremio.com/u/ben)\
**Post date:** [July 29, 2019, 5:29pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/2 "2019-07-29T17:29:44Z")

</div>

Can you share the `dremio.conf` for the coordinator _and_ the executors.

The _executor_ should have this configuration:

```auto
services: {
  coordinator: {
    enabled: false
    master: {
      enabled: false
    }
  }
  executor: {
    enabled: true
  }
}

```

---

<div class="post-metadata">

**Author:** ![victorbertoldo](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/victorbertoldo/32/2744_2.png) [@victorbertoldo](https://community.dremio.com/u/victorbertoldo)\
**Post date:** [July 29, 2019, 5:32pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/3 "2019-07-29T17:32:56Z")

</div>

My executor is like this:

```
paths: {
  # the local path for dremio to store data.
  local: "/var/lib/dremio"

  # the distributed path Dremio data including job results, downloads, uploads, etc
  #dist: "pdfs://"${paths.local}"/pdfs"
}

services: {
  coordinator.enabled: false,
  coordinator.master.enabled: false,
  executor.enabled: true
}

zookeeper: "coordinator:2181"

```

It is wrong?

---

<div class="post-metadata">

**Author:** ![ben](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/ben/32/1367_2.png) [@ben](https://community.dremio.com/u/ben)\
**Post date:** [July 29, 2019, 9:55pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/4 "2019-07-29T21:55:25Z")

</div>

@victorbertoldo, this: `zookeeper: "coordinator:2181"` would only be correct if `coordinator` is indeed the hostname of the Dremio coordinator. For that value, you want the internal IP or some hostname for the coordinator that is resolvable from executor.

---

<div class="post-metadata">

**Author:** ![victorbertoldo](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/victorbertoldo/32/2744_2.png) [@victorbertoldo](https://community.dremio.com/u/victorbertoldo)\
**Post date:** [July 30, 2019, 5:31pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/5 "2019-07-30T17:31:25Z")

</div>

Thats the hostname indeed.

---

<div class="post-metadata">

**Author:** ![rlin](https://avatars.discourse-cdn.com/v4/letter/r/49beb7/32.png) [@rlin](https://community.dremio.com/u/rlin)\
**Post date:** [October 16, 2019, 2:56pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/6 "2019-10-16T14:56:30Z")

</div>

I run into the same issue. Were you able to resolve it?

---

<div class="post-metadata">

**Author:** ![rlin](https://avatars.discourse-cdn.com/v4/letter/r/49beb7/32.png) [@rlin](https://community.dremio.com/u/rlin)\
**Post date:** [October 16, 2019, 3:10pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/7 "2019-10-16T15:10:55Z")

</div>

My setup is in AWS, we got the same error message:

2019-10-15 19:49:13,247 [FABRIC] WARN com.dremio.metrics.Metrics - Removing old metric since name matched newly registered metric. Metric name: FABRIC-send-durations-ms  
2019-10-15 19:49:13,361 [FABRIC-rpc-event-queue] ERROR c.d.services.fabric.FabricServer - UnsupportedOperationException: non-master coordinators or executors do not support dataset listing  
com.dremio.common.exceptions.UserException: **UnsupportedOperationException: non-master coordinators or executors do not support dataset listing**  
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:776) ~[dremio-common-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$ResponseSenderImpl.sendFailure(RpcBus.java:287) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$ResponseSenderImpl.sendFailure(RpcBus.java:273) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$RequestEvent.run(RpcBus.java:464) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.common.SerializedExecutor$RunnableProcessor.run(SerializedExecutor.java:96) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$SameExecutor.execute(RpcBus.java:328) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.common.SerializedExecutor.execute(SerializedExecutor.java:129) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:362) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]  
at com.dremio.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:333) [dremio-services-base-rpc-4.0.1-201909191652190301-211720e.jar:4.0.1-201909191652190301-211720e]

Caused By (java.lang.UnsupportedOperationException) non-master coordinators or executors do not support dataset listing  
com.dremio.service.listing.DatasetListingService$1.getSources():83  
com.dremio.service.listing.DatasetListingInvoker$3.handle():172  
com.dremio.service.listing.DatasetListingInvoker$3.handle():166  
com.dremio.services.fabric.simple.ProtocolBuilder$SimpleProtocol.handle():173  
com.dremio.services.fabric.FabricMessageHandler.handle():82  
com.dremio.services.fabric.FabricServer.handle():84  
com.dremio.services.fabric.FabricServer.handle():39

---

<div class="post-metadata">

**Author:** ![rlin](https://avatars.discourse-cdn.com/v4/letter/r/49beb7/32.png) [@rlin](https://community.dremio.com/u/rlin)\
**Post date:** [October 16, 2019, 3:14pm UTC](https://community.dremio.com/t/i-cant-find-way-thru-deploying-on-premises-clusters/3775/8 "2019-10-16T15:14:26Z")

</div>

I confirm that executor is able to connect to coordinator zookeeper (embedded)

From executor:  
[root@ip-10-83-21-82 conf]# nc -zv 10.83.20.141 2181  
Connection to 10.83.20.141 2181 port [tcp/eforward] succeeded!

From coordinator:  
[ec2-user@ip-10-83-20-141 conf]$ sudo lsof -i -P -n | grep 2181  
java 14812 dremio 472u IPv6 25164 0t0 TCP \*:2181 (LISTEN)  
java 14812 dremio 477u IPv6 25168 0t0 TCP 127.0.0.1:37114-\>127.0.0.1:2181 (ESTABLISHED)  
java 14812 dremio 478u IPv6 25901 0t0 TCP 127.0.0.1:2181-\>127.0.0.1:37114 (ESTABLISHED)

–update–  
fixed it by setting this property in coordinator dremio.conf  
registration.publish-host: “\<coordinator-host-name\>”  
zookeeper: “\<coordinator-host-name\>:2181”
