Error while connecting hive to dremio

1

When I am trying to connect dremio with hive but I am getting error .I am putting the log file details .Pls help
tty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
Caused by: java.util.concurrent.TimeoutException: null
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:432) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:68) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractCheckedFuture.checkedGet(AbstractCheckedFuture.java:104) ~[guava-20.0.jar:na]
at com.dremio.exec.catalog.CatalogServiceImpl.createOrUpdateSource(CatalogServiceImpl.java:627) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]

2

HI @abhba

Can you attach the server,log and the screenshot for the hive source settings

@Venugopal_Menda

3

yes venu thank you connecting.pls check the log below

2019-04-09 08:25:07,175 [Plugin Startup: Hive] INFO c.d.e.store.hive.HiveStoragePlugin - Hive Metastore SASL enabled. Kerberos principal: hive/devupgnew4.azure.ril.com@hydhdpdevupg.ril.com
2019-04-09 08:25:09,108 [catalog-source-synchronization] WARN c.d.exec.catalog.CatalogServiceImpl - Failure while synchronizing sources.
2019-04-09 08:27:07,175 [qtp994889306-585] INFO c.d.exec.catalog.CatalogServiceImpl - User Error Occurred [ErrorId: 47e6b3a1-0636-441d-8004-332655949e1c]
com.dremio.common.exceptions.UserException: Failure while configuring source [Hive]
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:746) ~[dremio-common-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.createOrUpdateSource(CatalogServiceImpl.java:639) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.createSource(CatalogServiceImpl.java:378) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.access$600(CatalogServiceImpl.java:102) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl$SourceModifier.createSource(CatalogServiceImpl.java:972) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogImpl.createSource(CatalogImpl.java:519) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.DelegatingCatalog.createSource(DelegatingCatalog.java:189) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:157) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:148) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:144) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:80) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_201]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_201]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_201]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_201]
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
Caused by: java.util.concurrent.TimeoutException: null
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:432) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:68) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractCheckedFuture.checkedGet(AbstractCheckedFuture.java:104) ~[guava-20.0.jar:na]
at com.dremio.exec.catalog.CatalogServiceImpl.createOrUpdateSource(CatalogServiceImpl.java:627) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]

4

Pls check the log timing Venu Earlier I was getting this issue .

2019-04-09 05:43:09,107 [catalog-source-synchronization] WARN c.d.exec.catalog.CatalogServiceImpl - Failure while synchronizing sources.
2019-04-09 05:43:10,992 [Plugin Startup: Hive] ERROR o.a.thrift.transport.TSaslTransport - SASL negotiation failure
javax.security.sasl.SaslException: GSS initiate failed
at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) ~[na:1.8.0_201]
at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) [libthrift-0.9.3.jar:0.9.3]
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) ~[libthrift-0.9.3.jar:0.9.3]
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) [libthrift-0.9.3.jar:0.9.3]
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) [dremio-hive-exec-shaded-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) [dremio-hive-exec-shaded-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_201]
at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_201]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836) [hadoop-common-2.8.3.jar:na]
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) [dremio-hive-exec-shaded-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:477) [hive-metastore-2.1.1-dremio-201811301814460298-e73bd7f.jar:2.1.1-dremio-201811301814460298-e73bd7f]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:285) [hive-metastore-2.1.1-dremio-201811301814460298-e73bd7f.jar:2.1.1-dremio-201811301814460298-e73bd7f]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:210) [hive-metastore-2.1.1-dremio-201811301814460298-e73bd7f.jar:2.1.1-dremio-201811301814460298-e73bd7f]
at com.dremio.exec.store.hive.HiveClient$1.run(HiveClient.java:148) [dremio-hive-plugin-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.store.hive.HiveClient$1.run(HiveClient.java:145) [dremio-hive-plugin-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.store.hive.HiveClient$9.run(HiveClient.java:321) [dremio-hive-plugin-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_201]
at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_201]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836) [hadoop-common-2.8.3.jar:na]
at com.dremio.exec.store.hive.HiveClient.doAsCommand(HiveClient.java:318) [dremio-hive-plugin-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]

5

Can you check once the user trying to add the hive source has the required previlages. Are you able to login to hive directly with the same user can you check?.

For double check, please verify the user impersonation is true or false.

@Venugopal_Menda

6

if you are talking about dremio user it has all the privileges and Impersonation is true only .Still not able to connect and please look into the second error log also .

7

Hi @abhba

Can you change the property hive.server2.enable.doAs to false under advanced options in the hive source settings and try. If it fails again please upload the server.log file

@Venugopal_Menda

8

I can’t make it false .And if i am doing it what will be the after affect ??

9

Hi @abhba,

Based on the information you have shared, this looks like a Kerberos misconfiguration on the Dremio host. Please do the following:

  1. Ensure the Kerberos client is properly configured on the Dremio host.
  2. Verify the Dremio host can communicate with the specified Kerberos Realm servers.
  3. Make sure your Dremio keytab is valid and make sure you can generate a ticket successfully using kinit (or another Kerberos init utility).
  4. Check to see if the Hive principal is correct (stack trace indicates that hive/devupgnew4.azure.ril.com@hydhdpdevupg.ril.com is your Hive principal)

If you’re still having trouble, please upload your entire server.log to this thread. There may be something else in the log that we can use to help you that we’re missing with the shared stack traces.

Thanks!

-Sam

10

Hi sam,
I checked all the parameters .Now I am not able to open my UI
2019-04-10 12:07:43,002 [main] ERROR ROOT - Dremio is exiting. Failure while starting services. Error log is below.

2019-04-10 12:07:43,002 [main] ERROR ROOT - Dremio is exiting. Failure while starting services.
com.typesafe.config.ConfigException$BadPath: dremio.conf: 35: path has a leading, trailing, or two adjacent period ‘.’ (use quoted “” empty string if you want an empty element)
at com.typesafe.config.impl.Parser.parsePathExpression(Parser.java:1110) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser.parsePathExpression(Parser.java:1049) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser.access$000(Parser.java:27) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.parseKey(Parser.java:597) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.parseObject(Parser.java:757) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.parseValue(Parser.java:520) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.consolidateValueTokens(Parser.java:400) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.parseObject(Parser.java:796) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser$ParseContext.parse(Parser.java:993) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parser.parse(Parser.java:34) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable.rawParseValue(Parseable.java:222) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable$ParseableResources.rawParseValue(Parseable.java:602) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable$ParseableResources.rawParseValue(Parseable.java:554) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable.parseValue(Parseable.java:176) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable.parseValue(Parseable.java:170) ~[config-1.2.1.jar:na]
at com.typesafe.config.impl.Parseable.parse(Parseable.java:227) ~[config-1.2.1.jar:na]
at com.typesafe.config.ConfigFactory.parseResources(ConfigFactory.java:794) ~[config-1.2.1.jar:na]
at com.typesafe.config.ConfigFactory.parseResources(ConfigFactory.java:747) ~[config-1.2.1.jar:na]
at com.typesafe.config.ConfigFactory.parseResources(ConfigFactory.java:751) ~[config-1.2.1.jar:na]
at com.dremio.config.DremioConfig.create(DremioConfig.java:274) ~[dremio-common-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.config.DremioConfig.create(DremioConfig.java:245) ~[dremio-common-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.config.DremioConfig.create(DremioConfig.java:241) ~[dremio-common-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.server.DACConfig.newConfig(DACConfig.java:199) ~[dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:90) ~[dremio-dac-daemon-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
(END)

11

Complete log files .

an executor.
2019-04-10 12:30:00,938 [main] INFO com.dremio.common.config.SabotConfig - Configuration and plugin file(s) identified in 27ms.
Base Configuration:
- jar:file:/opt/dremio/jars/dremio-common-3.1.7-201903210426240688-c843b51.jar!/sabot-default.conf

Intermediate Configuration and Plugin files, in order of precedence:
- jar:file:/opt/dremio/jars/dremio-common-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-yarn-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-provision-common-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-datastore-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-dac-common-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-accelerator-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-jobs-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-namespace-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-coordinator-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-users-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-options-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-sabot-logical-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-resourcescheduler-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-pdfs-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-services-configuration-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-dac-daemon-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-s3-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-mongo-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-hive-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-hbase-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-jdbc-plugin-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-sabot-scheduler-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf
- jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-3.1.7-201903210426240688-c843b51.jar!/sabot-module.conf

2019-04-10 12:30:02,119 [main] INFO c.dremio.dac.daemon.DACDaemonModule - Internal user/group service is configured.
2019-04-10 12:30:02,527 [main] INFO com.dremio.dac.daemon.ZkServer - Starting Zookeeper
2019-04-10 12:30:03,533 [main] INFO com.dremio.dac.daemon.ZkServer - Zookeeper is up at localhost:2181
2019-04-10 12:30:03,647 [main] INFO c.d.s.coordinator.zk.ZKClusterClient - Starting ZKClusterClient
2019-04-10 12:30:03,673 [Curator-ConnectionStateManager-0] INFO c.d.s.coordinator.zk.ZKClusterClient - ZK connection state changed to CONNECTED
2019-04-10 12:30:03,759 [main] INFO c.d.s.c.zk.ZKClusterCoordinator - ZKClusterCoordination is up
2019-04-10 12:30:03,759 [main] INFO c.d.d.s.exec.MasterElectionService - Starting MasterElectionService
2019-04-10 12:30:03,802 [main] INFO c.d.d.s.exec.MasterElectionService - Elected as master node.
2019-04-10 12:30:03,802 [main] INFO c.d.s.c.TaskLeaderStatusListener - Starting TaskLeaderStatusListener for: MASTER
2019-04-10 12:30:03,803 [main] WARN c.d.s.c.TaskLeaderStatusListener - Received empty node registration
2019-04-10 12:30:03,804 [main] INFO c.d.s.c.TaskLeaderStatusListener - TaskLeaderStatusListener for: MASTER is up
2019-04-10 12:30:03,804 [main] INFO c.d.s.s.LocalSchedulerService - SchedulerService is up
2019-04-10 12:30:03,805 [main] INFO c.d.s.fabric.FabricServiceImpl - fabric service has 104857600 bytes reserved
2019-04-10 12:30:03,931 [main] INFO c.d.services.fabric.FabricServer - [FABRIC]: Server started on port 45678.
2019-04-10 12:30:03,934 [main] INFO c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider
2019-04-10 12:30:04,902 [main] INFO c.d.datastore.LocalKVStoreProvider - LocalKVStoreProvider is up
2019-04-10 12:30:04,921 [scheduler-1] INFO c.d.s.n.SplitOrphansCleanerService - Search for expired dataset splits
2019-04-10 12:30:04,969 [main] INFO c.d.sabot.rpc.user.UserRPCServer - [USER]: Server started on port 31010.
2019-04-10 12:30:04,972 [main] INFO c.dremio.exec.server.ContextService - IFaces [devupgnew4.azure.ril.com/10.26.37.151] bound to the host: devupgnew4.azure.ril.com
2019-04-10 12:30:04,982 [scheduler-1] INFO c.d.s.n.SplitOrphansCleanerService - Deleted 29 expired/orphan dataset splits
2019-04-10 12:30:06,257 [main] INFO c.d.common.scanner.ClassPathScanner - Scanning packages [com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.provision.yarn.service, com.dremio.provision, com.dremio.datastore, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.sabot.op.aggregate.vectorized, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store, com.dremio.services.configuration, com.dremio.services.configuration.ConfigurationStore, com.dremio.plugins.s3.store, com.dremio.plugins.adl, com.dremio.plugins.elastic, com.dremio.plugins.mongo, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.hbase, com.dremio.exec.expr.fn.impl.conv, com.dremio.exec.store.jdbc, com.dremio.extra.exec.store.dfs, com.dremio.exec.planner.acceleration.substitution, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.extras.plugins.elastic, com.dremio.plugins.mongo, com.dremio.exec.store.jdbc, org.apache.hadoop.hive] in locations [jar:file:/opt/dremio/jars/dremio-yarn-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-options-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-resourcescheduler-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-services-configuration-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-dac-daemon-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-3.1.7-201903210426240688-c843b51.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-3.1.7-201903210426240688-c843b51.jar!/] took 769ms
2019-04-10 12:30:07,361 [main] INFO c.d.e.e.f.FunctionImplementationRegistry - Function registry loaded. 1387 functions loaded in 2188 ms.
2019-04-10 12:30:08,167 [Plugin Startup: Mongo_Db] INFO c.d.p.m.c.MongoConnectionManager - Created connection to [address=10.26.37.150:27017, user=null].
2019-04-10 12:30:08,167 [Plugin Startup: Mongo_Db] INFO c.d.p.m.c.MongoConnectionManager - Number of open connections 1.
2019-04-10 12:30:08,168 [Plugin Startup: Mongo_Db] INFO c.d.p.m.c.MongoConnectionManager - MongoClientOptions:
MongoClientOptions{description=‘null’, applicationName=‘null’, compressors=’[]’, readPreference=primary, writeConcern=WriteConcern{w=null, wTimeout=null ms, fsync=null, journal=null, retryWrites=false, readConcern=com.mongodb.ReadConcern@0, codecRegistry=org.bson.codecs.configuration.ProvidersCodecRegistry@6be8514f, serverSelector=null, clusterListeners=[], commandListeners=[], minConnectionsPerHost=0, maxConnectionsPerHost=100, threadsAllowedToBlockForConnectionMultiplier=5, serverSelectionTimeout=2000, maxWaitTime=120000, maxConnectionIdleTime=0, maxConnectionLifeTime=0, connectTimeout=10000, socketTimeout=0, socketKeepAlive=true, sslEnabled=false, sslInvalidHostNamesAllowed=false, sslContext=null, alwaysUseMBeans=false, heartbeatFrequency=10000, minHeartbeatFrequency=500, heartbeatConnectTimeout=20000, heartbeatSocketTimeout=20000, localThreshold=15, requiredReplicaSetName=‘null’, dbDecoderFactory=com.mongodb.DefaultDBDecoder$1@c017e47, dbEncoderFactory=com.mongodb.DefaultDBEncoder$1@36b19e65, socketFactory=null, cursorFinalizerEnabled=true, connectionPoolSettings=ConnectionPoolSettings{maxSize=100, minSize=0, maxWaitQueueSize=500, maxWaitTimeMS=120000, maxConnectionLifeTimeMS=0, maxConnectionIdleTimeMS=0, maintenanceInitialDelayMS=0, maintenanceFrequencyMS=60000, connectionPoolListeners=[]}, socketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=0, keepAlive=true, receiveBufferSize=0, sendBufferSize=0}, serverSettings=ServerSettings{heartbeatFrequencyMS=10000, minHeartbeatFrequencyMS=500, serverListeners=’[]’, serverMonitorListeners=’[]’}, heartbeatSocketSettings=SocketSettings{connectTimeoutMS=20000, readTimeoutMS=20000, keepAlive=true, receiveBufferSize=0, sendBufferSize=0}}
2019-04-10 12:30:08,168 [Plugin Startup: Mongo_Db] INFO c.d.p.m.c.MongoConnectionManager - MongoCredential:null
2019-04-10 12:30:08,277 [main] INFO c.dremio.exec.catalog.PluginsManager - Result of storage plugin startup:
Mongo_Db: success (186ms). Healthy: MongoDB version 3.4.20.
INFORMATION_SCHEMA: success (1ms). Healthy
__jobResultsStore: success (147ms). Healthy
__logs: success (112ms). Healthy
__home: success (132ms). Healthy
__support: success (105ms). Healthy
__datasetDownload: success (144ms). Healthy
sys: success (0ms). Healthy
__accelerator: success (147ms). Healthy
$scratch: success (145ms). Healthy
MySql_Test: success (233ms). Healthy

2019-04-10 12:30:08,699 [main] INFO c.d.service.jobs.LocalJobsService - Starting JobsService
2019-04-10 12:30:08,763 [main] INFO c.d.service.jobs.LocalJobsService - JobsService is up
2019-04-10 12:30:10,073 [main] INFO c.d.p.s.ProvisioningServiceImpl - Starting provisioning service
2019-04-10 12:30:10,082 [main] INFO c.d.exec.server.NodeRegistration - Starting NodeRegistration for devupgnew4.azure.ril.com:31010
2019-04-10 12:30:10,110 [main] INFO c.d.exec.server.NodeRegistration - NodeRegistration is up for devupgnew4.azure.ril.com:31010
2019-04-10 12:30:10,127 [main] INFO c.d.d.s.search.SearchIndexManager - Search manager created, last wakeup time was 1554897910470
2019-04-10 12:30:10,158 [Curator-ServiceCache-0] INFO c.d.s.c.TaskLeaderStatusListener - New TaskLeader node for MASTER devupgnew4.azure.ril.com:45678 registered itself.
2019-04-10 12:30:11,078 [main] INFO c.d.d.s.TimingApplicationEventListener - ApplicationEventListener.onEvent INITIALIZATION_START
2019-04-10 12:30:12,728 [main] INFO c.d.d.s.TimingApplicationEventListener - ApplicationEventListener.onEvent INITIALIZATION_APP_FINISHED
2019-04-10 12:30:12,730 [main] INFO c.d.d.s.TimingApplicationEventListener - ApplicationEventListener.onEvent INITIALIZATION_FINISHED
2019-04-10 12:30:12,886 [main] INFO com.dremio.dac.server.WebServer - Started on http://localhost:9047
2019-04-10 12:30:12,892 [main] INFO c.dremio.dac.server.LivenessService - Started liveness service on port 43336
2019-04-10 12:30:20,101 [dremio-general-1] INFO c.d.s.reflection.ReflectionManager - reflection 5a77c605-9b34-4b53-82e5-0c81d27dbff4 (Raw Reflection) is due for refresh
2019-04-10 12:30:20,967 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e22-bb4e-e0a4-1b88-6bac37637400”,“schema”:"[]",“queryText”:“DROP TABLE IF EXISTS “__accelerator”.“cc7c1cbe-1337-44de-b558-f7be3eb5ebed”.“6c74f674-e1ee-496d-bde7-7cce066a1a16"”,“start”:1554899420266,“finish”:1554899420883,“outcome”:“COMPLETED”,“username”:”dremio"}
2019-04-10 12:30:20,967 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e23-1cfe-fa73-6408-e07686795500”,“schema”:"[]",“queryText”:“DROP TABLE IF EXISTS “__accelerator”.“5a77c605-9b34-4b53-82e5-0c81d27dbff4”.“2069c62e-a338-4b66-ad9a-3145261234dc””,“start”:1554899420241,“finish”:1554899420883,“outcome”:“COMPLETED”,“username”:"dremio"}
2019-04-10 12:30:21,302 [23521e23-67fa-5a79-1a29-0058e9f71100:foreman] INFO c.d.s.fabric.FabricConnectionManager - [FABRIC]: No connection active, opening new connection to devupgnew4.azure.ril.com:45678.
2019-04-10 12:30:21,406 [FABRIC-rpc-event-queue] INFO c.d.sabot.exec.FragmentExecutors - Received remote fragment start instruction for 23521e23-67fa-5a79-1a29-0058e9f71100:0:0
2019-04-10 12:30:22,154 [e0 - 23521e23-67fa-5a79-1a29-0058e9f71100:frag:0:0] INFO c.d.s.e.f.FragmentStatusReporter - 23521e23-67fa-5a79-1a29-0058e9f71100:0:0: State to report: FINISHED
2019-04-10 12:30:22,175 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e23-67fa-5a79-1a29-0058e9f71100”,“schema”:"[]",“queryText”:“REFRESH REFLECTION ‘5a77c605-9b34-4b53-82e5-0c81d27dbff4’ AS ‘2df51b54-94d5-4f0f-85fe-62c6b9d20cf2’”,“start”:1554899420191,“finish”:1554899422160,“outcome”:“COMPLETED”,“username”:"dremio"}
2019-04-10 12:30:22,533 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e20-9c0d-cc27-b753-91796c5ec500”,“schema”:"[]",“queryText”:“LOAD MATERIALIZATION METADATA “5a77c605-9b34-4b53-82e5-0c81d27dbff4”.“2df51b54-94d5-4f0f-85fe-62c6b9d20cf2"”,“start”:1554899422265,“finish”:1554899422531,“outcome”:“COMPLETED”,“username”:”dremio"}
2019-04-10 12:30:22,600 [dremio-general-1] INFO c.d.s.reflection.ReflectionManager - reflection cc7c1cbe-1337-44de-b558-f7be3eb5ebed (Aggregation Reflection) is due for refresh
2019-04-10 12:30:23,079 [FABRIC-rpc-event-queue] INFO c.d.sabot.exec.FragmentExecutors - Received remote fragment start instruction for 23521e21-6c88-3466-3ce4-4e3868b53100:0:0
2019-04-10 12:30:23,087 [FABRIC-rpc-event-queue] INFO c.d.sabot.exec.FragmentExecutors - Received remote fragment start instruction for 23521e21-6c88-3466-3ce4-4e3868b53100:1:0
2019-04-10 12:30:23,238 [e1 - 23521e21-6c88-3466-3ce4-4e3868b53100:frag:1:0] INFO c.d.s.e.f.FragmentStatusReporter - 23521e21-6c88-3466-3ce4-4e3868b53100:1:0: State to report: FINISHED
2019-04-10 12:30:23,266 [e0 - 23521e21-6c88-3466-3ce4-4e3868b53100:frag:0:0] INFO c.d.s.e.f.FragmentStatusReporter - 23521e21-6c88-3466-3ce4-4e3868b53100:0:0: State to report: FINISHED
2019-04-10 12:30:23,280 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e21-6c88-3466-3ce4-4e3868b53100”,“schema”:"[]",“queryText”:“REFRESH REFLECTION ‘cc7c1cbe-1337-44de-b558-f7be3eb5ebed’ AS ‘67606513-6c12-472e-a764-434c7a6645f1’”,“start”:1554899422605,“finish”:1554899423269,“outcome”:“COMPLETED”,“username”:"dremio"}
2019-04-10 12:30:23,425 [out-of-band-observer] INFO query.logger - {“queryId”:“23521e1f-befa-d7b0-84db-aee9ad0a0500”,“schema”:"[]",“queryText”:“LOAD MATERIALIZATION METADATA “cc7c1cbe-1337-44de-b558-f7be3eb5ebed”.“67606513-6c12-472e-a764-434c7a6645f1"”,“start”:1554899423364,“finish”:1554899423424,“outcome”:“COMPLETED”,“username”:”dremio"}
2019-04-10 12:35:40,604 [Plugin Startup: hive] INFO c.d.e.store.hive.HiveStoragePlugin - Hive Metastore SASL enabled. Kerberos principal: hive/devupgnew2.azure.ril.com@hydhdpdevupg.ril.com
2019-04-10 12:36:08,286 [catalog-source-synchronization] WARN c.d.exec.catalog.CatalogServiceImpl - Failure while synchronizing sources.
2019-04-10 12:37:40,613 [qtp744812115-194] INFO c.d.exec.catalog.CatalogServiceImpl - User Error Occurred [ErrorId: 4c53c651-3339-4d10-bb51-bd1d85d71c8b]
com.dremio.common.exceptions.UserException: Failure while configuring source [hive]
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:746) ~[dremio-common-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.createOrUpdateSource(CatalogServiceImpl.java:639) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.createSource(CatalogServiceImpl.java:378) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl.access$600(CatalogServiceImpl.java:102) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogServiceImpl$SourceModifier.createSource(CatalogServiceImpl.java:972) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.CatalogImpl.createSource(CatalogImpl.java:519) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.exec.catalog.DelegatingCatalog.createSource(DelegatingCatalog.java:189) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:157) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:148) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:144) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:80) [dremio-dac-backend-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_201]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_201]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_201]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_201]
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.26.v20180806.jar:9.2.26.v20180806]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
Caused by: java.util.concurrent.TimeoutException: null
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:432) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:68) ~[guava-20.0.jar:na]
at com.google.common.util.concurrent.AbstractCheckedFuture.checkedGet(AbstractCheckedFuture.java:104) ~[guava-20.0.jar:na]
at com.dremio.exec.catalog.CatalogServiceImpl.createOrUpdateSource(CatalogServiceImpl.java:627) [dremio-sabot-kernel-3.1.7-201903210426240688-c843b51.jar:3.1.7-201903210426240688-c843b51]

12

@abhba, it looks like you don’t have the formatting correct in dremio.conf:

2019-04-10 12:07:43,002 [main] ERROR ROOT - Dremio is exiting. Failure while starting services.
com.typesafe.config.ConfigException$BadPath: dremio.conf: 35: path has a leading, trailing, or two adjacent period ‘.’ (use quoted “” empty string if you want an empty element)

13

Hi Ben,
Just send me the exact dremio.conf file which I need to add .

14

Hi @abhba

Can you attach your dremio.conf file for qucik review.

@Venugopal_Menda

15

This is conf file and I commented the keytabs because I put the keytab my UI goes down .

paths: {

the local path for dremio to store data.

local: ${DREMIO_HOME}"/data"

the distributed path Dremio data including job results, downloads, uploads, etc

#dist: “pdfs://”${paths.local}"/pdfs"
}

services: {
coordinator.enabled: true,
coordinator.master.enabled: true,
executor.enabled: true

        }

#paths: {
#local: “/var/lib/dremio”
#…
#}

#services.kerberos: {

principal: "dremio@hydhdpdevupg.ril.com", # principal name must be generic and not tied to any host.

keytab.file.path: “/etc/security/keytabs/dremio.service.keytab”

#}

16

Hi @abhba,

I think I see that you are attempting to override the paths.local variable. You should try to avoid redefining variables just to be on the safe side. Are you trying to point your paths.local to ${DREMIO_HOME}"/data" or “/var/lib/dremio”?

Additionally, I see a ‘…’ in your new paths block later on in the file, that is whats causing your parsing error when it’s uncommented.

Thanks!

-Sam

17

I removed the commented path.local. And paths.local is pointing to ${DREMIO_HOME}"/data".

Shall I change it to var/lib/dremio ??

18

Hi @abhba

No need to change to /var. Let us know if you are getting any error

@Venugopal_Menda

19

Yes venu still the error persist .I didn’t find any solution for this issue .