Cannot access to the AWS Elasticsearch server by Dremio

This post was flagged by the community and is temporarily hidden.

@youngin could you share Dremio’s server.log for the time corresponding to when you were attempting to add these sources? It would be great if you could share this for the ES 5.5 source. Elasticsearch 6 is not yet supported – we’ll reach out when support for it is available. This is something we’re actively investigating.

1 Like
    2018-01-23 00:55:07,169 [qtp1551758833-179] INFO  c.d.p.elastic.ElasticConnectionPool - User Error Occurred [ErrorId: 562b1e80-9184-4e22-9d36-79fd70817267]
com.dremio.common.exceptions.UserException: Encountered a problem while executing com.dremio.plugins.elastic.ElasticActions$NodesInfo@363fbf88. Cannot gather Elasticsearch nodes information. Please make sure that the user has [cluster:monitor/nodes/info] privilege.
        at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648) ~[dremio-common-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.addContextAndThrow(ElasticConnectionPool.java:427) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.access$500(ElasticConnectionPool.java:82) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:579) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.getHostList(ElasticConnectionPool.java:327) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.updateClients(ElasticConnectionPool.java:185) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.connect(ElasticConnectionPool.java:175) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin2.start(ElasticsearchStoragePlugin2.java:420) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin.start(ElasticsearchStoragePlugin.java:51) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:434) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:288) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:124) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:116) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:81) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
Caused by: javax.ws.rs.ProcessingException: java.net.UnknownHostException: http
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:287) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:228) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697) ~[jersey-client-2.25.1.jar:na]
        at com.dremio.plugins.elastic.ElasticActions$NodesInfo.getResult(ElasticActions.java:146) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:577) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        ... 56 common frames omitted
Caused by: java.net.UnknownHostException: http
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[na:1.8.0_151]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_151]
        at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_151]
        at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) ~[na:1.8.0_151]
        at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_151]
        at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:399) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285) ~[jersey-client-2.25.1.jar:na]
        ... 65 common frames omitted
2018-01-23 00:55:07,173 [qtp1551758833-179] ERROR c.d.d.server.GenericExceptionMapper - Unexpected exception when processing PUT http://due-analytics-elb-statistics-1204685418.us-east-1.elb.amazonaws.com:3030/apiv2/source/poc-r3?nocache=1516668715635 : java.lang.RuntimeException: Unable to get host lists from any host seed.
java.lang.RuntimeException: Unable to get host lists from any host seed.
        at com.dremio.plugins.elastic.ElasticConnectionPool.updateClients(ElasticConnectionPool.java:224) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.connect(ElasticConnectionPool.java:175) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin2.start(ElasticsearchStoragePlugin2.java:420) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin.start(ElasticsearchStoragePlugin.java:51) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:434) ~[dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:288) ~[dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:124) ~[dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:116) ~[dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:81) ~[dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) ~[jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
Caused by: java.lang.RuntimeException: Failure getting server list from seed host
        at com.dremio.plugins.elastic.ElasticConnectionPool.updateClients(ElasticConnectionPool.java:220) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        ... 54 common frames omitted
Caused by: com.dremio.common.exceptions.UserException: Encountered a problem while executing com.dremio.plugins.elastic.ElasticActions$NodesInfo@363fbf88. Cannot gather Elasticsearch nodes information. Please make sure that the user has [cluster:monitor/nodes/info] privilege.
        at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648) ~[dremio-common-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.addContextAndThrow(ElasticConnectionPool.java:427) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.access$500(ElasticConnectionPool.java:82) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:579) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.getHostList(ElasticConnectionPool.java:327) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.updateClients(ElasticConnectionPool.java:185) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        ... 54 common frames omitted
Caused by: javax.ws.rs.ProcessingException: java.net.UnknownHostException: http
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:287) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:228) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697) ~[jersey-client-2.25.1.jar:na]
        at com.dremio.plugins.elastic.ElasticActions$NodesInfo.getResult(ElasticActions.java:146) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:577) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        ... 56 common frames omitted
Caused by: java.net.UnknownHostException: http
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[na:1.8.0_151]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_151]
        at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_151]
        at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) ~[na:1.8.0_151]
        at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_151]
        at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:399) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285) ~[jersey-client-2.25.1.jar:na]
        ... 65 common frames omitted

@youngin this looks like error from before you set the Query whitelisted hosts only option. Could you confirm and share the entries for after this was set?

1 Like

@youngin it looks like there is an issue when trying to retrieve cluster metadata from this end point:

curl -XGET <ELASTIC_HOST:PORT>/_cluster/state/metadata/

Could you manually confirm you can curl this end point for the host you specified in the Dremio source settings?

1 Like

Ok. I confirmed the curl commend on EC2 deploying Dremio

“curl -XGET 'http://search-dev-poc-r3-3tbr4iumcpqyagjzhss4qei4lm.us-east-1.es.amazonaws.com:80/_cluster/state/metadata/?pretty

And I get a response below (I already deleted all the indecies except for kibana… But as I checked ‘how hidden indices that start with a dot (.)’, .Kibana index is should be showed on dataset)

    {
  "cluster_name" : "256598433840:dev-poc-r3",
  "metadata" : {
    "cluster_uuid" : "dcp5DVbaTGaiNY2RQNM-ng",
    "templates" : {
      "logstash" : {
        "template" : "logstash-*",
        "order" : 0,
        "settings" : {
          "index" : {
            "refresh_interval" : "5s"
          }
        },
        "mappings" : {
          "_default_" : {
            "dynamic_templates" : [ {
              "message_field" : {
                "path_match" : "message",
                "mapping" : {
                  "norms" : false,
                  "type" : "text"
                },
                "match_mapping_type" : "string"
              }
            }, {
              "string_fields" : {
                "mapping" : {
                  "norms" : false,
                  "type" : "text",
                  "fields" : {
                    "keyword" : {
                      "ignore_above" : 256,
                      "type" : "keyword"
                    }
                  }
                },
                "match_mapping_type" : "string",
                "match" : "*"
              }
            } ],
            "_all" : {
              "norms" : false,
              "enabled" : true
            },
            "properties" : {
              "@timestamp" : {
                "include_in_all" : false,
                "type" : "date"
              },
              "geoip" : {
                "dynamic" : true,
                "properties" : {
                  "latitude" : {
                    "type" : "half_float"
                  },
                  "location" : {
                    "type" : "geo_point"
                  },
                  "longitude" : {
                    "type" : "half_float"
                  }
                }
              },
              "@version" : {
                "include_in_all" : false,
                "type" : "keyword"
              }
            }
          }
        }
      }
    },
    "indices" : {
      ".kibana" : {
        "state" : "open",
        "settings" : {
          "index" : {
            "number_of_shards" : "1",
            "provided_name" : ".kibana",
            "mapper" : {
              "dynamic" : "false"
            },
            "creation_date" : "1516348605216",
            "number_of_replicas" : "1",
            "uuid" : "R3Aw7ogXSQaxV5dpuMG4hQ",
            "version" : {
              "created" : "5050299"
            }
          }
        },
        "mappings" : {
          "url" : {
            "dynamic" : "strict",
            "properties" : {
              "accessCount" : {
                "type" : "long"
              },
              "accessDate" : {
                "type" : "date"
              },
              "url" : {
                "type" : "text",
                "fields" : {
                  "keyword" : {
                    "ignore_above" : 2048,
                    "type" : "keyword"
                  }
                }
              },
              "createDate" : {
                "type" : "date"
              }
            }
          },
          "visualization" : {
            "dynamic" : "strict",
            "properties" : {
              "savedSearchId" : {
                "type" : "keyword"
              },
              "description" : {
                "type" : "text"
              },
              "uiStateJSON" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "visState" : {
                "type" : "text"
              }
            }
          },
          "timelion-sheet" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "timelion_sheet" : {
                "type" : "text"
              },
              "timelion_interval" : {
                "type" : "keyword"
              },
              "timelion_columns" : {
                "type" : "integer"
              },
              "timelion_other_interval" : {
                "type" : "keyword"
              },
              "timelion_rows" : {
                "type" : "integer"
              },
              "description" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "timelion_chart_height" : {
                "type" : "integer"
              }
            }
          },
          "server" : {
            "dynamic" : "strict",
            "properties" : {
              "uuid" : {
                "type" : "keyword"
              }
            }
          },
          "search" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "columns" : {
                "type" : "keyword"
              },
              "description" : {
                "type" : "text"
              },
              "sort" : {
                "type" : "keyword"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              }
            }
          },
          "index-pattern" : {
            "dynamic" : "strict",
            "properties" : {
              "notExpandable" : {
                "type" : "boolean"
              },
              "fieldFormatMap" : {
                "type" : "text"
              },
              "sourceFilters" : {
                "type" : "text"
              },
              "timeFieldName" : {
                "type" : "keyword"
              },
              "intervalName" : {
                "type" : "keyword"
              },
              "fields" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              }
            }
          },
          "dashboard" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "timeFrom" : {
                "type" : "keyword"
              },
              "timeTo" : {
                "type" : "keyword"
              },
              "refreshInterval" : {
                "properties" : {
                  "display" : {
                    "type" : "keyword"
                  },
                  "section" : {
                    "type" : "integer"
                  },
                  "value" : {
                    "type" : "integer"
                  },
                  "pause" : {
                    "type" : "boolean"
                  }
                }
              },
              "description" : {
                "type" : "text"
              },
              "uiStateJSON" : {
                "type" : "text"
              },
              "timeRestore" : {
                "type" : "boolean"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "optionsJSON" : {
                "type" : "text"
              },
              "panelsJSON" : {
                "type" : "text"
              }
            }
          },
          "_default_" : {
            "dynamic" : "strict"
          },
          "config" : {
            "dynamic" : "true",
            "properties" : {
              "buildNum" : {
                "type" : "keyword"
              }
            }
          }
        },
        "aliases" : [ ],
        "primary_terms" : {
          "0" : 1
        },
        "in_sync_allocations" : {
          "0" : [ "ek9EYUQKS3WISzpZKV_4qw", "NAqMuTY2QuC682CQDygVVQ" ]
        }
      }
    },
    "repositories" : {
      "cs-automated" : {
        "type" : "s3"
      }
    },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  }
}

I wonder if it’s an issue with that specific Kibana index. Could you try adding a new index (non-Kibana generated) and re-create the source in Dremio? This could help us narrow down the issue.

1 Like

Ok. I tried after add index the name is ‘test’

curl result

    {
  "cluster_name" : "256598433840:dev-poc-r3",
  "metadata" : {
    "cluster_uuid" : "dcp5DVbaTGaiNY2RQNM-ng",
    "templates" : {
      "logstash" : {
        "template" : "logstash-*",
        "order" : 0,
        "settings" : {
          "index" : {
            "refresh_interval" : "5s"
          }
        },
        "mappings" : {
          "_default_" : {
            "dynamic_templates" : [ {
              "message_field" : {
                "path_match" : "message",
                "mapping" : {
                  "norms" : false,
                  "type" : "text"
                },
                "match_mapping_type" : "string"
              }
            }, {
              "string_fields" : {
                "mapping" : {
                  "norms" : false,
                  "type" : "text",
                  "fields" : {
                    "keyword" : {
                      "ignore_above" : 256,
                      "type" : "keyword"
                    }
                  }
                },
                "match_mapping_type" : "string",
                "match" : "*"
              }
            } ],
            "_all" : {
              "norms" : false,
              "enabled" : true
            },
            "properties" : {
              "@timestamp" : {
                "include_in_all" : false,
                "type" : "date"
              },
              "geoip" : {
                "dynamic" : true,
                "properties" : {
                  "latitude" : {
                    "type" : "half_float"
                  },
                  "location" : {
                    "type" : "geo_point"
                  },
                  "longitude" : {
                    "type" : "half_float"
                  }
                }
              },
              "@version" : {
                "include_in_all" : false,
                "type" : "keyword"
              }
            }
          }
        }
      }
    },
    "indices" : {
      "test" : {
        "state" : "open",
        "settings" : {
          "index" : {
            "creation_date" : "1516683713893",
            "number_of_shards" : "3",
            "number_of_replicas" : "2",
            "uuid" : "BJi7xZQZT9-UA9CU8u4TcQ",
            "version" : {
              "created" : "5050299"
            },
            "provided_name" : "test"
          }
        },
        "mappings" : { },
        "aliases" : [ ],
        "primary_terms" : {
          "0" : 1,
          "1" : 1,
          "2" : 1
        },
        "in_sync_allocations" : {
          "1" : [ "7lnwmryqSwGU_wjw4QvPnQ", "YbwixJMJSHSzVmPHkaqLjQ", "RIP1NTUMQs6vPbtQUZ5MWg" ],
          "2" : [ "-Jt2VRWSSZWnoOt1h4brUw", "_1HXBcROQOORLgYdKiF9rQ", "wSTNQ9WQSba6nSc7zj81-w" ],
          "0" : [ "WthhR5SpSMue3YY6ZkWkFA", "WDijcOeqSZ-fMiFkf-703Q", "pDMStcY4TdO571OBU9xOcg" ]
        }
      },
      ".kibana" : {
        "state" : "open",
        "settings" : {
          "index" : {
            "number_of_shards" : "1",
            "provided_name" : ".kibana",
            "mapper" : {
              "dynamic" : "false"
            },
            "creation_date" : "1516348605216",
            "number_of_replicas" : "1",
            "uuid" : "R3Aw7ogXSQaxV5dpuMG4hQ",
            "version" : {
              "created" : "5050299"
            }
          }
        },
        "mappings" : {
          "config" : {
            "dynamic" : "true",
            "properties" : {
              "buildNum" : {
                "type" : "keyword"
              }
            }
          },
          "url" : {
            "dynamic" : "strict",
            "properties" : {
              "accessCount" : {
                "type" : "long"
              },
              "accessDate" : {
                "type" : "date"
              },
              "url" : {
                "type" : "text",
                "fields" : {
                  "keyword" : {
                    "ignore_above" : 2048,
                    "type" : "keyword"
                  }
                }
              },
              "createDate" : {
                "type" : "date"
              }
            }
          },
          "search" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "columns" : {
                "type" : "keyword"
              },
              "description" : {
                "type" : "text"
              },
              "sort" : {
                "type" : "keyword"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              }
            }
          },
          "index-pattern" : {
            "dynamic" : "strict",
            "properties" : {
              "notExpandable" : {
                "type" : "boolean"
              },
              "fieldFormatMap" : {
                "type" : "text"
              },
              "sourceFilters" : {
                "type" : "text"
              },
              "timeFieldName" : {
                "type" : "keyword"
              },
              "intervalName" : {
                "type" : "keyword"
              },
              "fields" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              }
            }
          },
          "dashboard" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "timeFrom" : {
                "type" : "keyword"
              },
              "timeTo" : {
                "type" : "keyword"
              },
              "refreshInterval" : {
                "properties" : {
                  "display" : {
                    "type" : "keyword"
                  },
                  "section" : {
                    "type" : "integer"
                  },
                  "value" : {
                    "type" : "integer"
                  },
                  "pause" : {
                    "type" : "boolean"
                  }
                }
              },
              "description" : {
                "type" : "text"
              },
              "uiStateJSON" : {
                "type" : "text"
              },
              "timeRestore" : {
                "type" : "boolean"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "optionsJSON" : {
                "type" : "text"
              },
              "panelsJSON" : {
                "type" : "text"
              }
            }
          },
          "server" : {
            "dynamic" : "strict",
            "properties" : {
              "uuid" : {
                "type" : "keyword"
              }
            }
          },
          "visualization" : {
            "dynamic" : "strict",
            "properties" : {
              "savedSearchId" : {
                "type" : "keyword"
              },
              "description" : {
                "type" : "text"
              },
              "uiStateJSON" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "visState" : {
                "type" : "text"
              }
            }
          },
          "_default_" : {
            "dynamic" : "strict"
          },
          "timelion-sheet" : {
            "dynamic" : "strict",
            "properties" : {
              "hits" : {
                "type" : "integer"
              },
              "timelion_sheet" : {
                "type" : "text"
              },
              "timelion_interval" : {
                "type" : "keyword"
              },
              "timelion_columns" : {
                "type" : "integer"
              },
              "timelion_other_interval" : {
                "type" : "keyword"
              },
              "timelion_rows" : {
                "type" : "integer"
              },
              "description" : {
                "type" : "text"
              },
              "title" : {
                "type" : "text"
              },
              "version" : {
                "type" : "integer"
              },
              "kibanaSavedObjectMeta" : {
                "properties" : {
                  "searchSourceJSON" : {
                    "type" : "text"
                  }
                }
              },
              "timelion_chart_height" : {
                "type" : "integer"
              }
            }
          }
        },
        "aliases" : [ ],
        "primary_terms" : {
          "0" : 1
        },
        "in_sync_allocations" : {
          "0" : [ "ek9EYUQKS3WISzpZKV_4qw", "NAqMuTY2QuC682CQDygVVQ" ]
        }
      }
    },
    "repositories" : {
      "cs-automated" : {
        "type" : "s3"
      }
    },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  }
}

And still I can’t see any things on the dataset list even if I remake the ES source.

server.log

2018-01-23 05:09:14,071 [qtp1551758833-179] INFO  c.d.p.elastic.ElasticConnectionPool - Retrieved Elastic host list from http://search-dev--poc-r3-3tbr4iumcpqyagjzhss4qei4lm.us-east-1.es.amazonaws.com:80:

        http => JerseyWebTarget { http://http//search-dev-poc-r3-3tbr4iumcpqyagjzhss4qei4lm.us-east-1.es.amazonaws.com:80 }

2018-01-23 05:09:14,110 [qtp1551758833-179] INFO  c.d.p.elastic.ElasticConnectionPool - User Error Occurred [ErrorId: 2ec60d33-e5be-4726-a47e-cd774f603c73]
com.dremio.common.exceptions.UserException: Failure executing Elastic request retrieving cluster metadata.
        at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648) ~[dremio-common-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.handleException(ElasticConnectionPool.java:504) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.access$400(ElasticConnectionPool.java:82) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.execute(ElasticConnectionPool.java:563) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin2.getDatasets(ElasticsearchStoragePlugin2.java:294) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.CatalogServiceImpl.refreshSourceNames(CatalogServiceImpl.java:499) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:481) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:288) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:124) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:116) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:81) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
        at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
Caused by: javax.ws.rs.ProcessingException: java.net.UnknownHostException: http
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:287) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:228) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697) ~[jersey-client-2.25.1.jar:na]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.execute(ElasticConnectionPool.java:561) [dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        ... 53 common frames omitted
Caused by: java.net.UnknownHostException: http
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[na:1.8.0_151]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_151]
        at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_151]
        at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_151]
        at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) ~[na:1.8.0_151]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) ~[na:1.8.0_151]
        at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_151]
        at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:399) ~[jersey-client-2.25.1.jar:na]
        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285) ~[jersey-client-2.25.1.jar:na]
        ... 61 common frames omitted
2018-01-23 05:09:14,111 [qtp1551758833-179] WARN  c.d.exec.store.CatalogServiceImpl - Failure while attempting to update metadata for source "dev-poc-r3". Terminating update of this source.
com.dremio.common.exceptions.UserException: Failure executing Elastic request retrieving cluster metadata.
        at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648) ~[dremio-common-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.handleException(ElasticConnectionPool.java:504) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool.access$400(ElasticConnectionPool.java:82) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.execute(ElasticConnectionPool.java:563) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.plugins.elastic.ElasticsearchStoragePlugin2.getDatasets(ElasticsearchStoragePlugin2.java:294) ~[dremio-elasticsearch-plugin-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.CatalogServiceImpl.refreshSourceNames(CatalogServiceImpl.java:499) ~[dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.create(StoragePluginRegistryImpl.java:481) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.exec.store.StoragePluginRegistryImpl.createOrUpdate(StoragePluginRegistryImpl.java:288) [dremio-sabot-kernel-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:124) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.service.source.SourceService.registerSourceWithRuntime(SourceService.java:116) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at com.dremio.dac.resource.PutSourceResource.putSource(PutSourceResource.java:81) [dremio-dac-backend-1.3.1-201712020438070881-a7af5c8.jar:1.3.1-201712020438070881-a7af5c8]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:301) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-

Hi, it looks like you may have included the “http://” in the host name you used to configure the Elasticsearch source in Dremio. Can you check if that is the case, and try again without the “http”?

Oh my good! you ar my hero ! It works !
Thank you for your help steven and thank you can also.
I didn’t know that “http://” is should be removed… cause when I make logstash configuration, It should be typed in there.