# Elasticsearch version compatibility **URL:** \ **Category:** Uncategorized\ **Created:** [August 10, 2017, 9:45am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176 "2017-08-10T09:45:18Z")\ **Posts on this page:** 18\ **Page:** 1
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 10, 2017, 9:45am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/1 "2017-08-10T09:45:18Z")
I downloaded dremio and install in my centos server which also hosted my elasticsearch. When i access the localhost:9047 in the browser and added the elasticsearch as a source, there’s no datasets found in my elasticsearch. BUT, i do have another elasticsearch server which holds the latest elasticsearch (5.5) it currently working well. BTW, the one that doesn’t work is elasticsearch(5.4). I don’t know if it is the problem in versioning, or there are some issues with regards to my elasticsearch config. Hoping for your feedback. TIA ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 10, 2017, 4:51pm UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/2 "2017-08-10T16:51:04Z")
Hi @joginar10 I was able to add a 5.4 elastic search server in Dremio and work with the datasets. The same server hosted both dremio and elastic server. Do you see any errors in the Dremio-DIR/log/server.log ? If so, please share. Please note that “advanced options” for the source allows you to configure the metadata refresh intervals. The default is 30 minutes. ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 12:25am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/3 "2017-08-11T00:25:39Z")
Hello @benoy. Thanks for your reply. Hmm… Where can i find that /log/server.log? I installed dremio in my Linux OS Machine. ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 12:32am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/4 "2017-08-11T00:32:54Z")
It will be at DREMIO-INSTALL- DIR/log/server.log ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 1:23am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/5 "2017-08-11T01:23:51Z")
This is not the complete logs. This is from the last few lines of the log. ``` at sun.net.www.http.HttpClient.(HttpClient.java:242) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966) ~[na:1.8.0_131] at org.glassfish.jersey.internal.Errors.process(Errors.java:228) ~[jersey-common-2.23.2.jar:na] at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.(HttpClient.java:242) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966) ~[na:1.8.0_131] at org.glassfish.jersey.internal.Errors.process(Errors.java:228) ~[jersey-common-2.23.2.jar:na] at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.(HttpClient.java:242) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966) ~[na:1.8.0_131] at org.glassfish.jersey.internal.Errors.process(Errors.java:228) ~[jersey-common-2.23.2.jar:na] at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.(HttpClient.java:242) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966) ~[na:1.8.0_131] at com.dremio.plugins.elastic.ElasticConnectionPool.access$500(ElasticConnectionPool.java:80) [dremio-elasticsearch-plugin-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:477) [dremio-elasticsearch-plugin-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] at com.dremio.plugins.elastic.ElasticsearchStoragePlugin2.getState(ElasticsearchStoragePlugin2.java:223) [dremio-elasticsearch-plugin-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] at com.dremio.exec.store.CatalogServiceImpl$NamespaceUpdateThread.refreshSourceStates(CatalogServiceImpl.java:505) [dremio-sabot-kernel-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] at com.dremio.exec.store.CatalogServiceImpl$NamespaceUpdateThread.run(CatalogServiceImpl.java:546) [dremio-sabot-kernel-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] Caused by: javax.ws.rs.ProcessingException: java.net.SocketException: Network is unreachable (connect failed) at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:287) ~[jersey-client-2.23.2.jar:na] at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252) ~[jersey-client-2.23.2.jar:na] at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701) ~[jersey-client-2.23.2.jar:na] at org.glassfish.jersey.internal.Errors.process(Errors.java:315) ~[jersey-common-2.23.2.jar:na] at org.glassfish.jersey.internal.Errors.process(Errors.java:297) ~[jersey-common-2.23.2.jar:na] at org.glassfish.jersey.internal.Errors.process(Errors.java:228) ~[jersey-common-2.23.2.jar:na] at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) ~[jersey-common-2.23.2.jar:na] at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697) ~[jersey-client-2.23.2.jar:na] at com.dremio.plugins.elastic.ElasticActions$Health.getResult(ElasticActions.java:151) ~[dremio-elasticsearch-plugin-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.executeAndHandleResponseCode(ElasticConnectionPool.java:475) [dremio-elasticsearch-plugin-1.0.8-201707190805180330-27f36e1.jar:1.0.8-201707190805180330-27f36e1] ... 3 common frames omitted Caused by: java.net.SocketException: Network is unreachable (connect failed) at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_131] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[na:1.8.0_131] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_131] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_131] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_131] at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_131] at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.(HttpClient.java:242) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[na:1.8.0_131] at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1202) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1546) ~[na:1.8.0_131] at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_131] at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_131] at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:394) ~[jersey-client-2.23.2.jar:na] at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285) ~[jersey-client-2.23.2.jar:na] ... 12 common frames omitted 2017-08-11 09:14:07,835 [metadata-refresh] INFO c.d.exec.store.CatalogServiceImpl - Ignoring metadata load for source AWSPH since it is currently in a bad state. ``` ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 1:28am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/6 "2017-08-11T01:28:31Z")
![dremioCapture](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/1X/450141b8a5d893b77cd0f4480ebb77c5552880e2.PNG) This what looks like in the dashboard. There’s no Datasets in AWSPH. ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 2:15am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/7 "2017-08-11T02:15:51Z")
> [@joginar10](#): > > Caused by: java.net.SocketException: Network is unreachable (connect failed) This means that Dremio cannot connect to the ES server. Could you please make sure that you can reach ES Server from the Dremio Host ? You can use a command like curl ‘[http://elastic-search-host:9200/?pretty’](http://elastic-search-host:9200/?pretty%E2%80%99) ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 2:26am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/8 "2017-08-11T02:26:23Z")
Yes. I could connect to elasticsearch. Hmmm… I also try to use ‘localhost’ in my connection. But still it does not work. ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 2:32am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/9 "2017-08-11T02:32:51Z")
Could you please share a screenshot of the AWSPH source \> details page ? It will be great if you could share the curl command used to test the connectivity between Dremio HOST and ES server . And its output. ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 2:40am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/11 "2017-08-11T02:40:34Z")
![dremioCapture3](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/1X/3c8e0078a822ca06edbc19de7c5c6523cc40da9f.PNG) Here it is. 😃 ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 4:48am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/12 "2017-08-11T04:48:04Z")
@joginar10, I see that both the servers (Dremio and elastic ) are on the same host. I wanted to confirm that you have run the command to access the Elastic Server from the DREMIO HOST. You can use curl to do that. You can try both localhost:9020 and the 192.168.200.254:9020. In addition , to avoid any one time issues, try deleting the erroneous source and add it again. thanks and regards, Benoy ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 5:04am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/13 "2017-08-11T05:04:43Z")
> [@benoy](#): > > You can try both localhost:9020 and the 192.168.200.254:9020. I check the connection for elasticsearch i use **localhost:9200** Why do i need to check at port 9020? Thanks for your reply btw @benoy. ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 11, 2017, 6:02am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/14 "2017-08-11T06:02:58Z")
Hello @benoy, I just solve this issue. Thanks for your help 😃 ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 3:27pm UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/15 "2017-08-11T15:27:14Z")
@joginar10, Glad to know that the issue is resolved. What was the issue ? ---
**Author:** ![benoy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/benoy/32/46_2.png) [@benoy](https://community.dremio.com/u/benoy)\ **Post date:** [August 11, 2017, 3:27pm UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/16 "2017-08-11T15:27:47Z")
My mistake. It should be 9200. ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 12, 2017, 1:59am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/17 "2017-08-12T01:59:38Z")
I just ugrade my elasticsearch to 5.5. i dont know why my es 5.4 wont work. 🤔 ---
**Author:** ![can](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/can/32/40_2.png) [@can](https://community.dremio.com/u/can)\ **Post date:** [August 12, 2017, 2:14am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/18 "2017-08-12T02:14:18Z")
@joginar10 if you are up for it it would be great to take a look at what’s in the Dremio elasticsearch request logs when attempting to connect to Elasticsearch 5.4. To do this: - Add the following in `/conf/logback.xml` on the coordinator node: ```xml ${dremio.log.path}/elastic.log ${dremio.log.path}/archive/elastic.%d{yyyy-MM-dd}.log.gz 30 %date{ISO8601} [%thread] %-5level %logger{36} - %msg%n ``` - Restart Dremio - Try connecting to Elasticsearch 5.4 ---
**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\ **Post date:** [August 12, 2017, 2:21am UTC](https://community.dremio.com/t/elasticsearch-version-compatibility/176/19 "2017-08-12T02:21:35Z")
I’m sorry @can, i can’t try this since i already upgrade my ES client to 5.5.