Dremio compatibility with elasticsearch 7.0.1

Dear dremio team,

I recently upgraded elasticsearch to version 7.0.1 and dremio stopped working (Getting “Unexpected error ocurred”, “Invalid response”, etc. when trying to execute queries).

Apparently dremio is not yet compatible with ES 7.0.1. Are there any plans to make it compatible soon? Can’t wait! :wink:

Thank you and best regards,
Marcos

Hi @marcos.llama,

We do not currently test against 7.x releases of Elasticsearch, only 6 and later versions of 5, but it’s not clear why there would be a breaking change with these newer versions. Do you have query profiles for any of the jobs that fail when querying against 7.0.1?

Hello @ben

There is no specific query profile, it fails simply after adding the elasticsearch repository as a data source, then navigating to any of the indexes and clicking the “doc” item inside. Instead of getting the preview, I get these messages “Unexpected error ocurred”, “Invalid response”, etc.

Thank you

Marcos

Hello again @ben

I found this in the query log:

{“queryId”:“2312a04e-c47b-b850-6998-5e1d3dc63b00”,“schema”:"[XXX, YYY-iptables-2019.04]",“queryText”:"select * f
rom ",“start”:1559060400428,“finish”:1559060400454,“outcome”:“FAILED”,“username”:“admin”}

Same outcome for all indexes/queries

Thanks again

Marcos

Also happens when typing the query directly: select * from doc

image

All information entered previously was generated on a fresh dremio instance

If a try using a previous dremio installation on another computer (which was working fine prior to ES upgrade), I get a different error message:

“Failure while attempting to read metadata for XXX.“YYY-2019.05”.doc.”

Update: I upgraded from ES 7.0.1 to ES 7.1, same outcome from Dremio…

Marcos