Im running my own research on utilization of dremio into our production data analytics. During my research, I found an issue that not sure how to solve it.
I notice that dremio unable to load data from elasticsearch that contain date with timezone. Below are the error :
Below are the format for documentSet data.iso_8601 from ElasticSearch side :
FYI, the input data are like this :
I’ve found a link that seems to be related to this issue Elasticsearch datetime problems but didn’t seem to get response on that.
So far now I’m keen to use dremio as middle man between ElasticSearch as main data lake and client BI tools. Therefore I would highly appreciate if your end have any suggestion or recommendation on above issue if it’s possible to be fix.