Im running my own research on utilization of dremio into our production data analytics. During my research, I found an issue that not sure how to solve it.
I’ve manage to connect dremio with my data source from ElasticSearch Cluster, but notice that dremio only manage to translate only 1st layer of JSON tree to columns, not for 2nd and 3rd layer onwards. See below as example
So far now I’m keen to use dremio as middle man between ElasticSearch as main data lake and client BI tools. Therefore I would highly appreciate if your end have any suggestion or recommendation on above issue if it’s possible to be fix.
If you hover your mouse to the right of a field value, there should be 3 dots, you should be able to click on that, extract out another nested field and again unnest, like screenshot below
Thanks for your quick response, yes I’ve test it and it works like a charm!
Just a quick check, does this feature could be made as defaut or at least extract all in bulk instead of every documentSet ?
Good point @Carillpower. Let me check on that internally and get back to you
Cool, thanks Balaji … will wait for their response
Currently we unnest only one level, further un-nesting needs to be done via the UI or SQL as mentioned above
Ok then, will try to absorb this limitation for current time being. Hope there’s a roadmap for this in future releases.
Thanks for the clarification, really appreciate the effort.
There are lots of examples of different things you can do in this tutorial on data curation: