Failure while attempting to read metadata - AWS ElasticSearch

1

Hi,

I have pushed some data from postgres to AWS Elastic Search instance using logstash. It is of the format -

{
“hits”: {
“total”: 1,
“max_score”: 1,
“hits”: [
{
“_index”: “temp-sanjay”,
“_type”: “projects”,
“_id”: “abc”,
“_score”: 1,
“_source”: {
“streamId”: “abc”,
“reqInfo.method”: “PUT”,
“@timestamp”: “2018-11-20T06:59:19.782Z”,
“@version”: “1”
}
}]}}

When I try to load this data in dremio, it gives error as - Failure while attempting to read metadata for table prd.“temp-sanjay”.projects

Thanks,
Sanjay Jain

2

Hi @Sanjay_Jain,

Is this Elastic search 6.0 AWS? If yes, we are in the final stages of development to support this feature and should be done in a few weeks. Will keep you posted

Thanks
@balaji.ramaswamy

3

Hi @balaji.ramaswamy

Yes, you are correct. I am using AWS ES 6.3 version.

Also, Can you please let me know if the above issue is resolved in AWS 5.6 version?

Thanks for your help.

Thanks,
Sanjay Jain

4

Hi @Sanjay_Jain

The new feature will support both 5.x and 6.x versions of elastic search on AWS. Currently it is not support on both versions

Thanks
@balaji.ramaswamy

5

Hi @Sanjay_Jain

We have enhanced Dremio to support elasticsearch on AWS. If this is still a requirement, kindly download our latest version 3.0.5 from https://www.dremio.com/download/, upgrade, test and let us know

Thanks
@balaji.ramaswamy