Empty ES Source

#1

Hello,

One of my ElasticSarch source on Dremio doesn’t work anymore. Dremio give me no error except that my source is empty without any index.

With Kibana I have more than 50 index for this source.

I have Dremio 3.1.1 and few days ago this source had 50 index in Dremio. Others ElasticSarch sources are still ok.

Regards,

Camille

#2

@CamilleD

What version of Elasticsearch is this? Also is there any error in server.log?

Thanks
@balaji.ramaswamy

#3

@balaji.ramaswamy

It’s 5.4.2 version for Elasticsearch and there is no error in the server.log

Thanks
@CamilleD

#4

@CamilleD

Add the same Elasticsearch source again with a different name and then send us the server.log as an attachment. Also mention what was the name of the new source you tried to add

Thanks
@balaji.ramaswamy

#5

@balaji.ramaswamy

I added the same Elasticsearch source with the name : Test_Datalab
server.zip (244,7 Ko)

Thanks

@CamilleD

#6

@CamilleD

I see this error in the server.log, is there a mismatch in the date format on “date_optional_time” between what is defined in the mapping to what the actual date format of the data is?

2019-11-26 01:08:35,597 [metadata-refresh-Test_Datalab] WARN c.d.e.catalog.MetadataSynchronizer - Source ‘Test_Datalab’ sync failed unexpectedly. Will try again later
com.dremio.common.exceptions.UserException: Found invalid custom date format, date_optional_time