# Error on Data Query

**URL:** <https://community.dremio.com/t/error-on-data-query/201>\
**Category:** Uncategorized\
**Created:** [August 17, 2017, 2:09am UTC](https://community.dremio.com/t/error-on-data-query/201 "2017-08-17T02:09:27Z")\
**Posts on this page:** 17\
**Page:** 1

<div class="post-metadata">

**Author:** ![joginar10](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/joginar10/32/107_2.png) [@joginar10](https://community.dremio.com/u/joginar10)\
**Post date:** [August 17, 2017, 2:09am UTC](https://community.dremio.com/t/error-on-data-query/201/1 "2017-08-17T02:09:27Z")

</div>

When we tried to query in the data set. We got this error:

`REFRESH METADATA" before rerunning query. SqlOperatorImpl ELASTICSEARCH_SUB_SCAN Location 2:0:2 Fragment 2:0 [Error Id: 45b8e403-65d0-4d8e-be46-baabdeb048ef on daserver:31010] ]`

Btw, we’re using elasticsearch as our datasource.

---

<div class="post-metadata">

**Author:** ![yufeldman](https://avatars.discourse-cdn.com/v4/letter/y/c77e96/32.png) [@yufeldman](https://community.dremio.com/u/yufeldman)\
**Post date:** [August 17, 2017, 3:12pm UTC](https://community.dremio.com/t/error-on-data-query/201/2 "2017-08-17T15:12:41Z")

</div>

Could you look at your job profile for Verbose Error?  
Here is an example of where to look at:

 ![00 AM](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/1X/d6ef803b4cec4fa56d222feb15f2654d55c4a538.png)

 ![24 AM](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/1X/800d8f8e147772241a2c71475b588f35092bf7c0.png)

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 5, 2017, 10:49am UTC](https://community.dremio.com/t/error-on-data-query/201/3 "2017-09-05T10:49:06Z")

</div>

Also got this error, with the following details -  
DATA\_READ ERROR: Failed to parse date time value in field timestamp.

SqlOperatorImpl ELASTICSEARCH\_SUB\_SCAN  
Location 0:0:6  
Fragment 0:0

[Error Id: on :

I’m not sure I understand what is the error, or how it is connected to elastic-search, as queries through REST do work fine.

---

<div class="post-metadata">

**Author:** ![rohan](https://avatars.discourse-cdn.com/v4/letter/r/f19dbf/32.png) [@rohan](https://community.dremio.com/u/rohan)\
**Post date:** [September 5, 2017, 5:36pm UTC](https://community.dremio.com/t/error-on-data-query/201/4 "2017-09-05T17:36:19Z")

</div>

Hi @ravenr,

Would you be able to share some information about the query?  
Here is how to share the query profile: [https://www.dremio.com/tutorials/share-query-profile/](https://www.dremio.com/tutorials/share-query-profile/)

From looking at the error it seems like it might also be helpful if you could share some sample data from the “timestamp” field.

Thanks,  
Rohan

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 6, 2017, 8:54am UTC](https://community.dremio.com/t/error-on-data-query/201/5 "2017-09-06T08:54:45Z")

</div>

the data is in unattached network, and cannot be shared as is.  
However, the query is the result of the preview query generated by Denodo automatically.  
there is a field called @timestamp, but it doesn’t seem to do any problems in other index/type (mapping), what should I be looking for to find the reason for this ?

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 6, 2017, 11:23am UTC](https://community.dremio.com/t/error-on-data-query/201/6 "2017-09-06T11:23:31Z")

</div>

the @timestamp values are in the default format of elasticsearch which is yyyy-MM-ddTHH:mm:ss.SSSZ  
for example, 2016-03-03T12:34:12.000Z  
Could see nothing special within those values.

I’ve seen I am not the only one who gets this error.

---

<div class="post-metadata">

**Author:** ![rohan](https://avatars.discourse-cdn.com/v4/letter/r/f19dbf/32.png) [@rohan](https://community.dremio.com/u/rohan)\
**Post date:** [September 6, 2017, 7:42pm UTC](https://community.dremio.com/t/error-on-data-query/201/7 "2017-09-06T19:42:45Z")

</div>

Hi @ravenr,

From the limited information provided it seems like the issue is happening when Dremio is parsing one of the values in the timestamp field. One way to clarify which field causes the issue would be to set the logging levels in logback.xml (\<DREMIO\_HOME\>/conf/logback.xml) to “debug” and then share the debug messages from server.log (\<DREMIO\_HOME\>/log/server.log).

Thanks,  
Rohan

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 7, 2017, 5:27am UTC](https://community.dremio.com/t/error-on-data-query/201/8 "2017-09-07T05:27:55Z")

</div>

This limited information is all there is out there unfortunately.  
Nothing more in the verbose detail errors.  
I copied all the data.  
It seems to happen in almost all my indexes so I guess it should have happened a lot, and all over.

---

<div class="post-metadata">

**Author:** ![rohan](https://avatars.discourse-cdn.com/v4/letter/r/f19dbf/32.png) [@rohan](https://community.dremio.com/u/rohan)\
**Post date:** [September 7, 2017, 8:30pm UTC](https://community.dremio.com/t/error-on-data-query/201/9 "2017-09-07T20:30:23Z")

</div>

@ravenr Did you get a chance to look at the debug messages in the log file? Comparing the log output for errors from different indices might help narrow the root cause of the issue down to a specific column or mapping.

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 12, 2017, 8:00am UTC](https://community.dremio.com/t/error-on-data-query/201/10 "2017-09-12T08:00:53Z")

</div>

It seems like using the debug level in the way you offer cause the whole server to almost hang, and things are not working. It takes almost an hour till something is up, and too many errors.  
I am trying to see if the new version solves some of those issues.  
till now the 1.0.8 version was used, as I was not able to reproduce those errors on the cloud with the newer version.

---

<div class="post-metadata">

**Author:** ![ravenr](https://avatars.discourse-cdn.com/v4/letter/r/6de8d8/32.png) [@ravenr](https://community.dremio.com/u/ravenr)\
**Post date:** [September 12, 2017, 12:01pm UTC](https://community.dremio.com/t/error-on-data-query/201/11 "2017-09-12T12:01:42Z")

</div>

The only thing I can get, is this Dremio is complaining about the value ‘2017-04-28 19:59:59’ in the timestamp field. Which is the default elasticsearch field @timestamp

---

<div class="post-metadata">

**Author:** ![HokieKev](https://avatars.discourse-cdn.com/v4/letter/h/e480ec/32.png) [@HokieKev](https://community.dremio.com/u/HokieKev)\
**Post date:** [February 21, 2018, 1:11pm UTC](https://community.dremio.com/t/error-on-data-query/201/12 "2018-02-21T13:11:13Z")

</div>

I am also getting the error message (when trying to read from Elasticsearch):

Failed to parse date time value in field

Was this error ever resolved?

---

<div class="post-metadata">

**Author:** ![HokieKev](https://avatars.discourse-cdn.com/v4/letter/h/e480ec/32.png) [@HokieKev](https://community.dremio.com/u/HokieKev)\
**Post date:** [February 24, 2018, 1:00am UTC](https://community.dremio.com/t/error-on-data-query/201/13 "2018-02-24T01:00:21Z")

</div>

I turned on debugging and this is in the server.log file:

2018-02-23 16:37:23,822 [256f4c3b-f706-2eaa-a74e-a387e50cf800:foreman] INFO c.d.p.elastic.execution.WriteHolders - User Error Occurred [ErrorId: bedb558f-28b0-4f41-8376-9c2261fa3258]

com.dremio.common.exceptions.UserException: Failed to parse date time value 2017/01/01 00:33:04.006 in field source\_data.scantime.

```
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648) ~[dremio-common-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.WriteHolders.getMillis(WriteHolders.java:368) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.WriteHolders.access$100(WriteHolders.java:45) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.WriteHolders$TimestampWriteHolder.write(WriteHolders.java:356) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.WriteHolders$TimestampWriteHolder.writeMap(WriteHolders.java:347) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.FieldReadDefinition.writeMap(FieldReadDefinition.java:132) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.ElasticsearchJsonReader.writeDeclaredMap(ElasticsearchJsonReader.java:328) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.ElasticsearchJsonReader.writeDeclaredMap(ElasticsearchJsonReader.java:324) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.ElasticsearchJsonReader.writeToVector(ElasticsearchJsonReader.java:214) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.ElasticsearchJsonReader.write(ElasticsearchJsonReader.java:182) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.execution.ElasticsearchRecordReader.next(ElasticsearchRecordReader.java:328) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.ElasticTableBuilder.getSampledSchema(ElasticTableBuilder.java:322) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.ElasticTableBuilder.populate(ElasticTableBuilder.java:190) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.ElasticTableBuilder.buildIfNecessary(ElasticTableBuilder.java:161) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.plugins.elastic.ElasticTableBuilder.getDataset(ElasticTableBuilder.java:142) [dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.store.SimpleSchema.getTableFromSource(SimpleSchema.java:366) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.store.SimpleSchema.getTableWithRegistry(SimpleSchema.java:284) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.store.SimpleSchema.getTable(SimpleSchema.java:406) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at org.apache.calcite.jdbc.SimpleCalciteSchema.getImplicitTable(SimpleCalciteSchema.java:67) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.4.4-201801230630490666-6d69d32]

at org.apache.calcite.jdbc.CalciteSchema.getTable(CalciteSchema.java:219) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.4.4-201801230630490666-6d69d32]

at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:117) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:106) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:73) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:71) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:189) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:910) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:891) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2859) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2844) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3077) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:910) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:891) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:208) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:866) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:577) [calcite-core-1.12.0-201712102340200054-6e60422.jar:1.12.0-201712102340200054-6e60422]

at com.dremio.exec.planner.sql.SqlConverter.validate(SqlConverter.java:188) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode(PrelTransformer.java:165) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert(PrelTransformer.java:153) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan(NormalHandler.java:43) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan(HandlerToExec.java:66) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at com.dremio.exec.work.foreman.AttemptManager.run(AttemptManager.java:293) [dremio-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar:1.4.4-201801230630490666-6d69d32]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_131]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_131]

at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]
```

---

<div class="post-metadata">

**Author:** ![JacobHZ](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/jacobhz/32/975_2.png) [@JacobHZ](https://community.dremio.com/u/JacobHZ)\
**Post date:** [October 11, 2018, 9:08am UTC](https://community.dremio.com/t/error-on-data-query/201/14 "2018-10-11T09:08:36Z")

</div>

Was this error ever resolved?

---

<div class="post-metadata">

**Author:** ![fahadh4ilyas](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/fahadh4ilyas/32/2826_2.png) [@fahadh4ilyas](https://community.dremio.com/u/fahadh4ilyas)\
**Post date:** [September 18, 2020, 6:50am UTC](https://community.dremio.com/t/error-on-data-query/201/15 "2020-09-18T06:50:26Z")

</div>

Was this error ever resolved? This error still shows up even after Dremio v4.7.3

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [September 24, 2020, 7:44am UTC](https://community.dremio.com/t/error-on-data-query/201/16 "2020-09-24T07:44:49Z")

</div>

@fahadh4ilyas

If you do not mind, would you be able to send us the profile from the failed job?

> **[How To Share A Query Profile](https://www.dremio.com/tutorials/share-query-profile-dremio/)**
>
> Tutorial explaining how to share a query profile in Dremio.

---

<div class="post-metadata">

**Author:** ![fahadh4ilyas](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/fahadh4ilyas/32/2826_2.png) [@fahadh4ilyas](https://community.dremio.com/u/fahadh4ilyas)\
**Post date:** [September 24, 2020, 8:02am UTC](https://community.dremio.com/t/error-on-data-query/201/17 "2020-09-24T08:02:59Z")

</div>

I already solve it [here](https://community.dremio.com/t/dremio-failed-to-parse-date-time-value-elasticsearch/6314). In my case, my timestamp field has `DOUBLE` type value and not `INTEGER` or `LONG`. Maybe fix it next update so every type of number can be parsed? Because elasticsearch could parse it to datetime but dremio couldn’t.