Hi, I’m trying to understand an error I get when I point Dremio to a dataset.
Field [PAYLOAD] has incompatible types in file and table
In the physical data set the field “PAYLOAD” it is always an object, but frequently has a few different shapes. It is logging an ElasticSearch query and so as the query changed so is the object. Sometimes there is a {“term”:…} sometimes a {“match_phrase_prefix”} or sometimes the bool.must field is an empty array.
Can Dremio make sense of that all and allow me to present these as objects or does every object in that field have to have the same schema?
Field [PAYLOAD] has incompatible types in file and table. Type in fileschema: [PAYLOAD: STRUCT<_source: LIST<data: VARCHAR>, from: BIGINT, query: STRUCT<bool: STRUCT<must: LIST<data: STRUCT<match_phrase_prefix: STRUCT<propertyAddress_tx: VARCHAR>, term: STRUCT<firstOccurrence_fg: BOOLEAN>>>>>, size: BIGINT, sort: LIST<data: STRUCT<transaction_id.keyword: VARCHAR>>>], type in tableschema: [payload: STRUCT<_source: LIST<data: VARCHAR>, from: BIGINT, query: STRUCT<bool: STRUCT<must: LIST<data: INTEGER>>>, size: BIGINT, sort: LIST<data: STRUCT<project_id.keyword: VARCHAR, transaction_id.keyword: VARCHAR>>>].Show less