"Column not found in any table" querying Elasticsearch 6.1.3

1

I have a column mapped to an Elasticsearch “scaled_float” but It is not visible from Dremio; I get a “
Column ‘duration’ not found in any table” error message. This is my ES mapping for the index:


{
  "webserviceusage-2018-02-26" : {
    "mappings" : {
      "doc" : {
        "properties" : {
          "@timestamp" : {
            "type" : "date"
          },
          "@version" : {
            "type" : "text",
            "index" : false
          },
          "clientName" : {
            "type" : "keyword",
            "index" : false
          },
          "createdTimestamp" : {
            "type" : "text",
            "index" : false
          },
          "duration" : {
            "type" : "scaled_float",
            "scaling_factor" : 1000.0
          },
          "entityName" : {
            "type" : "keyword"
          },
          "entityValue" : {
            "type" : "keyword"
          },
          "inputParameters" : {
            "type" : "text"
          },
          "ipAddress" : {
            "type" : "ip",
            "index" : false,
            "store" : true
          },
          "locationName" : {
            "type" : "keyword",
            "index" : false
          },
          "methodCall" : {
            "type" : "keyword"
          },
          "outputParameters" : {
            "type" : "text"
          },
          "serviceCall" : {
            "type" : "keyword"
          },
          "status" : {
            "type" : "keyword"
          },
          "userName" : {
            "type" : "keyword",
            "index" : false
          },
          "wsuID" : {
            "type" : "keyword"
          }
        }
      }
    }
  }
}

Thanks

2

Dremio does not yet support ES 6.x. Currently 2.x and 5.x are supported. While many things work in 6.x, there several limitations due to some breaking changes made in Elasticsearch.

We expect to support 6.x later this year.

3

Thanks for the quick reply.

4

Please support it as soon as you can, many modern elasticsearch clusters run the latest version. Really big fan of your community and product by the way.
George

5

Elasticsearch 6 support is now available in the latest Dremio release. More details here.