Hi everyone, I need some help with my configurations using Opensearch and Dremio, I’m really new to this.
I’m using a custom plugin for opensearch that uses a system of ARP.
My arp datatypes looks like this:
data_types:
mappings:
- source:
name: "BOOLEAN"
dremio:
name: "boolean"
required_cast_arguments: "none"
- source:
name: "INTEGER"
dremio:
name: "integer"
required_cast_arguments: "none"
- source:
name: "FLOAT"
dremio:
name: "double"
required_cast_arguments: "none"
- source:
name: "TIMESTAMP"
max_scale: 6
dremio:
name: "timestamp"
required_cast_arguments: "none"
- source:
name: "DATE"
dremio:
name: "date"
required_cast_arguments: "none"
- source:
name: "VARCHAR"
dremio:
name: "varchar"
required_cast_arguments: "none"
My software:
-
Dremio
– Build
— 24.3.2-202401241821100032-d2d8a497
– Edition
— Community Edition
– Build Time
— 24/01/2024 18:30:34
– Change Hash
— d2d8a49790d59599d617f25f6020731f0260178d
– Change Time
— 24/01/2024 18:11:23 -
Opensearch
{
"name" : "opensearch",
"cluster_name" : "opensearch-cluster",
"cluster_uuid" : "2BcdPhS8RoSgHLIN1dRTgQ",
"version" : {
"distribution" : "opensearch",
"number" : "2.11.0",
"build_type" : "tar",
"build_hash" : "4dcad6dd1fd45b6bd91f041a041829c8687278fa",
"build_date" : "2023-10-13T02:55:55.511945994Z",
"build_snapshot" : false,
"lucene_version" : "9.7.0",
"minimum_wire_compatibility_version" : "7.10.0",
"minimum_index_compatibility_version" : "7.0.0"
},
"tagline" : "The OpenSearch Project: https://opensearch.org/"
}
While I’m trying to do a simple query that looks like this:
SELECT * FROM "opensearch"."logstash_logs-000001"
I’m allways getting this exception:
Source 'opensearch' returned error 'Can not convert object '{hostname=7f9db56d00f0, id=ec5de384-e9de-438d-947b-61f39e6f818f, ephemeral_id=1057519b-42fd-46cc-9141-938e45bec573, type=filebeat, version=7.4.2}' of type 'java.util.LinkedHashMap' to type 'java.lang.String''
Can someone explain to me what is happening and the reason behind it ? I can’t really find anything useful online that could help me out.