IllegalArgumentException: equalityFields and equalityVectors list sizes do not match - Error reading data from iceberg tables on Dremio

Apache Iceberg
1

I’m using Kafka and Debezium to ingest data from MSSQL into Iceberg Tables. I am using Nessie catalog and IBM cloud object storage.
When I query data from Iceberg tables on Dremio I got error:

IllegalArgumentException: equalityFields and equalityVectors list sizes do not match

Part of my sink connector config:

  class: io.tabular.iceberg.connect.IcebergSinkConnector
  tasksMax: 1
  config:

    key.converter: "org.apache.kafka.connect.json.JsonConverter"
    value.converter: "org.apache.kafka.connect.json.JsonConverter"
    key.converter.schemas.enable: "true"
    value.converter.schemas.enable: "true"

    iceberg.tables.auto-create-enabled: "true"
    iceberg.tables.default-commit-branch: "main"
    iceberg.table.my_table.id-columns: "Id"
    iceberg.table.my_table.partition-by: "Id"
    iceberg.tables.default-id-columns: "Id"
    iceberg.tables.default-partition-by: "Id"
    iceberg.tables.upsert-mode-enabled: "true"
2

Hi, can you attach a query profile with the error? It looks like some issue with reading the Iceberg table’s equality delete file. Are you able to query the same table with another engine such as Spark?