# Apache Iceberg **URL:** https://community.dremio.com/c/apache-iceberg/43.md [Latest](https://community.dremio.com/latest.md) · [Categories](https://community.dremio.com/categories.md) --- ## [About the Apache Iceberg category](https://community.dremio.com/t/about-the-apache-iceberg-category/12019)
**Author:** [@AlexMerced](https://community.dremio.com/u/AlexMerced)\ **Replies:** 0\ **Last updated:** [July 3, 2024, 3:05pm UTC](https://community.dremio.com/t/about-the-apache-iceberg-category/12019 "2024-07-03T15:05:45Z")
This a category to ask conceptual and technical questions about Apache Iceberg table format and how it works with Dremio (not for support with other engines). --- ## [Soumitra Dutta-How do I create an Apache Iceberg table in Dremio?](https://community.dremio.com/t/soumitra-dutta-how-do-i-create-an-apache-iceberg-table-in-dremio/13369)
**Author:** [@soumitradutta26](https://community.dremio.com/u/soumitradutta26)\ **Replies:** 1\ **Last updated:** [July 30, 2026, 6:42pm UTC](https://community.dremio.com/t/soumitra-dutta-how-do-i-create-an-apache-iceberg-table-in-dremio/13369 "2026-07-30T18:42:46Z")
Hi Everyone, I am Soumitra Dutta an entrepreneur & photographer from Oxford. I’m getting started with Apache Iceberg in Dremio and would like some advice on the best way to create an Iceberg table. Regards Soumitra Dut… --- ## [Soumitra Dutta Oxford-How do I create an Apache Iceberg table correctly in Dremio?](https://community.dremio.com/t/soumitra-dutta-oxford-how-do-i-create-an-apache-iceberg-table-correctly-in-dremio/13351)
**Author:** [@soumitradutta26](https://community.dremio.com/u/soumitradutta26)\ **Replies:** 0\ **Last updated:** [May 19, 2026, 7:26am UTC](https://community.dremio.com/t/soumitra-dutta-oxford-how-do-i-create-an-apache-iceberg-table-correctly-in-dremio/13351 "2026-05-19T07:26:38Z")
Hi Everyone, I am Soumitra Dutta an entrepreneur & photographer from Oxford. I’m trying to create an Apache Iceberg table in Dremio, but I’m not fully sure I’m doing it correctly. I’ve set up my source, but I’m unclear a… --- ## [Cannot register Iceberg tables in bucket with different region than project](https://community.dremio.com/t/cannot-register-iceberg-tables-in-bucket-with-different-region-than-project/13328)
**Author:** [@Nicolas-Reichel\_SSCS](https://community.dremio.com/u/Nicolas-Reichel_SSCS)\ **Replies:** 2\ **Last updated:** [March 16, 2026, 9:47am UTC](https://community.dremio.com/t/cannot-register-iceberg-tables-in-bucket-with-different-region-than-project/13328 "2026-03-16T09:47:05Z")
I’ve got a project in us-east-1, and an AWS S3 bucket in eu-north-1 as an external data source. I created a table test\_table in eu-north-1 using a CTAS in the GUI as a test (confirming the bucket is reachable by Dremio),… --- ## [Dremio Performance & Load Balancing Issue](https://community.dremio.com/t/dremio-performance-load-balancing-issue/13314)
**Author:** [@ruchitha](https://community.dremio.com/u/ruchitha)\ **Replies:** 2\ **Last updated:** [February 25, 2026, 11:50pm UTC](https://community.dremio.com/t/dremio-performance-load-balancing-issue/13314 "2026-02-25T23:50:58Z")
I am testing query performance and executor load balancing in Dremio and need guidance to understand whether I am facing a configuration or architectural bottleneck. Environment Setup Source: MySQL table with ~10 mil… --- ## [SQL via Dremio onto S3/Minio failing](https://community.dremio.com/t/sql-via-dremio-onto-s3-minio-failing/13308)
**Author:** [@georgelza](https://community.dremio.com/u/georgelza)\ **Replies:** 13\ **Last updated:** [February 25, 2026, 10:59pm UTC](https://community.dremio.com/t/sql-via-dremio-onto-s3-minio-failing/13308 "2026-02-25T22:59:26Z")
hi hi all, hope someone can assist. I’ve created a iceberg table out of parquet files, written all of this to my S3 objet store/based on MinIO. I can query the table, using duckdb by pointing it at the version-hint.tx… --- ## [MERGE with VALUES and MAP's](https://community.dremio.com/t/merge-with-values-and-maps/13305)
**Author:** [@Nisden](https://community.dremio.com/u/Nisden)\ **Replies:** 4\ **Last updated:** [February 9, 2026, 12:21am UTC](https://community.dremio.com/t/merge-with-values-and-maps/13305 "2026-02-09T00:21:29Z")
I am attempting to use the MERGE statement together with a MAP column from a temporary SELECT/VALUES statement, but I get a strange error. The error is: cast function for type MAP is not defined The SQL I attempt to u… --- ## [Polaris catalog on Dremio community edition](https://community.dremio.com/t/polaris-catalog-on-dremio-community-edition/12748)
**Author:** [@vadlamania](https://community.dremio.com/u/vadlamania)\ **Replies:** 3\ **Last updated:** [December 4, 2025, 3:55am UTC](https://community.dremio.com/t/polaris-catalog-on-dremio-community-edition/12748 "2025-12-04T03:55:16Z")
I see that polaris catalog is not supported on Dremio community edition. I even tried using the property “plugins.restcatalog.enabled: true” inside dremio.conf, but this also didn’t help. Is there any other way we can co… --- ## [Incorrect timestamp field type in for created Iceberg Table](https://community.dremio.com/t/incorrect-timestamp-field-type-in-for-created-iceberg-table/13095)
**Author:** [@sheinbergon](https://community.dremio.com/u/sheinbergon)\ **Replies:** 10\ **Last updated:** [November 17, 2025, 4:42pm UTC](https://community.dremio.com/t/incorrect-timestamp-field-type-in-for-created-iceberg-table/13095 "2025-11-17T16:42:21Z")
This is somewhat of a criticial bug. Using dremio 26.0.0 OSS, when I create an iceberg table on top of AWS GLUE: Dremio doesn’t have timstamp with timezone type, so the date cloumn is just a Timestamp Parquet files cr… --- ## [How to insert data from dataframe in a iceberg table?](https://community.dremio.com/t/how-to-insert-data-from-dataframe-in-a-iceberg-table/13236)
**Author:** [@chrisRains](https://community.dremio.com/u/chrisRains)\ **Replies:** 3\ **Last updated:** [October 30, 2025, 1:36am UTC](https://community.dremio.com/t/how-to-insert-data-from-dataframe-in-a-iceberg-table/13236 "2025-10-30T01:36:02Z")
I did setup minio and connected it via nessie to dremio ( community edition). Now I want to insert rows from a dataframe in an iceberg table via dremio / pyarrow. how would I do this ? I managed to read the data, but I… --- ## [How to upload data to dremio nessie iceberg table via apache arrow flight?](https://community.dremio.com/t/how-to-upload-data-to-dremio-nessie-iceberg-table-via-apache-arrow-flight/13216)
**Author:** [@ganbaatar](https://community.dremio.com/u/ganbaatar)\ **Replies:** 2\ **Last updated:** [October 9, 2025, 8:40am UTC](https://community.dremio.com/t/how-to-upload-data-to-dremio-nessie-iceberg-table-via-apache-arrow-flight/13216 "2025-10-09T08:40:32Z")
how to upload data to dremio nessie iceberg table via apache arrow flight? i have python polars dataframe but need to upload that data to my dremio server. any way to do that without spark or javahome? because using I… --- ## [Error with dbt, dremio and incremental updates](https://community.dremio.com/t/error-with-dbt-dremio-and-incremental-updates/13195)
**Author:** [@memyself](https://community.dremio.com/u/memyself)\ **Replies:** 9\ **Last updated:** [September 9, 2025, 1:55am UTC](https://community.dremio.com/t/error-with-dbt-dremio-and-incremental-updates/13195 "2025-09-09T01:55:32Z")
Hi to you all. I work with dremio and have the following an iceberg table, I want to update a view with differential source data that should be appended with dbt with an incremental update strategy to the target iceb… --- ## [Best Catalog for Apache Iceberg w/ Dremio?](https://community.dremio.com/t/best-catalog-for-apache-iceberg-w-dremio/13156)
**Author:** [@coldfusioncoder](https://community.dremio.com/u/coldfusioncoder)\ **Replies:** 2\ **Last updated:** [September 3, 2025, 11:59am UTC](https://community.dremio.com/t/best-catalog-for-apache-iceberg-w-dremio/13156 "2025-09-03T11:59:04Z")
Q: Is there a recommended catalog to use with Dremio and Apache Iceberg? I’m new to Apache Iceberg and Dremio. I’m using MinIO for S3 because we’re doing on-prem, and using docker to run all our services on a single com… --- ## [ENHANCE\_YOUR\_CALM error response](https://community.dremio.com/t/enhance-your-calm-error-response/13190)
**Author:** [@RasmusW](https://community.dremio.com/u/RasmusW)\ **Replies:** 0\ **Last updated:** [August 22, 2025, 8:41am UTC](https://community.dremio.com/t/enhance-your-calm-error-response/13190 "2025-08-22T08:41:03Z")
We’ve got some jobs that use Arrow Flight to query and insert/delete data in iceberg tables. We regularly get gRPC Resource Exhausted and ENHANCE\_YOUR\_CALM error responses. We haven’t been able to identify the cause. W… --- ## [Iceberg table not registering why?](https://community.dremio.com/t/iceberg-table-not-registering-why/12923)
**Author:** [@rajnish](https://community.dremio.com/u/rajnish)\ **Replies:** 3\ **Last updated:** [April 4, 2025, 3:03am UTC](https://community.dremio.com/t/iceberg-table-not-registering-why/12923 "2025-04-04T03:03:11Z")
I was using Dremio and nessies – initially nessie was setup with in-memory and i created huge iceberg table \[iceberg\_tbl1\] when nessies rebooted obvious metadata gone and now dremio is not able to access I configure … --- ## [Unable load big json data to Iceberg with Dremio](https://community.dremio.com/t/unable-load-big-json-data-to-iceberg-with-dremio/12878)
**Author:** [@sleepdan](https://community.dremio.com/u/sleepdan)\ **Replies:** 0\ **Last updated:** [March 18, 2025, 11:01am UTC](https://community.dremio.com/t/unable-load-big-json-data-to-iceberg-with-dremio/12878 "2025-03-18T11:01:16Z")
Hi all! I want to load data from a json file that I have previously loaded into minio bucket. I added a data source and the loaded data is displayed (file “bigdata.json”): and content data of file is previewed. Whe… --- ## [Multitable insert - transaction support](https://community.dremio.com/t/multitable-insert-transaction-support/12743)
**Author:** [@tolgaevren](https://community.dremio.com/u/tolgaevren)\ **Replies:** 1\ **Last updated:** [February 10, 2025, 3:30pm UTC](https://community.dremio.com/t/multitable-insert-transaction-support/12743 "2025-02-10T15:30:40Z")
Hi , Is it possible to insert records in multipletables in s single transaction as if we insert to a database like : begin transaction insert into customer insert into sales commit thanks tolga --- ## [VACUUM TABLE command is not supported for this source](https://community.dremio.com/t/vacuum-table-command-is-not-supported-for-this-source/12697)
**Author:** [@jaroslav\_marko](https://community.dremio.com/u/jaroslav_marko)\ **Replies:** 4\ **Last updated:** [February 6, 2025, 4:11pm UTC](https://community.dremio.com/t/vacuum-table-command-is-not-supported-for-this-source/12697 "2025-02-06T16:11:14Z")
Hi, we have OSS 25.2.0 with Nessie catalogue. we perform regular table updates (full refresh) and the allocated disk space is exploding :slight\_smile: when I run vacuum catalogue nessie; it removes some files, but I… --- ## [Unable to Query Iceberg Data in Dremio - Data Written by Kafka Connector](https://community.dremio.com/t/unable-to-query-iceberg-data-in-dremio-data-written-by-kafka-connector/12514)
**Author:** [@Barry](https://community.dremio.com/u/Barry)\ **Replies:** 11\ **Last updated:** [January 10, 2025, 4:10am UTC](https://community.dremio.com/t/unable-to-query-iceberg-data-in-dremio-data-written-by-kafka-connector/12514 "2025-01-10T04:10:19Z")
Issue Description I am using a Kafka Connect Sink Connector to write data to Iceberg tables with the following configuration: connector.class=io.tabular.iceberg.connect.IcebergSinkConnector tasks.max=2 topics=transacti… --- ## [IllegalArgumentException: equalityFields and equalityVectors list sizes do not match - Error reading data from iceberg tables on Dremio](https://community.dremio.com/t/illegalargumentexception-equalityfields-and-equalityvectors-list-sizes-do-not-match-error-reading-data-from-iceberg-tables-on-dremio/12656)
**Author:** [@cnornberg](https://community.dremio.com/u/cnornberg)\ **Replies:** 1\ **Last updated:** [January 5, 2025, 6:39pm UTC](https://community.dremio.com/t/illegalargumentexception-equalityfields-and-equalityvectors-list-sizes-do-not-match-error-reading-data-from-iceberg-tables-on-dremio/12656 "2025-01-05T18:39:02Z")
I’m using Kafka and Debezium to ingest data from MSSQL into Iceberg Tables. I am using Nessie catalog and IBM cloud object storage. When I query data from Iceberg tables on Dremio I got error: IllegalArgumentException:… --- ## [Vacuum with variable date](https://community.dremio.com/t/vacuum-with-variable-date/12225)
**Author:** [@Sebastian](https://community.dremio.com/u/Sebastian)\ **Replies:** 4\ **Last updated:** [December 16, 2024, 3:12am UTC](https://community.dremio.com/t/vacuum-with-variable-date/12225 "2024-12-16T03:12:35Z")
Hello, I am trying to use the Iceberg vacuum statement with a variable date (e.g. keep all snapshot from last x days). The following code was shown in the Gnarly Data Waves Session on Tuesday, but does not seem to work … --- ## [Metadata.json remains after Iceberg vacuum statement](https://community.dremio.com/t/metadata-json-remains-after-iceberg-vacuum-statement/12350)
**Author:** [@Sebastian](https://community.dremio.com/u/Sebastian)\ **Replies:** 12\ **Last updated:** [November 13, 2024, 6:18am UTC](https://community.dremio.com/t/metadata-json-remains-after-iceberg-vacuum-statement/12350 "2024-11-13T06:18:43Z")
Hello, I have Iceberg tables on a Cloudian S3 Bucket connected with Dremio. After I execute a vacuum Statement via Dremio SQL Query, I can still see the vXX.metadata.json files on my file system and they continually kee… --- ## [Postgres Schema for Iceberg Nessie](https://community.dremio.com/t/postgres-schema-for-iceberg-nessie/12216)
**Author:** [@datasundae](https://community.dremio.com/u/datasundae)\ **Replies:** 4\ **Last updated:** [October 17, 2024, 11:04am UTC](https://community.dremio.com/t/postgres-schema-for-iceberg-nessie/12216 "2024-10-17T11:04:09Z")
If one is starting from scratch how is it that Iceberg / Nessie write to postgres - I would think I would need to create the table(s) and communicate that in a config file. In the case of Dremio, is Dremio writing that … --- ## [How to get the values dynamically from the iceberg table which contains the json type data](https://community.dremio.com/t/how-to-get-the-values-dynamically-from-the-iceberg-table-which-contains-the-json-type-data/12368)
**Author:** [@Riya](https://community.dremio.com/u/Riya)\ **Replies:** 3\ **Last updated:** [October 8, 2024, 5:30am UTC](https://community.dremio.com/t/how-to-get-the-values-dynamically-from-the-iceberg-table-which-contains-the-json-type-data/12368 "2024-10-08T05:30:31Z")
Hi Team, I have the table in hive catalog of dremio where in one of my column it contains the json structure data so i want to make the query dynamic where it can create the table itself. I tried flattening it but it th… --- ## [IndexOutOfBoundsException after ADD PARTITION FIELD to empty table](https://community.dremio.com/t/indexoutofboundsexception-after-add-partition-field-to-empty-table/12356)
**Author:** [@ctung](https://community.dremio.com/u/ctung)\ **Replies:** 1\ **Last updated:** [October 2, 2024, 6:23am UTC](https://community.dremio.com/t/indexoutofboundsexception-after-add-partition-field-to-empty-table/12356 "2024-10-02T06:23:51Z")
Created a table with PARTITION BY (month(“timestamp”)) Then did an ALTER TABLE … ADD PARTITION FIELD year(“timestamp”) response was “true” But now if I do a SHOW CREATE TABLE, I get the following error: IndexOutOfB… --- ## [How to effectively accelerate specific query](https://community.dremio.com/t/how-to-effectively-accelerate-specific-query/12261)
**Author:** [@jaroslav\_marko](https://community.dremio.com/u/jaroslav_marko)\ **Replies:** 7\ **Last updated:** [September 26, 2024, 6:49pm UTC](https://community.dremio.com/t/how-to-effectively-accelerate-specific-query/12261 "2024-09-26T18:49:44Z")
Hi team, can you please advice how to effectively accelerate below query. it is cca 30M rows and whatever reflection i create it scans all 30M rows. I tried to created view and raw reflection on it with aggregation wi… --- ## [Unable to configure Nessies?](https://community.dremio.com/t/unable-to-configure-nessies/12299)
**Author:** [@rajnish](https://community.dremio.com/u/rajnish)\ **Replies:** 6\ **Last updated:** [September 25, 2024, 3:04am UTC](https://community.dremio.com/t/unable-to-configure-nessies/12299 "2024-09-25T03:04:36Z")
Team, Nessies is running on ip:19120/tree/main not on api/vX – how to configure it on api/v2 ,… issues is I am unable to configure Nessie endpoint on Dremio, it throw invalid endpoint any suggest what I need to do? --- ## [Accelaration not effective on select distinct \* from table](https://community.dremio.com/t/accelaration-not-effective-on-select-distinct-from-table/12263)
**Author:** [@jaroslav\_marko](https://community.dremio.com/u/jaroslav_marko)\ **Replies:** 3\ **Last updated:** [September 19, 2024, 4:55am UTC](https://community.dremio.com/t/accelaration-not-effective-on-select-distinct-from-table/12263 "2024-09-19T04:55:06Z")
Hi, I have wide table (\>200 columns) with 30M rows. I want to accelerate select distinct \* from table. So I have created view with “select distinct \* from table” and created a full Raw reflection on it. My understan… --- ## [How to add partition to an existing table](https://community.dremio.com/t/how-to-add-partition-to-an-existing-table/12264)
**Author:** [@jaroslav\_marko](https://community.dremio.com/u/jaroslav_marko)\ **Replies:** 2\ **Last updated:** [September 18, 2024, 12:50pm UTC](https://community.dremio.com/t/how-to-add-partition-to-an-existing-table/12264 "2024-09-18T12:50:19Z")
Hi, I’m experimenting with performance of large tables (\>500M rows) and as I go through different use cases I oftentimes wish to change the partitioning of a table. I know that i can create reflection, but there should … --- ## [Oracle/ SQL Server DW replaced by Iceberg](https://community.dremio.com/t/oracle-sql-server-dw-replaced-by-iceberg/12234)
**Author:** [@amin](https://community.dremio.com/u/amin)\ **Replies:** 3\ **Last updated:** [September 14, 2024, 12:35am UTC](https://community.dremio.com/t/oracle-sql-server-dw-replaced-by-iceberg/12234 "2024-09-14T00:35:53Z")
Hi, May I know if anyone has experience replacing traditional DW on Oracle/ SQL Server to Iceberg + Parquet in S3? Great if you could share advantages and disadvantages on doing this? [Next page](https://community.dremio.com/c/apache-iceberg/43.md?page=1)