Inserting data into Iceberg table using Arrow Flight client

1

Hello,

Is it possible to insert (or append) data to an Apache Iceberg table using an Arrow Flight client and Dremio?

For example, could an Arrow Flight client send a stream of record batches as part of a DoPut operation that ends up getting written to a Dremio data source?

Thanks!

2

yes if you are using iceberg tables you can make insert, update or merge sentences

3

I have just attempt to use the “DoPut” operation to write a RecordBatch, but it seems like its unsupported.
The server returns the following message:

‘Status(StatusCode=“Unimplemented”, Detail=“acceptPut is not implemented.”)’

4

@Nisden What are you exactly trying to do? Are you trying to insert into an Iceberg table?

5

Yes, we are trying to insert a large amount of records into an Iceberg table

6

@Nisden Just to narrow down the issue. Can you please try to run it as a pplain insert via the Dremio UI?

7

Yah, I got no issues using a regular “INSERT INTO” command. Its just the Arrow Flight Bulk insert endpoint that is throwing Unimplemented errors.