Hi Team,
I have successfully configured AWS IAM with Dremio and verified that queries executed via the Dremio UI can create and insert data into Iceberg tables stored in my S3 bucket.
As I plan to use this setup at a production-like scale, I expect that metadata, manifests, and data files will continue to grow. My question is:
Is the management of Iceberg data in S3 (e.g., compaction, cleanup, file optimization) handled automatically by Dremio, or is this responsibility left to the user side?
Thanks,
Seungchul Lee