Error creating table on hive metastore and S3 storage

Dermio version: V24 - Community edition

ERROR c.d.e.s.i.model.IcebergBaseCommand - The dataset is now forgotten by dremio, but there was an error while cleaning up respective data and metadata files residing at s3a://dremio/data.

2023-02-22 14:14:25,536 [1c09dcc0-dac5-23e2-7779-4a4d4e11fc00/0:foreman-planning] WARN c.d.e.s.i.m.IcebergTableCreationCommitter - Failure during cleaning up the unwanted files

java.lang.RuntimeException: org.apache.iceberg.exceptions.RuntimeIOException: Failed to delete file: s3a://dremio/data

    at com.dremio.exec.store.iceberg.model.IcebergBaseCommand.deleteTable(IcebergBaseCommand.java:390)

    at com.dremio.exec.store.iceberg.model.IcebergTableCreationCommitter.commit(IcebergTableCreationCommitter.java:86)

    at com.dremio.exec.store.hive.Hive3StoragePlugin.createEmptyTable(Hive3StoragePlugin.java:633)

    at com.dremio.exec.catalog.CatalogImpl.createEmptyTable(CatalogImpl.java:939)

    at com.dremio.exec.catalog.SourceAccessChecker.createEmptyTable(SourceAccessChecker.java:172)

    at com.dremio.exec.catalog.DelegatingCatalog.createEmptyTable(DelegatingCatalog.java:219)

    at com.dremio.exec.planner.sql.handlers.direct.CreateEmptyTableHandler.callCatalogCreateEmptyTableWithCleanup(CreateEmptyTableHandler.java:120)

    at com.dremio.exec.planner.sql.handlers.direct.CreateEmptyTableHandler.createEmptyTable(CreateEmptyTableHandler.java:211)

    at com.dremio.exec.planner.sql.handlers.direct.CreateEmptyTableHandler.toResult(CreateEmptyTableHandler.java:93)

    at com.dremio.exec.planner.sql.handlers.commands.DirectWriterCommand.plan(DirectWriterCommand.java:100)

    at com.dremio.exec.work.foreman.AttemptManager.plan(AttemptManager.java:530)

    at com.dremio.exec.work.foreman.AttemptManager.lambda$run$4(AttemptManager.java:422)

    at com.dremio.service.commandpool.ReleasableBoundCommandPool.lambda$getWrappedCommand$3(ReleasableBoundCommandPool.java:140)

    at com.dremio.service.commandpool.CommandWrapper.run(CommandWrapper.java:70)

    at com.dremio.context.RequestContext.run(RequestContext.java:96)

    at com.dremio.common.concurrent.ContextMigratingExecutorService.lambda$decorate$4(ContextMigratingExecutorService.java:212)

    at com.dremio.common.concurrent.ContextMigratingExecutorService$ComparableRunnable.run(ContextMigratingExecutorService.java:192)

    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

    at java.util.concurrent.FutureTask.run(FutureTask.java:266)

    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

    at java.lang.Thread.run(Thread.java:750)

Caused by: org.apache.iceberg.exceptions.RuntimeIOException: Failed to delete file: s3a://dremio/data

    at com.dremio.exec.store.iceberg.DremioFileIO.deleteFile(DremioFileIO.java:172)

    at com.dremio.exec.store.iceberg.model.IcebergBaseCommand.deleteTable(IcebergBaseCommand.java:386)

    ... 21 common frames omitted

@eelsherif Did you spot this in the server.log of Dremio? Would you be able to share the entire log?