I promoted a text file to a physical data set. When I try to drop the table I get the following error.
VALIDATION ERROR: Table contains different file formats.
Drop Table is only supported for directories that contain homogeneous file formats consumable by Dremio
This is a promoted file, not a folder. It is a comma delimited file with an extension “.out”
@sgoldsmith That is indeed surprising, does the file contain sensitive data? Can it be shared? If unable to shared, can tou pease send us the log file that has the full error stack? Another question, was any kind of rename or alterations done to the physical file after it was promoted inside Dremio?
test_.zip (217 Bytes)
I have tested the file contained in this zip file locally and get the same error. The file was not altered after being promoted to a table.
This is the error from the server log
2025-02-13 19:30:48,885 [1851b796-8cb7-4994-01bb-b87e93d74d00/0:foreman-planning] ERROR c.d.s.commandpool.CommandWrapper - command 1851b796-8cb7-4994-01bb-b87e93d74d00/0:foreman-planning failed
com.dremio.common.exceptions.UserException: Table contains different file formats.
Drop Table is only supported for directories that contain homogeneous file formats consumable by Dremio
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:979)
at com.dremio.exec.store.dfs.FileSystemPlugin.dropTable(FileSystemPlugin.java:1424)
at com.dremio.exec.catalog.CatalogImpl.dropTable(CatalogImpl.java:1700)
at com.dremio.exec.catalog.SourceAccessChecker.dropTable(SourceAccessChecker.java:282)
at com.dremio.exec.catalog.DelegatingCatalog.dropTable(DelegatingCatalog.java:265)
at com.dremio.exec.planner.sql.handlers.direct.DropTableHandler.toResult(DropTableHandler.java:103)
at com.dremio.exec.planner.sql.handlers.commands.DirectWriterCommand.plan(DirectWriterCommand.java:106)
at com.dremio.exec.work.foreman.AttemptManager.plan(AttemptManager.java:644)
at com.dremio.exec.work.foreman.AttemptManager.lambda$run$4(AttemptManager.java:519)
at com.dremio.service.commandpool.ReleasableBoundCommandPool.lambda$getWrappedCommand$3(ReleasableBoundCommandPool.java:156)
at com.dremio.service.commandpool.CommandWrapper.run(CommandWrapper.java:73)
at com.dremio.context.RequestContext.run(RequestContext.java:103)
at com.dremio.common.concurrent.ContextMigratingExecutorService.lambda$decorate$4(ContextMigratingExecutorService.java:246)
at com.dremio.common.concurrent.ContextMigratingExecutorService$ComparableRunnable.run(ContextMigratingExecutorService.java:222)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2025-02-13 19:30:48,886 [1851b796-8cb7-4994-01bb-b87e93d74d00:foreman] INFO c.d.exec.work.foreman.AttemptManager - 1851b796-8cb7-4994-01bb-b87e93d74d00: State change requested STARTING --> FAILED, Exception com.dremio.exec.work.foreman.ForemanException: Unexpected exception during fragment initialization: com.dremio.common.exceptions.UserException: Table contains different file formats.
Drop Table is only supported for directories that contain homogeneous file formats consumable by Dremio
2025-02-13 19:30:48,977 [Thread-124] ERROR o.a.z.server.NIOServerCnxnFactory - Thread Thread[Thread-124,5,main] died
com.dremio.common.exceptions.UserRemoteException: VALIDATION ERROR: Table contains different file formats.
Drop Table is only supported for directories that contain homogeneous file formats consumable by Dremio
[Error Id: 1ce565c3-8726-4d8b-a78d-f4db2ba242e9 on 09a8f428a223:31010]
at com.dremio.common.exceptions.UserRemoteException.create(UserRemoteException.java:94)
at com.dremio.common.exceptions.GrpcExceptionUtil.fromStatus(GrpcExceptionUtil.java:206)
at com.dremio.common.exceptions.GrpcExceptionUtil.fromStatusRuntimeException(GrpcExceptionUtil.java:193)
at com.dremio.service.jobs.JobStatusListenerAdapter.invokeFailureCallback(JobStatusListenerAdapter.java:104)
at com.dremio.service.jobs.JobStatusListenerAdapter.onError(JobStatusListenerAdapter.java:93)
at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:481)
at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at io.opentracing.contrib.grpc.TracingClientInterceptor$1$2.onClose(TracingClientInterceptor.java:224)
at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:574)
at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:72)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:742)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:723)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2025-02-13 19:30:48,985 [async-query-logger1] INFO query.logger - Query: 1851b796-8cb7-4994-01bb-b87e93d74d00; outcome: FAILED