I have an Iceberg table with 150 columns and 5 million records.
When I tried executing the following query:
SELECT * FROM nessie.mydb1.testtable ORDER BY attribute_66 ASC LIMIT 10 OFFSET 10;
I encountered the following exception:
org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.FlightRuntimeException: Network closed for unknown reason
at …
I’m running a Dremio instance on my laptop using Docker. Below is my docker-compose.yml file:
dremio:
image: dremio/dremio-oss:latest
ports:
- 9047:9047
- 31010:31010
- 32010:32010
- 45678:45678
container_name: dremio
volumes:
- ./dremio-data:/opt/dremio/data
- ./dremio-tmp:/var/lib/dremio
environment:
- DREMIO_MAX_DIRECT_MEMORY=8g # Increase memory if needed
- DREMIO_HEAP_MEMORY=16g
Any idea what might be causing this issue?
Errot stack trace :
2025-03-31T21:08:13.290+05:30 ERROR 88826 — [smarts-db-pipeline] [nio-8093-exec-1] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path threw exception [Request processing failed: java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Error while executing SQL “SELECT * FROM nessie.mydb1.testtable ORDER BY attribute_66 ASC LIMIT 10 OFFSET 10”: Network closed for unknown reason] with root cause
org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.FlightRuntimeException: Network closed for unknown reason
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.CallStatus.toRuntimeException(CallStatus.java:121) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.grpc.StatusUtils.fromGrpcRuntimeException(StatusUtils.java:161) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.grpc.StatusUtils.fromThrowable(StatusUtils.java:182) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.FlightStream$Observer.onError(FlightStream.java:489) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.FlightClient$1.onError(FlightClient.java:371) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:481) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.org.apache.arrow.flight.grpc.ClientInterceptorAdapter$FlightClientCallListener.onClose(ClientInterceptorAdapter.java:118) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:564) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:72) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:729) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:710) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at org.apache.arrow.driver.jdbc.shaded.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133) ~[flight-sql-jdbc-driver-17.0.0.jar:17.0.0]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[na:na]
at java.base/java.lang.Thread.run(Thread.java:1583) ~[na:na]
2025-03-31T21:08:13.326+05:30 WARN 88826 — [smarts-db-pipeline] [nio-8093-exec-1] .w.s.m.s.DefaultHandlerExceptionResolver : Resolved [org.springframework.web.context.request.async.AsyncRequestNotUsableException: ServletOutputStream failed to flush: java.io.IOException: Broken pipe]
attaching the docker logs
docker logs.txt.zip (86.8 KB)