Issue with Connecting to Dremio Software instance via Flight Client

Hi,

I am trying to connect to Dremio instance deployed in a standalone cluster in US VM from the client that is located in the EU via Flight SQL interface.

From time to time, I’m getting below exception:

java.lang.InterruptedException
	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:385)
	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.arrow.flight.auth2.ClientHandshakeWrapper.doClientHandshake(ClientHandshakeWrapper.java:51)
	at org.apache.arrow.flight.FlightClient.handshake(FlightClient.java:210)

Sometimes I’m getting the error that the connection has timed-out.

I checked the Jobs logs in the Dremio UI and I cannot see any queries that were excecuted.

I also investigated the Dremio instance logs in the /var/log directory, but there was also nothing.

When I’m connecting to that Dremio instance in US via JDBC client then it’s OK. Also when I’m connecting to Dremio instance that is deployed in the EU then it’s fine.

I think there might some issues with the timeout configuration. Is there any way to find out what can be wrong and how to tune it?

Hi pira
Which versions of client and Dremio are you using?

There is a support key mentioned here that may help:

Thank you

US Dremio Cluster version: 22.1.1-202208230402290397-a7010f28
EU Dremio Cluster version: 23.0.1-202210141019030815-c1de8bcc
Dremio Flight SQL client version: 8.0.0

After submitting that query from the above topic, I think the amount of timeouts is now smaller than it was before, however I need to do some more testing.

Thanks.

I did more testing and the timeouts still occur. The above properties did not help.

Hi @pira ,

Could you share what value you have tried setting flight.client.readiness.timeout.millis to?

The default is 5000 and the max is 90000 (15 minutes).