Failed to establish a new connection REST, Flight, & ODBC

We’re on Dremio 19.0.0 and having issues connecting dremio_client to either the REST (port 9047), Flight (port 32010), or ODBC (port 31010) endpoints. The Admin UI works fine.

When trying to connect via the above methods I get: Max retries exceeded with url: /api/v3/catalog/e2676566-1946-4f11-8e21-9fbb366fa77a/refresh (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fbaf84bba30>: Failed to establish a new connection: [Errno 60] Operation timed out'))

When trying to connect with ODBC, via Dbeaver, I get the following error:

Failure in connecting to Dremio: cdjd.com.dremio.exec.rpc.RpcException: Timed out after 30s waiting to connect to dremio-client.nonprod.yumds.com:31010
  Timed out after 30s waiting to connect to dremio-client.nonprod.yumds.com:31010
  Timed out after 30s waiting to connect to dremio-client.nonprod.yumds.com:31010

Port-forwarding to the flight port 32010 also doesn’t work when following the v2 chart: dremio-cloud-tools/charts/dremio_v2 at master · dremio/dremio-cloud-tools · GitHub

Our DevOps team believes this is coming from the Dremio pod itself.

Any ideas or suggestions?

@rockyyost

Any chance there is a load balancer/proxy/FW between the ODBC client and Dremio