No route to host (Host unreachable) - connecting to mysql in docker swarm

1

Heyho,
i set up a VM running docker swarm with dremio and a mysql db among other things, all in their own container.
I can connect my MYSQL Database to my Airbyte instance using the overlay network (10.0.2.15) but not to Dremio.
All Services are in the same network and im using the same ip, port and credentials as in airbyte.

Dremio version: 22.1.1 CE

If i check my logs i get this error:

2023-03-27 11:21:24,022 [start-Amazon] ERROR c.d.e.s.jdbc.JdbcSchemaFetcherImpl - Connection is not valid.

java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=10.0.2.15)(port=3306)(type=master) : No route to host (Host unreachable)

logs.zip (14,9 KB)

No route to host confused me since they are in the same network and airbyte can reach the host

Our compose file:

version: "3.5"

services:
  dremio:
    image: dremio/dremio-oss:22.1
    volumes:
      - dremio_data:/opt/dremio/data
      - dremio_conf:/opt/dremio/conf
    ports:
     - "9047:9047"    # Dremio REST/UI
     - "31010:31010"  # Clients ODBC/JDBC (Tableau, Power BI)
     - "45678:45678"  # Inter-node communication (Other Dremio nodes)
    networks:
      - www-overlay
      - ${PROJECT_SCOPE}
      - default
      #- perk-tunnel
    configs:
      - source: ${PROJECT_SCOPE}_dremio.conf
        target: /opt/dremio/conf/dremio.conf

volumes:
  dremio_data:
  dremio_conf:

configs:
  msz-dev_dremio.conf:
    external: true

networks:
  www-overlay:
    external: true
  msz-dev:
    external: true
  #perk-tunnel:
    #external: true

Our dremio.conf

paths: {
  # the local path for dremio to store data.
  local: ${DREMIO_HOME}"/data"
  # the distributed path Dremio data including job results, downloads, uploads, etc
  #dist: "hdfs://localhost:9000/path"
}
services: {
  coordinator.enabled: true,
  coordinator.master.enabled: true,
  executor.enabled: true,
  flight.enabled: true,
  flight.port: 32010,
  flight.use_session_service: true,
  flight.auth.mode: "legacy.arrow.flight.auth"
}

Edit: wget from the dremio container results in the same error (no route to host) but wget from the airbyte container works.

Edit2:
I have Java 8 and 11 installed but 11 is selected as active.

openjdk version "11.0.18" 2023-01-17
OpenJDK Runtime Environment (build 11.0.18+10-post-Ubuntu-0ubuntu122.04)
OpenJDK 64-Bit Server VM (build 11.0.18+10-post-Ubuntu-0ubuntu122.04, mixed mode, sharing)

Edit3: I only allocated 13 GB RAM to the vm but i read dremio uses 16 by default, this should not be the problem right?

2

As usual i fixed it myself.
I removed the networks, except ${PROJECT_SCOPE}, and now everything works.
Still unsure why this was a problem since on prod this configuration works but maybe thats a problem with local deployment

Can be closed