Dremio + Nessie + Minio - Status Code: 403; Error Code: SignatureDoesNotMatch

I have docket compose stack with Dremio, Nessie and Minio. Nessie + Minio working from Apache Spark. But when I tried connect Dremio to Nessie I catch exception - SignatureDoesNotMatch

Nessie Configuration

  catalog:
    image: ghcr.io/projectnessie/nessie:0.101.3
    container_name: catalog
    ports:
      - "19120:19120"
      - "9002:9000"
    environment:
      nessie.server.authentication.enabled: false
      nessie.catalog.warehouses.dev_lakehouse.location: s3://dev-lakehouse
      nessie.catalog.default-warehouse: dev_lakehouse
      nessie.catalog.service.s3.default-options.endpoint: http://minio:9000
      nessie.catalog.service.s3.region: cy-lim-1
      nessie.catalog.service.s3.path-style-access: true
      nessie.catalog.service.s3.access-key.name: KQHSCVpf50wkoAX92LJe
      nessie.catalog.service.s3.access-key.secret: ilQV5yGabLCkUyEFH7NntV2mBOoPzrtl9lXsig9i
      NESSIE_VERSION_STORE_TYPE: ROCKSDB
      NESSIE_VERSION_STORE_PERSIST_ROCKS_DATABASE-PATH: /data/nessie
    volumes:
      - ./data/nessie:/data/nessie
    deploy:
      resources:
        limits:
          cpus: '0.50'
          memory: 512M
        reservations:
          cpus: '0.25'
          memory: 256M
    depends_on:
      - minio
    networks:
      - icebergnet

Minio Configuration

  minio:
    image: minio/minio
    container_name: minio
    command: server /data --console-address ":9001"
    ports:
      - "9000:9000"
      - "9001:9001"
    environment:
      MINIO_ROOT_USER: minio
      MINIO_ROOT_PASSWORD: p@ssw0rd
      MINIO_DEFAULT_BUCKETS: test
      MINIO_REGION: cy-lim-1
      MINIO_REGION_NAME: cy-lim-1
    volumes:
      - type: bind
        source: /Volumes/MinIOData
        target: /data
    deploy:
      resources:
        limits:
          cpus: '0.50'
          memory: 512M
        reservations:
          cpus: '0.25'
          memory: 256M
    networks:
      - icebergnet

Dremio Configuration

  dremio:
    image: dremio/dremio-oss:25.2
    container_name: dremio
    ports:  
      - 9047:9047 
      - 31010:31010 
      - 45678:45678
    volumes:
      - dremio:/opt/dremio/data
    deploy:
      restart_policy:
        condition: on-failure
        delay: 5s
        max_attempts: 3
        window: 120s
    networks:
      - icebergnet

Connection Settings

It’s problem with custom region. I remove this property from Minio and after that all ok

1 Like