Cannot connect to minio

1

Following this: quick-guides-from-dremio/icebergminiodremio.md at main · developer-advocacy-dremio/quick-guides-from-dremio · GitHub

Got MinIO setup and running locally per the instructions.

Trying to setup minio as s3 source in Dremio I am getting “Could not connect to S3 source. Check your S3 data source settings and credentials.”

These are the instructions I’m following:

Setup Dremio Source

Get to Dremio dashboard then:

  • Create a New Source
  • Select S3
  • Put in the access and secret key from minio, uncheck the encrypted checkbox
  • head over to the advanced section and check off compatibility mode
  • in the connection settings in the advanced section add the follow properties
    • fs.s3a.path.style.access set to true
    • fs.s3a.endpoint set to the API address of your Minio server example 0.0.0.0:9000 (without http://)

Confirmed access to Minio via AWS CLI.

FYI: I changed the dremio “platform” in docker-compose.yml to linux/amd64 so it would run on my M1 MacBook. I also tried running on an AWS EC2 machine with the default linux/x86_64 platform and got the same failure, so the change of platform doesn’t appear to be the issue.

Thanks

2

Fixed issues with docker networking.

1 Like
3

@pdp
Hi I was stuck in with similar issue. I have tried different configuration of the docker networking and it is still not working. Could you tell how the docker-compose look like?

4

@chayasin-bdi

Are you trying to add MinIO as a source or configure as Dist storage? What error are you getting? Have you gone through the below pre-requisites?

Thanks
Bali