Cannot access Dremio samples after adding Minio for distributed storager

1

After adding a local minio server for distributed storage to store reflections (as per docs on dist-store-config), I can no longer access the Dremio Sample sources. This is inconvenient, because I use the Sample Data sources for some automated tests.

Any tip on how to address this?

java.nio.file.AccessDeniedException: s3a://samples.dremio.com/: 
listStatus on s3a://samples.dremio.com/: 
com.amazonaws.services.s3.model.AmazonS3Exception: 
Access Denied. (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 17DEB5683F42A4D9; S3 Extended Request ID: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8; Proxy: null), S3 Extended Request ID: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8:AccessDenied
2

You may have changed the S3 Endpoint globally via the fs.s3a.endpoint property to get MinIO working for the Distributed store. This property impacts any new S3 source you add in Dremio, including AWS S3 buckets (and therefore the Samples bucket). Luckily you can specify per source connection properties in Dremio. So to make this work - go to the Samples Source Settings → Advanced Options → Connection Properties, and add the fs.s3a.endpoint property and set it to s3.us-west-2.amazonaws.com

2 Likes
3

Yes, that did the trick. Thank you, appreciated!