Dremio - S3 bucket by access key and secrete key

1

Hello Legends,

I am exploring Dremio community edition with Tableau. I have got access, secrete key and bucket details from our upstream guys. Followed the existing doc I have added all necessary details. But when I try to navigate to s3 bucket inside folder, from UI it is showing "Something went wrong. Please check the log file for details, see https://docs.dremio.com/advanced-administration/log-files.html’. Further checking in logs below is the error. Please advice.
ERROR c.d.d.server.GenericExceptionMapper - Unexpected exception when processing GET http://:9047/apiv2/source/SWB_UAT/?nocache=1602658199459 : com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to .s3.amazonaws.com:80 [.s3.amazonaws.com/] failed: connect timed out
com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to .s3.amazonaws.com:80 [.s3.amazonaws.com/52.216.26.12] failed: connect timed out

2

@chpavans84

It seems like this is timeout on the S3 side,

The below has to go to all executors core-site.xml under /conf, if this is Yarn based deployment, then only add to coordinator, if this is a K8’s based deployment, just add it to configs/core-site.xml

Make sure that fs.s3a.connection.maximum is at least larger than fs.s3a.threads.max.

{code}

fs.s3a.threads.max
1000

fs.s3a.connection.maximum 5000 {code}

Kindly let us know if this helps

Thanks
Bali