Access S3 Using ProfileAuth ( ~/.aws/Credentials) - Dremio throwing IllegalStateException


I have a need to access the S3 using ProfileFile Credentials ( not Instance IAM , But based on Profile Files)

Is there anyway i can make this happen

I try to put in the Advanced propertes of S3 with the following = com.amazonaws.auth.DefaultAWSCredentialsProviderChain

but the log shows the following

Caused by: java.lang.IllegalStateException: com.amazonaws.auth.DefaultAWSCredentialsProviderChain

What does this mean ?

Version : Dremio 4.0.1
OS : Linux

Verified that .aws/credentials is correctly populated.



Is your S3 set this way?

Are you unable to add the access key and secret key directly to the S3 source?


No, I don’t have those as the profile is refreshed by external process.

Yes , that is correct.

No I can’t as it has session token , the setup is the profile has accesskey , secret key and token usually valid for 1 hr and gets refreshed by some other process.

This is our test environment setup. I couldnt get other options