Access S3 Using ProfileAuth ( ~/.aws/Credentials) - Dremio throwing IllegalStateException

1

Hi,

I have a need to access the S3 using ProfileFile Credentials ( not Instance IAM , But based on Profile Files)

Is there anyway i can make this happen

I try to put in the Advanced propertes of S3 with the following

fs.s3a.aws.credentials.provider = com.amazonaws.auth.DefaultAWSCredentialsProviderChain

but the log shows the following

Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: com.amazonaws.auth.DefaultAWSCredentialsProviderChain

What does this mean ?

Version : Dremio 4.0.1
OS : Linux

Verified that .aws/credentials is correctly populated.

Regards
Sathish

2

@Sathish_Senathi

Is your S3 set this way?

https://docs.aws.amazon.com/sdk-for-php/v3/developer-guide/guide_credentials_profiles.html

Are you unable to add the access key and secret key directly to the S3 source?

Thanks
@balaji.ramaswamy

3

No, I don’t have those as the profile is refreshed by external process.

4

Yes , that is correct.

5

No I can’t as it has session token , the setup is the profile has accesskey , secret key and token usually valid for 1 hr and gets refreshed by some other process.

This is our test environment setup. I couldnt get other options