AWS CredentialsProvider Missing

derrickburns · June 25, 2020, 1:35am

On this line:

dremio/dremio-oss/blob/master/plugins/s3/src/main/java/com/dremio/plugins/s3/store/S3FileSystem.java#L402


    case ACCESS_KEY_PROVIDER:
      return StaticCredentialsProvider.create(AwsBasicCredentials.create(
        config.get(Constants.ACCESS_KEY), config.get(Constants.SECRET_KEY)));
    case EC2_METADATA_PROVIDER:
      return InstanceProfileCredentialsProvider.create();
    case NONE_PROVIDER:
      return AnonymousCredentialsProvider.create();
    case ASSUME_ROLE_PROVIDER:
      return new STSCredentialProviderV2(config);
    default:
      throw new IllegalStateException(config.get(Constants.AWS_CREDENTIALS_PROVIDER));
  }
}

private class BucketCreator extends ContainerCreator {
  private final Configuration parentConf;
  private final String bucketName;

  BucketCreator(Configuration parentConf, String bucketName) {
    super();
    this.parentConf = parentConf;

the plugin fails if it does not recognize the CredentialsProvider. Instead, it should use the DefaultCredentialsProvider. This will allow dremio to use credentials provided via Kubernetes service accounts.

Topic		Replies	Views
Access S3 Using ProfileAuth ( ~/.aws/Credentials) - Dremio throwing IllegalStateException	4	1212	November 6, 2019
Connecting S3 bucket via ec2 metadata	3	1633	March 27, 2021
Configuring S3 as distributed cache	2	2846	July 28, 2017
Connecting Dremio to an S3 bucket	2	1486	April 10, 2020
AWS S3 access using EC2 role instead of Access Keys	15	2785	July 2, 2021

AWS CredentialsProvider Missing

Related topics