Can Dremio connect to EMC ECS Object storage?

1

I am trying to get Dremio to connect to EMC ECS. I have added fs.s3a.endpoint to the Properties but I am unable to connect. When I go to save, I get Failed to create workspaces for buckets owned by the account.

Thanks

1 Like
2

I do not believe Dremio looks at fs.s3a.endpoint property to connect to it directly. Essentially it figures out what buckets are accessible based on the credentials specified. But good idea for enhancement.

3

Hi Team,

Can you please confirm if we can connect to EMC ECS S3 with Dremio. Tried connecting using Amazon S3 source but it fails with ‘ConnectTimeoutException’ : “Connect to s3.amazonaws.com:80 [s3.amazonaws.com/54.231.72.186] failed: connect timed out”.
It tries to connect to ‘s3.amazonaws.com:80’ despite of mapping fs.s3a.endpoint property. Please confirm how to connect to ECS S3 using dremio?

Thanks.

4

@Monika_Goel Hey Monika, this is currently not supported. We will be sure to post here when it is.

5

Hi @Can @yufeldman

Can’t we use Amazon S3 source(https://docs.dremio.com/data-sources/s3.html) to connect with ECS S3. As ECS S3 uses AWS S3 behind the scenes?

6

Hey @Monika_Goel, this is not supported. Appreciate your feedback.

7

Hi - is there any update for support for EMC ECS @can

8

Dremio can now connect to EMC ECS and other S3 compatible products: https://docs.dremio.com/data-sources/s3.html#connecting-to-an-s3-compatible-product