# Connect S3 as a data source

**URL:** <https://community.dremio.com/t/connect-s3-as-a-data-source/10682>\
**Category:** Dremio Cloud\
**Created:** [June 2, 2023, 8:44am UTC](https://community.dremio.com/t/connect-s3-as-a-data-source/10682 "2023-06-02T08:44:22Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kom\_al](https://avatars.discourse-cdn.com/v4/letter/k/838e76/32.png) [@Kom\_al](https://community.dremio.com/u/Kom_al)\
**Post date:** [June 2, 2023, 8:44am UTC](https://community.dremio.com/t/connect-s3-as-a-data-source/10682/1 "2023-06-02T08:44:22Z")

</div>

Hi,  
How can we connect S3 as a data source in dremio cloud and access all the files that are present over bucket. And what are the prerequistics authentication we need to connect S3?

---

<div class="post-metadata">

**Author:** ![Payal\_Gupta](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/payal_gupta/32/4262_2.png) [@Payal\_Gupta](https://community.dremio.com/u/Payal_Gupta)\
**Post date:** [June 2, 2023, 11:46am UTC](https://community.dremio.com/t/connect-s3-as-a-data-source/10682/2 "2023-06-02T11:46:02Z")

</div>

Hi @Kom_al

Please refer to this documentation for step by step guidelines on how to connect Amazon S3 as a datasource in Dremio Cloud - [Dremio](https://docs.dremio.com/cloud/sources/amazon-s3/)

Let me know if you face any issues. Would be happy to help.

Thanks,  
Payal  
Dremio

---

<div class="post-metadata">

**Author:** ![Kom\_al](https://avatars.discourse-cdn.com/v4/letter/k/838e76/32.png) [@Kom\_al](https://community.dremio.com/u/Kom_al)\
**Post date:** [June 21, 2023, 4:02am UTC](https://community.dremio.com/t/connect-s3-as-a-data-source/10682/3 "2023-06-21T04:02:10Z")

</div>

Hi @Payal_Gupta , Thanks for the help.  
One more thing ,basically I have my AWS free tier account so I have limited resources like 2000 request for s3 storage etc. So, When I was connecting to S3 with dremio, I hardly hit 10-15 request or run the query on S3 storage files, but my request limit exceeded. How?

---

<div class="post-metadata">

**Author:** ![Payal\_Gupta](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/payal_gupta/32/4262_2.png) [@Payal\_Gupta](https://community.dremio.com/u/Payal_Gupta)\
**Post date:** [June 21, 2023, 12:39pm UTC](https://community.dremio.com/t/connect-s3-as-a-data-source/10682/4 "2023-06-21T12:39:55Z")

</div>

Hi @Kom_al ,

Dremio Cloud uses S3 bucket as a project store also with read/write permissions (other than the data source) which contains all project-specific data, such as metadata, reflections, and file uploads to the homespace [1].

Hence, to calculate the total requests made to S3 from Dremio Cloud, you would have to check the S3 data source + project store S3 bucket.

Further, since this request limit is for the complete S3 storage account, I would suggest you to check the AWS usage report for Amazon S3 in order to understand and check what action/resource caused the limit to exceed [2].

Ref [1] : [Dremio](https://docs.dremio.com/cloud/getting-started/prerequisites/#prerequisites)  
Ref [2] : [AWS usage report for Amazon S3 - Amazon Simple Storage Service](https://docs.aws.amazon.com/AmazonS3/latest/userguide/aws-usage-report.html)

Hope it helps.

Best,  
Payal