# java.nio.file.AccessDeniedException: s3a://iris/

**URL:** <https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896>\
**Category:** Uncategorized\
**Created:** [March 24, 2025, 2:50pm UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896 "2025-03-24T14:50:09Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [March 24, 2025, 2:50pm UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/1 "2025-03-24T14:50:09Z")

</div>

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/d/d4f50d79efcc78a12e17d8f4c52449b81c4a6e78.png)  
I added a hive data source and configured the hive metastore. The data of this hive is stored on s3. What other configurations do I need to add to create tables and perform queries in dremio? The current error is as follows: java.nio.file.AccessDeniedException: s3a://iris/: org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials provided by TemporaryAWSCredentialsProvider SimpleAWSCredentialsProvider EnvironmentVariableCredentialsProvider IAMInstanceCredentialsProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from environment variables (AWS\_ACCESS\_KEY\_ID (or AWS\_ACCESS\_KEY) and AWS\_SECRET\_KEY (or AWS\_SECRET\_ACCESS\_KEY))

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 26, 2025, 5:13am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/2 "2025-03-26T05:13:49Z")

</div>

@fuliu Where have you declared the access\_key, secret\_key variables as the error says it is not able to load these variables

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [March 26, 2025, 6:10am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/3 "2025-03-26T06:10:29Z")

</div>

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/a/acda97e07f1a3b1548855709705dc56811a061c1.png)Is it added in Credentials?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 28, 2025, 5:18am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/4 "2025-03-28T05:18:23Z")

</div>

@fuliu See general tab

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [March 28, 2025, 8:05am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/5 "2025-03-28T08:05:12Z")

</div>

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/7/77235a4b0b338b3104091fb7c9cbebee4d695608.png)  
only hive metastore uri in general tab

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [April 3, 2025, 5:10am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/6 "2025-04-03T05:10:45Z")

</div>

@fuliu My bad, you are having Hive external tables where the PARQUET files are on S3 and the S3 bucket has access and secret key, yes then it should go via advanced option, but it should get the same name as defined in core-site.xml or you can copy core-site.xml, see doc below

> **[Hive | Dremio Documentation](https://docs.dremio.com/current/sonar/data-sources/metastores/hive/)**
>
> This topic describes Hive data source considerations and Dremio configuration.

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [April 4, 2025, 2:04pm UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/7 "2025-04-04T14:04:38Z")

</div>

> [@balaji.ramaswamy](#):
>
> My bad, you are having Hive external tables where the PARQUET files are on S3 and the S3 bucket has access and secret key, yes then it should go via advanced option, but it should get the same name as defined in core-site.xml or you can copy core-site.xml, see doc below

 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/9/9622065542b36911f52495e0124580b556d68126.jpeg)  
When I start the source code through idea, the hive data source is not scanned, so I cannot see the hive data source on the UI. Can you guide me on how to configure it?

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [April 7, 2025, 3:14am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/8 "2025-04-07T03:14:30Z")

</div>

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/a/a338cb5485fdd72125b5218f85467f60a10d6d39.png)  
Is this right?After I configured it like this, I still got the same error

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [April 16, 2025, 7:27pm UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/9 "2025-04-16T19:27:22Z")

</div>

@fuliu Have you validared that the core-site.xml has the correct parameter name and value for the access key and secret key? Can you try passing the settings through the advanced option tab under the Hive source in Dremio. I assume you are able to query this table via Hive shell?

Basically Dremio needs permission to read the file on S3

Some of the parameters here should be in your core-site.xml or if the core-site.xml has conflicting values for the same parameter names then add to source advanced option

> **[Configuring Distributed Storage | Dremio Documentation](https://docs.dremio.com/24.3.x/get-started/cluster-deployments/customizing-configuration/dremio-conf/dist-store-config/#amazon-s3)**
>
> This topic specifies how to configure Dremio for distributed storage.

---

<div class="post-metadata">

**Author:** ![nickb](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/nickb/32/6393_2.png) [@nickb](https://community.dremio.com/u/nickb)\
**Post date:** [April 17, 2025, 9:23am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/10 "2025-04-17T09:23:54Z")

</div>

@fuliu you need to define the parameters as they would be configured in the core-site.xml, ie:

 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/f/fd6ea0a608286ed08dcf655fe667953469ca013e.png)

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [April 18, 2025, 5:01am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/11 "2025-04-18T05:01:40Z")

</div>

After I added these parameters, the data in csv format can be queried, but other formats, such as parquet, json, and iceberg, fail to query  
[ae94bd7b-f159-4de0-ac58-c0899d0d4306.zip](https://community.dremio.com/uploads/short-url/hkOVwVVRZYr7CUKLxnjY4cyYZ3Z.zip) (20.1 KB)  
[59ab728c-e4fb-43bb-a869-5a294bd720bb.zip](https://community.dremio.com/uploads/short-url/n5W2HgQpQdAhiAhSwoxJB5rG8L0.zip) (16.9 KB)

 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/0/0f119b62763483b4d29dcc3d6285126e4512108a.png)  
 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/d/d3ab0bc5eb2cc24fadf70259c0ceae7581134cca.png)

---

<div class="post-metadata">

**Author:** ![fuliu](https://avatars.discourse-cdn.com/v4/letter/f/41988e/32.png) [@fuliu](https://community.dremio.com/u/fuliu)\
**Post date:** [April 18, 2025, 5:51am UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/12 "2025-04-18T05:51:22Z")

</div>

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/7/70f2d25ff4778675ec1e36404ee2aa42c7bb3085.png)  
I add the property dremio.s3.compat it also query error.This is my configs

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [April 18, 2025, 5:36pm UTC](https://community.dremio.com/t/java-nio-file-accessdeniedexception-s3a-iris/12896/13 "2025-04-18T17:36:23Z")

</div>

@fuliu Can you see if you this thread helps?

> <https://stackoverflow.com/questions/34582318/how-can-i-resolve-the-error-the-security-token-included-in-the-request-is-inval>
