# Dremio 14.0.0 fails to detect file in S3 when subfolders start with underscore "\_"

**URL:** <https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063>\
**Category:** Uncategorized\
**Created:** [March 4, 2021, 12:52pm UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063 "2021-03-04T12:52:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![triduong.tran](https://avatars.discourse-cdn.com/v4/letter/t/7993a0/32.png) [@triduong.tran](https://community.dremio.com/u/triduong.tran)\
**Post date:** [March 4, 2021, 12:52pm UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063/1 "2021-03-04T12:52:11Z")

</div>

I have an S3 bucket which uses hive partitioning key naming schema where partitioning prefixes all start with an underscore in order to avoid clashes with actual data columns.

Given this example:

- I have files within the same bucket “my-bucket”:

- When I now navigate to the `s3://my-bucket` and promote `data-source` to a physical dataset Dremio gives me an error:

> No files were found.

With 13.1.0 it worked but after upgrading to 14.0.0 it stopped working.

In the [release notes for version 3.0](https://docs.dremio.com/release-notes/30-release-notes.html#fixed-issues-3) I discovered a fixed issue which says:

> _**Format previews did not work when a directory has ‘hidden’ files (files starting with an underscore in the file name).**_  
> Resolved by ignoring period and underscores in files when performing format previews.

Do you think these might be related?  
Does anybody else face the same problem and/or know a solution to this problem?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 5, 2021, 7:42am UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063/2 "2021-03-05T07:42:49Z")

</div>

@triduong.tran

That is right, Dremio currently ignores files and.folders starting with an underscore

Thanks  
Bali

---

<div class="post-metadata">

**Author:** ![triduong.tran](https://avatars.discourse-cdn.com/v4/letter/t/7993a0/32.png) [@triduong.tran](https://community.dremio.com/u/triduong.tran)\
**Post date:** [March 6, 2021, 6:06pm UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063/3 "2021-03-06T18:06:40Z")

</div>

@balaji.ramaswamy I’m still confused as the patch note states that only filenames starting with an underscore are ignored but not prefixes/folders on s3 like shown in the example. To me this behaviour is unexpected and should be fixed as the filenames do not have underscores as a starting character.

---

<div class="post-metadata">

**Author:** ![triduong.tran](https://avatars.discourse-cdn.com/v4/letter/t/7993a0/32.png) [@triduong.tran](https://community.dremio.com/u/triduong.tran)\
**Post date:** [March 12, 2021, 9:56am UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063/4 "2021-03-12T09:56:27Z")

</div>

@balaji.ramaswamy would you mind elaborating your view on this?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 17, 2021, 6:19am UTC](https://community.dremio.com/t/dremio-14-0-0-fails-to-detect-file-in-s3-when-subfolders-start-with-underscore/7063/5 "2021-03-17T06:19:13Z")

</div>

@triduong.tran

Let me check on this internally and get back to you