# Create a data set from a subset of parquet files

**URL:** <https://community.dremio.com/t/create-a-data-set-from-a-subset-of-parquet-files/8143>\
**Category:** Uncategorized\
**Created:** [October 14, 2021, 8:55pm UTC](https://community.dremio.com/t/create-a-data-set-from-a-subset-of-parquet-files/8143 "2021-10-14T20:55:36Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jdlong](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/jdlong/32/3159_2.png) [@jdlong](https://community.dremio.com/u/jdlong)\
**Post date:** [October 14, 2021, 8:55pm UTC](https://community.dremio.com/t/create-a-data-set-from-a-subset-of-parquet-files/8143/1 "2021-10-14T20:55:36Z")

</div>

I can see how I would create datasets from a single file. I can also see how to create a dataset from all files in a directory. Both of those are covered in the [UI docs here](https://docs.dremio.com/data-sources/files-and-directories/). And I see that I can do both of those from the API as documented [here](http://docs.dremio.com/rest-api/catalog/container-source-config/#amazon-s3).

what I want to do is slightly different. I want to use the API to create a dataset from 100 files from an S3 bucket with 100,000 files in it. I don’t want Dremio to scan the whole S3 bucket because that will take FOREVER because of how many files are in there. But I have the file names and I’d like to tell Dremio, “hey, make a single dataset from these files. Here are the names…”

Is that what the `propertyList` parameter is for? I can’t find any documentation or examples around what key value pairs one can shove into `propertyList` or why. Or is there a complete different method?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [October 19, 2021, 6:14am UTC](https://community.dremio.com/t/create-a-data-set-from-a-subset-of-parquet-files/8143/2 "2021-10-19T06:14:53Z")

</div>

@jdlong Currently there is no way you can do a partial promotion, not a great workaround would be to move the 100 files to a subfolder and promote that