# Programatically Load Data

**URL:** <https://community.dremio.com/t/programatically-load-data/4619>\
**Category:** Uncategorized\
**Created:** [November 22, 2019, 3:48am UTC](https://community.dremio.com/t/programatically-load-data/4619 "2019-11-22T03:48:41Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![w13bit](https://avatars.discourse-cdn.com/v4/letter/w/6de8d8/32.png) [@w13bit](https://community.dremio.com/u/w13bit)\
**Post date:** [November 22, 2019, 3:48am UTC](https://community.dremio.com/t/programatically-load-data/4619/1 "2019-11-22T03:48:41Z")

</div>

Hi,

I’m trying to look for resources on how I can say load Dataset to Dremio via some sort of a feed that update regularly. How is this achieved? I can’t seem to find a way to write this. I have check the REST api – I saw I can create a DataSet using a catalog. But what will I use to add data to this?

Thanks for any pointers.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [November 22, 2019, 5:11pm UTC](https://community.dremio.com/t/programatically-load-data/4619/2 "2019-11-22T17:11:29Z")

</div>

@w13bit

Dremio is not an ETL tool or data generation product. You can use Dremio to query data on your lake like Hadoop/S3/ADLS/RDBMS/MongoDB etc. We can join across sources and create reflections to accelerate query execution speeds. We can also write back results of a query back to the lake as PARQUET files

Kindly let me know if you have any other questions

Thanks  
@balaji.ramaswamy

---

<div class="post-metadata">

**Author:** ![w13bit](https://avatars.discourse-cdn.com/v4/letter/w/6de8d8/32.png) [@w13bit](https://community.dremio.com/u/w13bit)\
**Post date:** [November 22, 2019, 5:53pm UTC](https://community.dremio.com/t/programatically-load-data/4619/3 "2019-11-22T17:53:49Z")

</div>

We have some files that is stored in some proprietary format and stored in a key/value store. Ideally I wanted this to be able to be queried by some sql ( these files contains report generated at x interval per day). I was hoping not to parse the files and load it to say a postgresqldb and have dremio access that. Is it possible if I have it transformed to csv and then have dremio read the csv files?