Data Source - Connecting to REST API

#1

Is there a way to setup a data source that pulls data directly from a REST call (e.g.: GET https://mydatasource.com/api/sales/orders)

#2

An option today is to create a script that would pull data from a REST call > store it in some type of filesystem > use Dremio’s REST API and create a physical dataset to that filesystem/file

#3

Thanks for the work-around Anthony.

Do you know where suggested enhancements can be submitted. I believe that having a REST URL as a data source (e.g.: with configurable headers) would make the product more versatile and valuable.

#4

Hi @anthony if i would like to write a custom plugin or connector to read data directly from REST API how could we do it? any guidelines or help would be highly appreciated.

1 Like
#5

Hi Ranjan this is not something you can do today.

#6

Hi Kelly thanks for your response! Is it something doable in near future few weeks to months time?

#7

If you’re into DIY, I would recommend looking at examples of other plugins:

Then consider some of the parameters that would be involved in implementing. Credentials, authentication, metadata mapping, etc.