Dremio Table Format as Parquet Dynamically

Dremio University
21

Hi @doron /@balaji.ramaswamy ,

Can you please confirm like to utilize the API futures, whether any API services to be started in Dremio server?

WR,
Sathish R

22

@sathhishcse Is your question if whether there are any API’s to start and stop Dremio?

23

Hi @balaji.ramaswamy ,

No Balaji, my query is like whether to avail API activities , any service to be started in Dremio server.When executed http:/localhost:9047/apiv2/catalog/ in browser, got 404 error.

{"errorMessage":"Something went wrong. Please check the log file for details, see https://docs.dremio.com/advanced-administration/log-files.html","moreInfo":"HTTP 404 Not Found"}

Kindly help to resolve this issue or we need to use Postman for API activities.

It will be great if we have a working session to resolve our requirement.

Thank you!

WR,
Sathish R

24

The catalog APIs are v3 - http:/localhost:9047/api/v3/catalog/. All services are started when Dremio starts.

25

Hi @doron ,

Sorry for the delayed response.

Thank you for your information. We have tried the http:/localhost:9047/api/v3/catalog/ but its showing the same error as mentioned above, so we tested with Login POST API using http://localhost:9047/apiv2/login & it resulted with status 200 “OK” which was expected and on http://localhost:9047/api/v3/login it resulted as 404 not found error.

We are using Dremio CE - v - 18.0.0-202109101536100970-a32fc9f4

Kindly feedback.

WR,
Sathish R

26

Are you using the login token you got from apiv2/login to call v3/catalog?

27

Hi @doron ,

Thank you for the Hint Doron, Now i can able to promote the folder as VDS.

Used apiv2 authorization in api/v3/catalog.

Thank you once again for your time and support.

On a separate note, I have raised another topic(https://community.dremio.com/t/metadata-refresh-every-minute-adls/8023/2) like on latest Dremio release 18v, there is an option to enable Metadata refresh for every minute . We have enabled it on our source ADLS but querying underlying folder is not getting updated on every minute but getting updated in hour interval. Currently we are managing by manual metadata refresh. We have seen the pod logs for any error but no error details found.

We implemented Dremio using Kubernetes… and need your suggestions as whether any configuration needed in helm file or need to updated helm file to avail this feature .

Kindly review and feedback.

Thank you Doron.

WR,
Sathish R