Migrate virtual datasets between environments

1

Hello,

We have two separate Dremio clusters for development and beta and would like to create a CI pipeline that copies the virtual datasets definitions from Dev to Beta every week programmatically. Can you suggest a ‘best practice’ for doing that? Thank you.

2

There isn’t a fully automatic programmatic way of doing that today, but using our REST API can make this more seamless - https://docs.dremio.com/rest-api/catalog/endpoints.html

3

This may be helpful as well: Dremio Cluster Cloner

1 Like
4

I wish I have seen it sooner. I end up writing the same thing…