Migrate Dremio on aws to other account AWS

Dremio Cloud
1

Hi, Community!

I need to migrate my Dremio setup from one AWS account to another and would like to know the best way to approach this. Specifically, I’m looking for guidance on:

  1. How to transfer Dremio metadata between accounts.
  2. The best method to move S3 bucket data to the new account.
  3. Any tips for setting up the infrastructure and ensuring everything works smoothly in the new environment.

Has anyone done this before or have any recommendations? Your insights would be greatly appreciated!

2

@geronimomorais The only thing is as you told is the metadata, how many promoted pds do you have? If there are too many then there is a feature that I need to check if it is also included in Community edition

4

We are currently using Dremio BYOL version 24.1.3 from the AWS Marketplace and want to migrate to another AWS account. However, we encountered several issues:

  • Snapshots didn’t work.
  • Copying the db folder and running dremio-admin upgrade resulted in a KVStore version error.
  • Copying only the catalog folders from db led to this error when starting Dremio:
    Process user (dremio) doesn't match local catalog db owner (ec2-user). 
Please run process as ec2-user.
    Even though all folders are owned by the dremio user.

Since version 24.1.3 is no longer available on the AWS Marketplace (only 24.3.13 is), how do you suggest we proceed with the migration?