I created a backup of the state of dremio instance (contains 35+ VDS, spaces & views combined) and stored the backup in my local system as well as /tmp/backups directory.
However, when trying to restore the backup to a new instance with the same version it returns the following error, the same for the old one as well. Is there a way to get to the previous state with all the data?
Tail of output log
09:55:36.379 [main] INFO com.dremio.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider
09:55:36.456 [main] DEBUG com.dremio.datastore.ByteStoreManager - WAL settings: size: '0 MB', TTL: '300' seconds
09:55:38.378 [main] DEBUG com.dremio.datastore.utility.StoreLoader - Loaded the following StoreCreationFunctions: [class com.dremio.exec.server.options.SystemOptionManager$OptionStoreCreator, class com.dremio.service.namespace.NamespaceServiceImpl$PartitionChunkCreator, class com.dremio.exec.server.options.SystemOptionManager$LegacyProtoOptionStoreCreator, class com.dremio.service.jobtelemetry.server.store.LocalProfileStore$KVProfileStoreCreator, class com.dremio.service.nessie.NessieRefNamesStoreBuilder, class com.dremio.service.nessie.NessieKeyListStoreBuilder, class com.dremio.service.users.SimpleUserService$UserGroupStoreBuilder, class com.dremio.service.nessie.NessieRepoDescriptionStoreBuilder, class com.dremio.service.namespace.NamespaceServiceImpl$NamespaceStoreCreator, class com.dremio.service.reflection.store.MaterializationStore$MaterializationStoreCreator, class com.dremio.service.reflection.store.MaterializationStore$RefreshStoreCreator, class com.dremio.dac.service.datasets.DatasetVersionMutator$VersionStoreCreator, class com.dremio.service.nessie.upgrade.version040.NessieCommitKVStoreBuilder, class com.dremio.service.jobs.LocalJobsService$JobsStoreCreator, class com.dremio.service.namespace.NamespaceServiceImpl$MultiSplitStoreCreator, class com.dremio.service.tokens.TokenStoreCreator, class com.dremio.service.nessie.upgrade.version040.NessieRefKVStoreBuilder, class com.dremio.service.reflection.store.ReflectionEntriesStore$StoreCreator, class com.dremio.service.reflection.store.DependenciesStore$StoreCreator, class com.dremio.service.nessie.NessieRefLogStoreBuilder, class com.dremio.service.reflection.store.ExternalReflectionStore$StoreCreator, class com.dremio.service.reflection.store.RefreshRequestsStore$StoreCreator, class com.dremio.service.reflection.store.ReflectionSettingsStore$StoreCreator, class com.dremio.dac.support.BasicSupportService$OldSupportStoreCreator, class com.dremio.dac.support.UpgradeStore$UpgradeTaskStoreCreator, class com.dremio.dac.service.collaboration.CollaborationTagStore$CollaborationTagsStoreCreator, class com.dremio.exec.server.options.SystemOptionManager$LegacyJacksonOptionStoreCreator, class com.dremio.service.statistics.store.StatisticEntriesStore$StoreCreator, class com.dremio.service.script.ScriptStoreImpl$StoreCreator, class com.dremio.service.statistics.store.StatisticStore$StoreCreator, class com.dremio.provision.service.ProvisioningServiceImpl$ProvisioningStoreCreator, class com.dremio.dac.service.collaboration.CollaborationWikiStore$CollaborationWikiStoreStoreCreator, class com.dremio.service.nessie.NessieCommitLogStoreBuilder, class com.dremio.service.nessie.NessieNamedRefHeadsStoreBuilder, class com.dremio.service.orphanage.OrphanageImpl$OrphanStoreCreator, class com.dremio.service.nessie.NessieGlobalLogStoreBuilder, class com.dremio.service.reflection.store.ReflectionGoalsStore$StoreCreator, class com.dremio.service.nessie.NessieGlobalPointerStoreBuilder, class com.dremio.service.userpreferences.UserPreferenceStoreImpl$StoreCreator, class com.dremio.services.configuration.ConfigurationStore$ConfigurationStoreCreator, class com.dremio.exec.catalog.CatalogSourceDataCreator, class com.dremio.service.jobs.ExtraJobInfoStoreCreator].
09:55:38.379 [main] INFO com.dremio.datastore.adapter.LegacyKVStoreProviderAdapter - Starting LegacyKVStoreProviderAdapter.
09:55:38.379 [main] INFO com.dremio.datastore.LocalKVStoreProvider - LocalKVStoreProvider is up
09:55:38.597 [main] DEBUG org.apache.hadoop.io.nativeio.NativeIO - Initialized cache for IDs to User/Group mapping with a cache timeout of 14400 seconds.
09:55:38.694 [main] INFO com.dremio.datastore.LocalKVStoreProvider - Stopping LocalKVStoreProvider
09:55:38.741 [main] INFO com.dremio.datastore.LocalKVStoreProvider - Stopped LocalKVStoreProvider
09:55:38.742 [main] INFO admin - Restore failed. Please make sure the backup is compatible with this version.
java.io.IOException: Missing metadata file for table nessie_reference_names
at com.dremio.dac.util.BackupRestoreUtil.scanBackupFiles(BackupRestoreUtil.java:305)
at com.dremio.dac.util.BackupRestoreUtil.restore(BackupRestoreUtil.java:544)
at com.dremio.dac.cmd.Restore.main(Restore.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.dremio.dac.cmd.AdminCommandRunner.runCommand(AdminCommandRunner.java:91)
at com.dremio.dac.cmd.AdminCommandRunner.main(AdminCommandRunner.java:75)
09:55:38.748 [shutdown-hook-0] DEBUG org.apache.hadoop.fs.FileSystem - FileSystem.close() by method: org.apache.hadoop.fs.FilterFileSystem.close(FilterFileSystem.java:529)); Key: (dremio (auth:SIMPLE))@file://; URI: file:///; Object Identity Hash: d6e55ba
09:55:38.749 [shutdown-hook-0] DEBUG org.apache.hadoop.fs.FileSystem - FileSystem.close() by method: org.apache.hadoop.fs.RawLocalFileSystem.close(RawLocalFileSystem.java:759)); Key: null; URI: file:///; Object Identity Hash: 3a9aa67
09:55:38.751 [Thread-3] DEBUG org.apache.hadoop.util.ShutdownHookManager - Completed shutdown in 0.006 seconds; Timeouts: 0
09:55:38.782 [Thread-3] DEBUG org.apache.hadoop.util.ShutdownHookManager - ShutdownHookManager completed shutdown.