Hi, is there any plans to support Dremio catalog persistence distributed file systems like HDFS?
@balaji.ramaswamy Thanks for the reply, afaik RocksDB also supports HDFS storage, would be that ok if I try to create a PR supporting catalog hdfs storage?
Currently we do not support rocksDB on HDFS and not in the near future. Are you having troubling having your KV store in local or a NAS mount?
@balaji.ramaswamy Yep, I’m running Dremio on the cloud, and the containers are stateless(will be recreated completely after restart). There is no NAS mounts by security reasons, and I’m searching the way to sotre catalog without getting it dropped every restart