Is distributed storage required?

1

Questions:

  1. Is distributed storage required (e.g. MinIO) for a small testing on-premise cluster?
  2. Is a PV/PVC (Persistent Volume (Claim) sufficient?
  3. Is it possible to disable distributed storage?

Documentation:
" The distributed storage cache location contains accelerator, tables, job results, downloads, upload data, and scratch data.

The location is specified with the paths.dist property in the dremio.conf file. In addition, this property must be the same across all nodes in the cluster. This means that if local storage or NAS is used, the configured path must exist on, or be accessible from, all nodes. If the value of this property is changed, then it must be updated in the dremio.conf file on all nodes in the Dremio cluster. By default Dremio uses the disk space on local Dremio nodes."

Error: “The ‘local’ distStorage type is no longer supported in Dremio 21.0.0 or later.”
(“Do I need a different type than ‘local’ for distributed storage?”)

2

@Odrai Dist is mandatory, you can use a NAS mont and use file:///

1 Like