Storing dremio data using volumes


I am using the docker dremio image for some simple development work to prove out Dremio as a potential use case. It’s been working great so far, but I am now having some difficulty with how I can save the data/state of the container in a volume, so that if I stop & remove the container, I can just use the base image to start a new container, attach the volume and pick up where I left off. I’m aware that I can commit the container as a new image, but I want to see if the volume storage is possible as I would prefer it and am more used to it. Here is my Dockerfile:

FROM dremio/dremio-oss:4.5
COPY target/dremio-flight-connector-0.23.0-SNAPSHOT.jar /opt/dremio/jars/
ENTRYPOINT [“bin/dremio”, “start-fg”]

Here is my docker run command that I use:
docker run --name dremio -p 9047:9047
-p 31010:31010 -p 45678:45678
-v $pwd\dremio\conf:/opt/dremio/conf -v $pwd\dremio\data\pdfs:/opt/dremio/data/pdfs

I saw something in a different topic referring to using a mounted docker volume, but it also didn’t work.
Here is my docker-compose.yml file:

version: “3.8”
image: dremio/dremio-oss:4.5
- “9047:9047”
- “31010:31010”
- “45678:45678”
- ./dremio/conf:/opt/dremio/conf
- dremio-data:/opt/dremio/data


Here is the process I am trying to replicate:

  1. Start a normal container with an attached volume to my local laptop
  2. Create a Raw Reflection on a slow moving query
  3. Stop and remove container
  4. Spin up a new container and attach the volume to the same local path in Step 1

When I go to the source of where the reflection was created, it shows this:

This is all standalone. No distributed storage or anything like that.


Where was the reflection files in the first place stored, maybe they were lost when you removed the container?