Running a query and its work files... where do they go?

1

Hi

I’ve run into something where my Dremio server has a 50GB volume.

I have a local path setup.

I also have a dist entry.

If I run a query, that does a join - how is the memory/spill handled in this, does it go the local path? Or does it go to the pdfs path?

I’m wondering if the root volume needs to be bigger. The logs aren’t giving too much away.

2

@spireite Currently Dremio only spills Aggregates and sorts and does not spill joins. The local 50 GB may contain files like cloud cache, rocksdb or even a hprof file

Are you able to send a recursive du -sh output for the folders and I can help find out what is using up all the space?