Out-of-core HashAgg

1

It seems that at the moment HashAgg is implemented as in-memory only (https://github.com/dremio/dremio-oss/blob/7d3f9c66365f72a02e9ae3e412306c68cf015264/sabot/kernel/src/main/java/com/dremio/sabot/op/aggregate/hash/HashAggOperator.java).

It is inconvenient as I often hit OOM due to this restriction. Is there any workaround or any ongoing plan to make it out-or-core?

2

Yes, it’s on our radar. Workaround would be to increase the memory, but we are also looking at supporting spilling.