I am struggling to understand why Dremio allocates so many threads to a query when the underlying dataset is so small. I believe there is diminishing returns to a higher thread count.
Hi @shawnhoo,
The number of threads allocated to a query take into account many variables. When you say you’re struggling to understand why Dremio allocates so many threads to a query, what variables did you take into account in regards to: the query itself, the CPU/RAM processing power available and the Dremio’s cluster size?
Thanks, Bogdan