During the execution of a query on Dremio, I’ve noticed that Dremio was using just 2GB of RAM from my executor node. After checking the dremio-config documentation, I opened the Dremio-env and this is my configuration:
DREMIO_MAX_HEAP_MEMORY_SIZE_MB=4096
DREMIO_MAX_DIRECT_MEMORY_SIZE_MB=16384
My current executor node is a c5.2xlarge (quad-core, 16GB of RAM), while my coordinator is a c5.2xlarge. Does anybody have some ideia what might be going on here?
Thank you in advance