A question about Dremio engines

1

Dears,

We setup dremio v24.3.4(hadoop/yarn) and config 1 worker node which is 8CPU & 32GB. At first, the worker node’s hostname is xxx09a and the worker start time is 2025-11-15 10:00:00;

But yesterday, I found the worker node’s hostname is changed, the new hostname is xxx011a. And the worker start time is still 2025-11-15 10:00:00;

My question is: why the hostname changed without changing starting time?

Best Regards

2

@Junwei When using Yarn deployment, you only specify number of workers, cores per worker and memory per worker. Yarn Resource manager will then spin up Dremio containers on Hadoop data nodes. If you restart the Applicatiom which is Dremio via the Dremio UI, the containers will be shutdown and the files removed. When starting up again, resource manager may spin up the containers on different data nodes and that is why you may see different hostnames

Thanks

Bali

3

Thanks. But I didn’t restart the workers. Does dremio will restart worker auto by itself?

Best Regards,

Junwei

4

Check the Yarn ResourceManager history server, every time a Dremio-Yarn engine start, Yarn create an application with the same name as your Dremio-Yarn engine name. So just check the Yarn history server; you could also check the log of the engine/application too.

For me, it’s at ResourceManagerHost:8088

5

Yes, workers usually restart automatically. Check once it would have resrtarted.