Multiple attempts to build reflection failed

For the last few days, our server has gone down and when I restart it and drill down to the VDS reflections they all have red stop signs and the message ‘Multiple attempts to build reflection failed, will not reattempt.’. Yesterday I followed these instructions https://community.dremio.com/t/error-too-many-open-files/2003 but apparently they didn’t work because we have the same problem again today.

Has anyone else had this issue?

Hi @summersmd

Were all the failures due to max open files? Can we have some profiles of failed jobs?

Thanks
@balaji.ramaswamy

All of the failures were due to max open files. How do I produce profiles of failed jobs?

@summersmd

What did you increase your max open files to? Have you configured systemctl? There is a bug in Linux that when ulimit change does not take effect if service is configured via systemctl

Bug: https://bugzilla.redhat.com/show_bug.cgi?id=1364332
https://bugzilla.redhat.com/show_bug.cgi?id=754285

Thanks
@balaji.ramaswamy