There are situations where the HDFS namenode fails and the standby namenode takes over. Dremio is unable to switch to the other namenode. Is there a way to support this?
It’s technically possible but the way the Hadoop client works is you would have to add all the HDFS HA configuration in the source configuration as properties (you can find the list of keys in the Hadoop documentation at https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html#Configuration_details), as Dremio cannot query the server to discover the HA configuration. Possible but troublesome unfortunately…