Yarn Provisioning ClassNotFoundException: org.apache.hadoop.conf.Configuration

Dremio 3.1.11

The scenario:

  • Dremio is installed in single instance as master-coordinator
  • Hadoop cluster is EMR 5.24, 1 master, 2 core (64GB RAM each)
  • Tried Yarn provisioning from coordinator to EMR

Result:

  • Provisioning failed, with yarn resource manager returning exit code: 1
  • stderr on the first container attempt returning error:
    – > ClassNotFoundException: org.apache.hadoop.conf.Configuration

Any suggestion?