Zookeepers started failing suddenly in k8s

1

This is the error we are seeing: I already tried deleting and creating manifest in k8s but still not resolved.
ERROR [main:QuorumPeer@648] - Unable to load database on disk
java.io.EOFException

Anyone else having this issue?

2

@Shirisha Not seen this error in Dremio, wondering if there is some kind of permission issue writing to the configured paths?

3

We were able to fix this issue by performing a delete on the trouble Zk by running: rm -rf /var/lib/zookeeper/version-2/ but was wondering what could have caused this behavior in the first place.