FDB cluster with Kubernetes StatefulSet

[mbuleandra (Marius)]

Unfortunately there is a very important scenario that is currently not supported by the FDB Operator: Failing and recovering all coordinators.

Failure / Recovery scenario

We want to support a scenario where all Kube nodes are brought down and then restarted. We are testing this by deleting all the pods and then having the fdb-operator re-create them. Unfortunately, the cluster never recovers, and we get this error in the fdb-operator logs. It seems like the ConfigMap shows an empty string in “cluster-file”. I assume that the fdb-operator cannot reach out the cluster coordinators (since those ip’s don’t exist anymore) and it gets stuck in a fail loop. 2020-10-…