We had a 40 node cluster that expanded to 60 nodes. These additional 20 nodes
include 8 tlog (it’s all tlogs) nodes and 12 storage nodes.
During the expansion rebalance process(20% data transferred), the new 20 nodes were accidentally
lost during the rebalance process.
(processes were killed and the data directory was deleted).
Then restarting the cluster reports the “Locking coordination state.” and hangs.
In this case:
- is there any way to start the cluster? Data lost is acceptable.
- is there any way to dump the data from the originial remaining 40 nodes?
For example, read data from sqlite directly, and we can fix the <key, value> data and load into an new FDB cluster.