Deleted All Active Coordinators, How Can I Reset?

Using FoundationDB
1

All of our coordinators were mistakenly deleted, is there a way to reset the coordinator quorum without losing any data? That is, we are unable to start any of the coordinators below, or new coordinators with the same IP addresses.

Could not communicate with a quorum of coordination servers:
  10.49.38.12:4500  (unreachable)
  10.49.38.21:4500  (unreachable)
  10.49.38.39:4500  (unreachable)
  10.49.38.52:4500  (unreachable)
  10.49.38.79:4500  (unreachable)
2

Referring to How to restore cluster after accidentally dropping coordinators

Is it correct to assume we’re kind of dead in the water in terms of recovering the existing data?

3

Currently, yes :frowning:

I created Recover from a cluster with no coordinated state · Issue #2022 · apple/foundationdb · GitHub to track this. I am pretty sure we can make this better in the future. But for now I think you need to recover from a backup if this happens.

4

Appreciate the response! We’ll move forward with a new plan :smiley:

1 Like