m/n/c/curator: maintain consistency between roles and etcd members

When updating the consensus role, both etcd membership and the role need
to be updated. It is possible that the etcd membership change is applied
but the role update fails, resulting in an inconsistency. This change
adds a background process which cleans up this inconsistency by updating
roles to match etcd membership.

This is partially based on previous work by Serge Bazanski, where this
background sync was performed in the opposite direction: etcd membership
is removed if the role is missing. Here, I instead update the role based
on etcd membership. This has the benefit that we finish partially
applied management operations, instead of fighting them.

Co-authored-by: Serge Bazanski <serge@monogon.tech>
Change-Id: I8871b068d1d20c65bcbea5289eafe54676906819
Reviewed-on: https://review.monogon.dev/c/monogon/+/3438
Tested-by: Jenkins CI
Reviewed-by: Serge Bazanski <serge@monogon.tech>
5 files changed
tree: f7332695f7546dd34ac043ac4ce4d6dcc6547dce
  1. .github/
  2. build/
  3. cloud/
  4. go/
  5. intellij/
  6. metropolis/
  7. osbase/
  8. third_party/
  9. tools/
  10. version/
  11. .bazelignore
  12. .bazelproject
  13. .bazelrc
  14. .bazelrc.ci
  15. .bazelrc.sandboxroot
  16. .bazelversion
  17. .git-ignore-revs
  18. .gitignore
  19. BUILD.bazel
  20. CODING_STANDARDS.md
  21. go.mod
  22. go.sum
  23. LICENSE
  24. MODULE.bazel
  25. MODULE.bazel.lock
  26. README.md
  27. SETUP.md
  28. shell.nix
  29. WORKSPACE
README.md

Monogon Monorepo

This is the main repository containing the source code for the Monogon Platform.

This is pre-release software - take a look, and check back later! In the meantime, join us on Matrix (#monogon-os-community:matrix.org) or Discord.

Environment

Our build environment is self-contained and requires only minimal host dependencies:

  • A Linux machine or VM.
  • Bazelisk >= v1.15.0 (or a working Nix environment).
  • A reasonably recent kernel with user namespaces enabled.
  • Working KVM with access to /dev/kvm (if you want to run tests).

Our docs assume that Bazelisk is available as bazel on your PATH.

Refer to SETUP.md for detailed instructions.

Monogon OS

The source code lives in //metropolis (Metropolis is the codename of Monogon OS).

See the //metropolis/README.md for a developer quick start guide, or see the Monogon OS Handbook for user documentation.