[Stuck Nodes] Rollback Tool

[jessicadaugherty]

Objective

Currently service and validator nodes can get stuck due to bad data which can result in further stuck nodes or even chain halts. The current recovery process is time consuming so nodes need an easier way to recover all or part of a database to a previous state.

Origin Document

Stuck Nodes Planning

Goal

• Allow nodes to rollback to a previous state without completely replacing data directories manually

Deliverable

• Create a command that enables nodes to rollback to a specific height
  • Limit the # of block heights a node can rollback to
• Update CLI docs

Non-goals / Non-deliverables

• Making nodes self-healing

General issue deliverables

• Update the appropriate CHANGELOG
• Update any relevant READMEs (local and/or global)
• Update any relevant global documentation & references
• If applicable, update the source code tree explanation
• If applicable, add or update a state, sequence or flowchart diagram using mermaid

---

Creator: @jessicadaugherty

[jessicadaugherty]

Not playing nicely with codebase ATM. Refactoring for a future release and moving to backlog.