Crash before write
Can the workflow resume from a known checkpoint without skipping required context?
Failure · retry · resume · effect
After a crash or retry, can the workflow continue without repeating or losing a real effect?
BitEvo injects bounded failures into one representative agent workflow and shows what is lost, repeated, skipped, stale or unrecoverable — with staging/synthetic execution by default.
Failure matrix
Remove one assumption at a time.
The purpose is not random breakage. Each case challenges a specific assumption about state, authority, downstream effects or recovery.
Crash after write
Can it determine whether the downstream mutation already happened before retrying?
Ambiguous timeout
Does it read resulting state or blindly replay a consequential mutation?
Duplicate event
Does one logical event still create one external effect?
Stale resume
Does the workflow revalidate material state before continuing an old plan?
Tool / schema drift
Does unexpected structure fail visibly instead of silently mapping the wrong data?
Approval expiry
Can an old approval survive longer than the authority it was meant to grant?
Partial completion
Is unresolved partial state visible, attributable and recoverable by an operator?
What we measure
Effect correctness before a green run status.
DUPLICATESRepeated external effects
OMISSIONSSkipped or lost steps
STATECheckpoint and stale-state behavior
RECOVERYOperator path for ambiguity
EVIDENCECan the action be reconstructed?
Delivery
Failure evidence and a recovery decision.
Workflow state map, failure plan, test evidence, continuity/recovery matrix, duplicate-effect analysis and prioritized remediation.
Claim boundary
No reliability guarantee.
No production chaos without separate written authorization, no promise of uptime, and no claim that the tested cases cover every possible failure mode.
Start with one effect
Choose the action that would be expensive to repeat or lose.
Then define the crash, timeout, replay or partial-completion path worth testing.
Prepare the drill scope