What you will learn
- Triage and containment
- Trading state reconciliation
- Root-cause analysis
- Remediation verification
Triage and containment
Triage identifies the affected systems, current exposure and evidence needed. Containment limits further harm while preserving the ability to reconcile. An immediate compensating trade without state knowledge can make an incident worse.
Trading state reconciliation
Trading-state reconciliation compares positions, working orders and executions with the authoritative account record. Local logs may be incomplete after a failure. Preserve disagreements and resolve them before assuming the system is flat.
Root-cause analysis
Root-cause analysis distinguishes the triggering event from the underlying defect and missing controls. Blaming an operator without examining ambiguous interfaces or unsafe defaults can leave the same failure mechanism intact.
Remediation verification
Remediation is complete only when the correction is verified against the failure case and relevant neighboring cases. Document residual limitations and ownership. A code change alone is not evidence that the incident cannot recur.
Worked example
A timeout causes an operator to retry, producing duplicate exposure. The timeout is a trigger; missing request identity and unclear pending state may be underlying contributors.
Try it yourself
Write a remediation plan covering interface state, request identity, reconciliation and a regression scenario.
Show the worked solution
Show pending status, preserve stable request identity where supported, reconcile uncertain outcomes before retry and test a successful request with a lost response. Verify that the repeated message does not create a second action.
Apply this to your course project
Submit an approval, rollback and incident-evidence package for a hypothetical model change.
Keep the calculation inputs, assumptions and decisions with your work. Practical exercises are self-reviewed; the scored knowledge checks assess the questions shown, not an independent certification of practical competence.