What you will learn
- Check units and accounting
- Challenge data availability
- Inspect sample selection
- Review execution assumptions
Check units and accounting
Check units and accounting before interpreting sophisticated statistics. A missing multiplier or duplicate fill can invalidate every later chart. Begin with a small independently verified example and aggregate reconciliation.
Challenge data availability
Challenge data availability at the claimed decision time. Ask how revised releases, completed bars and later annotations entered the analysis. A convincing model score cannot repair an unavailable feature.
Inspect sample selection
Inspect the sample-selection process and exclusions. A reviewer should be able to trace raw observations to reported trades. Missing losing cases require investigation, not automatic acceptance of the author's summary.
Review execution assumptions
Review execution assumptions alongside the strategy logic. A signal's historical return is not equivalent to fillable P&L. Check quote side, delay, quantity and costs, and state which elements the available data cannot verify.
Worked example
A polished report has a contract multiplier omitted from every P&L calculation. The statistical analysis may be internally consistent but describes the wrong cash exposure.
Try it yourself
Write a prioritized review finding and specify which outputs need to be regenerated after correction.
Show the worked solution
Identify the unit error as material, correct the calculation independently and regenerate P&L, sizing, drawdown and dependent statistics. Reassess the conclusion rather than merely fixing one table label.
Apply this to your course project
Produce a structured peer review and a targeted remediation plan.
Keep the calculation inputs, assumptions and decisions with your work. Practical exercises are self-reviewed; the scored knowledge checks assess the questions shown, not an independent certification of practical competence.