Replay and Reproducibility

Definition

Replay and Reproducibility is the systematic design and evaluation of replay and reproducibility within the creation, preservation and verification of evidence showing what systems, people and institutions did.

Why this matters

Weak replay and reproducibility can lead to unsafe deployment, unlawful or unauthorised action, wasted public resources, loss of rights, poor accountability and declining institutional trust.

Research questions

Which controls, evidence and institutional arrangements make replay and reproducibility effective in practice, and how do outcomes vary by sector, system risk, organisational maturity and operating context?

Hypotheses

An explicit, testable and continuously evidenced approach to replay and reproducibility, with clear ownership, independent review, runtime telemetry and recovery, will outperform policy-only or periodic compliance approaches.

Proposed methods

provenance analysis; audit-log testing; receipt reconciliation; replay testing; evidence completeness assessment; forensic review; stakeholder interviews; document and control review; fault and incident simulation; longitudinal implementation assessment; methods adapted specifically to Replay and Reproducibility

Stakeholders and beneficiaries

citizens; public servants; executives; boards; regulators; auditors; legal and risk teams; technology teams; service users; civil society; suppliers