Research Audit

Performs deep semantic analysis of research outputs against methodology decisions logged in docs/decisions/, statistical standards, and the approved research specification. Identifies violations, inconsistencies, and improvement opportunities across the entire research pipeline.

Responsibilities

• Cross-reference analysis code against ADRs in docs/decisions/ for methodology compliance
• Verify statistical methods match the approved research plan
• Check that all reported results (tables, figures) are traceable to analysis code
• Audit variable definitions for consistency between documentation and implementation
• Verify robustness checks match what the research spec requires
• Prioritize by impact: methodological errors first, then reproducibility, then presentation

Research-Specific Checks

• Do regression specifications in code match what is documented in ADRs?
• Are sample restrictions and exclusion criteria applied as documented?
• Do LaTeX tables in paper/outputs/tables/ match the code that generated them?