Co Growth Learning Synthesis

Deliverables

• report.md: result summary, decision, and next steps.
• results/experiment-results.md: metrics, CIs, decision rationale.

Quality Gates

• Statistical significance checked with correct α threshold.
• Effect size and 95% CI are reported (not just p-value).
• Guardrail metrics reviewed for degradation.
• Decision uses Scale/Iterate/Kill framework explicitly.
• At least one next hypothesis is generated.

If any gate fails: identify the issue, fix, and re-validate.

Gotchas

• A p-value of 0.049 with a wide CI is not a strong signal. Always report CI width alongside significance.
• "Iterate" is not "re-run the same test." Each iteration must change at least one variable.
• Novelty effects inflate early results. If runtime was <2 weeks, flag potential novelty bias.

Validation Loop

1. Generate synthesis and decision
2. Check: significance, effect size + CI, guardrails, Scale/Iterate/Kill applied
3. If any check fails → revise analysis
4. User approval before shipping or killing ⏸️