Name: Ab Test Analyzer
Author: ekatasingh1107

Analyzes A/B test results for statistical significance. Takes variant data (visitors and conversions), calculates conversion rates, lift, p-value, confidence interval, statistical power, and required sample size. Provides a clear recommendation to ship, extend, or kill the test based on rigorous statistical analysis.

Prerequisites

agency.config.json at repo root (for context on business goals and CRO service framing)
No external tools required; this is a pure computation skill

Phase 0: Intake

Read agency.config.json from the project root.
Extract:
- services[] -- CRO context for framing recommendations
- case_studies[] -- benchmark conversion data if relevant
Accept parameters (required):
- test_name -- descriptive name for the test
- control -- control variant data: { "name": "Control", "visitors": N, "conversions": N }
- variants -- array of variant data:

Prerequisites

agency.config.json at repo root (for context on business goals and CRO service framing)
No external tools required; this is a pure computation skill

Phase 0: Intake

Read agency.config.json from the project root.
Extract:
- services[] -- CRO context for framing recommendations
- case_studies[] -- benchmark conversion data if relevant
Accept parameters (required):
- test_name -- descriptive name for the test
- control -- control variant data: { "name": "Control", "visitors": N, "conversions": N }
- variants -- array of variant data:

Ab Test Analyzer

Prerequisites

Phase 0: Intake

Ab Test Analyzer

Prerequisites

Phase 0: Intake

Phase 1: Core Calculations

Per-variant calculations:

Variant vs. Control comparison:

Statistical significance:

Statistical power calculation:

Required sample size calculation:

Visualization Expert

Data Analyst

Huggingface Hub

Multi Reviewer Patterns

Dbt Transformation Patterns

Startup Financial Modeling