Post Impl Verification

Workflow

Step 1: Parse Claims

Extract from the task description:

• File patterns and expected count
• Test suite path and expected test count
• Risk mitigations to verify

Step 2: Count Deliverables

Glob for each deliverable pattern → count unique files → compare to expected count

• Use Glob to find all files matching claimed patterns
• Count results and compare against the expected deliverable count
• Flag any missing or unexpected files
• PASS: actual >= expected
• FAIL: actual < expected (list missing files)

Step 3: Run Test Suite

pytest <test_path> -q --tb=short → parse collected count + failures

• Run pytest targeting the relevant test directory/files
• Parse output for: collected count, passed count, failed count, error count
• PASS: collected >= expected AND failures == 0
• FAIL: collected < expected OR failures > 0

Step 4: Spot-Check Risk Mitigations

For each item in the risk register:

• Use Grep or Read to confirm the mitigation exists in source
• Check for defensive patterns (e.g., input validation, circuit breakers, error handling)
• At minimum spot-check 3 risk items (or all if fewer than 3)
• PASS: all checked mitigations found
• PARTIAL: some mitigations missing or ambiguous
• FAIL: critical mitigations absent

Step 5: Emit Contract

Produce the structured output contract (see below).

Error Handling

Output Contract

Every execution must end with:

## CONTRACT