Vote Severity | Skills Pool

技能檔案

Vote Severity

Phase 4 — Run multi-model severity voting on confirmed issues. Writes votes.json next to each issue (append-only).

expectedparrot0 星標2026年3月27日

職業
分類: 機器學習

技能內容

Phase 4: Multi-Model Severity Voting

Run from the repo root. Requires investigated and deduplicated issues from Phases 2-3.

Execute severity voting

Look for the roboree scripts path in the system prompt (it will say "roboree scripts are at: <path>"). Use that path:

python <r2-scripts-path>/vote_severity.py \
  --review-dir .review/ \
  --config .review/config.json

The script:

Finds all confirmed, canonical issues (using dedup.json if present)
Skips issues that already have votes.json (resumable)
Runs an edsl cross-product: issues x models (from config)
Writes votes.json next to each issue.json
Writes a top-level .review/severity.json summary

Output

相關技能

{
  "votes": [
    {"model": "claude-sonnet-4-6", "severity": "major", "reasoning": "..."},
    {"model": "gpt-4o", "severity": "major", "reasoning": "..."},
    {"model": "gemini-2.5-pro", "severity": "moderate", "reasoning": "..."}
  ],
  "consensus": "major",
  "agreement": 0.67,
  "voted_at": "<ISO timestamp>"
}

{
  "issues": {
    "chunks/model-00-a3f2/undefined_symbols": {"severity": "major", "agreement": 0.67}
  },
  "summary": {"major": 3, "moderate": 5, "minor": 2},
  "voted_not_an_issue": ["chunks/intro-00-b7c1/logical_gaps"],
  "created_at": "<ISO timestamp>"
}

git add -A
git commit -m "review: severity voting — <M> major, <Mo> moderate, <Mi> minor"