Skill: experiment-reproduction-and-result-verification

[Case 2]

• Initial Environment: A partially complete research submission contains code development artifacts and a rubric with code, execution, and result-match requirements. The benchmark awards partial credit based on which requirements are satisfied.
• Real Question: Assess the submission by checking which implementation, execution, and result requirements are actually met after running the pipeline.
• Real Trajectory: Read the rubric, identify leaf requirements, run the provided scripts, inspect logs and outputs, and connect observed evidence to each requirement type before scoring the submission.
• Real Answer: The submission satisfies some code-development and execution requirements but only a subset of result-match requirements, leading to a partial replication score.
• Why this demonstrates the capability: The task demonstrates experiment reproduction and result verification because it requires evidence-based judgment over code, execution artifacts, and empirical outputs. The agent must distinguish having code from having runnable code, and runnable code from actually matched results.

Pipeline Execution Instructions

To synthesize data for this capability, you must strictly follow a 3-phase pipeline. Do not hallucinate steps. Read the corresponding reference file for each phase sequentially:

1. Phase 1: Environment Exploration Read the exploration guidelines to discover raw knowledge seeds: references/EXPLORATION.md

2. Phase 2: Trajectory Selection Once Phase 1 is complete, read the selection criteria to evaluate the trajectory: references/SELECTION.md

3. Phase 3: Data Synthesis Once a trajectory passes Phase 2, read the synthesis instructions to generate the final data: references/SYNTHESIS.md