Generate Questions

Do NOT tailor questions to any specific documentation. The goal is to capture what users genuinely need help with.

Requirements

• Questions must be self-contained (no references to "the above" or prior context).
• If a dedup file was given, check each candidate question against existing ones and skip near-duplicates.

Reference Answers

Every question MUST include a reference_answer — a concise summary of the correct answer, used as ground truth during evaluation.

• State the key facts: the correct approach, relevant commands, and important parameter names.
• Keep it brief — a few sentences to a short paragraph. The evaluation pipeline independently verifies claims, so exhaustive detail is not needed.
• Base answers on your knowledge. Use web search only to confirm specific details you are unsure about.

Output

Write a JSON array (default: questions.json). The file must contain ONLY the JSON array — no markdown fences, no commentary, no explanation.

[
  {
    "text": "The full question text",
    "reference_answer": "Concise correct answer with key facts, commands, and parameter names."
  }
]

Self-Validation

After writing, verify:

• Valid JSON array
• Non-empty
• Each object has non-empty text and reference_answer strings
• If dedup file was given, no new question is a near-duplicate