Open Access Mining Guide

{
  "paper_id": "doi|pmcid|arxiv",
  "source": "pmc|core|arxiv|other",
  "license": "string or null",
  "sections": [
    {"title": "Methods", "text": "..."}
  ],
  "entities": [
    {"text": "string", "type": "string"}
  ],
  "numeric_findings": ["string"],
  "provenance": {
    "retrieved_at": "ISO-8601",
    "source_url": "string"
  }
}

Legal and operational guardrails

• Mine only content with lawful access and record license status per paper.
• Respect API/rate limits; cache raw responses to avoid repeated downloads.
• Share derived data when uncertain about redistribution rights for full text.
• Keep a validation report (sample size, precision issues, unresolved ambiguities).

Zotero integration pattern

• Store corpus query protocol as a Zotero note.
• Attach per-paper extraction summaries to source items.
• Tag items with mining stage (retrieved, parsed, qa-passed, needs-review).
• Generate a final collection-level synthesis note with method and limitations.