Macos Ocr Evidence

• the current task is object isolation itself
• image files do not exist locally yet
• full PDF document parsing is needed instead of image OCR
• caption approval or metadata write-back is the current task
• canonical Table -> Row -> Cell normalization is the current task
• the underlying tool lifecycle is broken — route to vendored-mcp-onboarding

Preferred Tool Surface

• macos-ocr-mcp.ocr_image(file_path)

Fallback Surface

• first fallback:
  • local Swift Vision fallback triggered from the vendored macos-ocr-mcp wrapper
• secondary helper path for table-like images:
  • local Apple Vision document-structure helper script used only as a structure-hint surface
• reference-only tertiary fallback:
  • macOCR CLI for interactive region OCR or future --input <file> comparison runs

Required Inputs

• absolute path to a local image file
• related image or run identifier if the OCR result should be persisted
• output report target when OCR evidence becomes part of a review artifact

References

• references/runtime.md

Workflow

1. Prefer macos-ocr-mcp on one image first.
2. If the run is sandboxed and OCR comes back empty or throws a Vision-side error, rerun unsandboxed before concluding there is no usable text.
3. Confirm whether annotations are non-empty.
4. Summarize the useful OCR text in the run artifact instead of pasting every raw box into a canonical resource doc.
5. If the image is table-like and row or column structure matters, gather Apple Vision structure hints through the helper script before concluding that OCR-only evidence is sufficient.
6. Treat Apple Vision structure output as a helper sidecar, not as a final canonical table artifact.
7. Use macOCR only as a reference or future comparison path unless the local CLI has been explicitly activated in this workspace.
8. Store OCR evidence under the active run artifact unless it becomes reusable knowledge.

Outputs

• OCR annotations from macos-ocr-mcp
• optional Apple Vision structure-hint sidecar for table-like images
• optional run report or review note under the current experiment
• optional evidence snippets attached to caption review or evaluation output

Not Owned Here

• object isolation preprocessing
• caption generation
• caption approval
• metadata write-back
• full-document OCR parsing
• canonical table-schema promotion
• tool lifecycle integrity (launcher, registration, inventory, setup state)