Unified wiki compiler. Processes sources from raw/ (immutable, manual) and daily/ (ephemeral, auto-generated) into structured wiki pages. Trigger when user says "ingest", "process raw", "wiki ingest", "переведи в wiki", "обработай raw", or "remember this" / "note this". Also handles "lint the wiki".
Processes sources from raw/ (immutable) and daily/ (ephemeral) into structured wiki pages.
raw/ → compile.py → wiki/ (immutable sources, manual: devlog, articles)
daily/ → compile.py → wiki/ (ephemeral, auto-generated from sessions, deleted after processing)
→ index.md (one index)
→ log.md (one log)
One compiler (compile.py) handles both source types. Automatic compilation triggered after 18:00 by flush.py. Manual via CLI or skill.
obsidian-vault/obsidian-vault/raw/ (immutable — never modify or delete)obsidian-vault/daily/ (ephemeral — deleted after successful compilation)obsidian-vault/wiki/ (subfolders below)obsidian-vault/index.md (single unified index)obsidian-vault/log.md (single unified log)obsidian-vault/wiki-schema.mdkarpathy-wiki-manual-and-auto/scripts/compile.pyraw/ or daily/ and asks to process themuv run --directory karpathy-wiki-manual-and-auto python scripts/compile.py # all unprocessed
uv run --directory karpathy-wiki-manual-and-auto python scripts/compile.py --source raw # only raw/
uv run --directory karpathy-wiki-manual-and-auto python scripts/compile.py --source daily # only daily/
uv run --directory karpathy-wiki-manual-and-auto python scripts/compile.py --file <path> # specific file
uv run --directory karpathy-wiki-manual-and-auto python scripts/compile.py --dry-run # preview
The compiler uses Claude Agent SDK to read sources and create/update wiki pages directly.
After compilation:
obsidian-vault/index.md for new pagesobsidian-vault/log.md for the compilation entrydaily/ files are automatically deletedIf the compiler missed something or you need fine-grained control:
index.md and log.mdWhen user says "remember this" / "note this" without a source:
sources: in frontmatter (or sources: [conversation])index.md + log.mduv run --directory karpathy-wiki-manual-and-auto python scripts/lint.py # all checks
uv run --directory karpathy-wiki-manual-and-auto python scripts/lint.py --structural-only # free, no LLM
Two folders only (same idea as coleam00/claude-memory-compiler):
| Folder | When to use |
|---|---|
wiki/concepts/ | Atomic pages: patterns, bugs, features, system design notes, ops, glossary |
wiki/connections/ | Cross-cutting pages: workflows, how multiple systems/topics relate, spanning ADRs |
---