Skip to content

Search skills.../

Agent Skill Search Engine

Search

Search
Categories
Occupations

About

About
Privacy
Terms

© 2026 Skills Pool. All rights reserved.

Audit | Skills Pool

Skill File

Audit

Cross-reference audit for stale counts, broken links, and doc drift across all files

johnnichev9 starsMar 24, 2026

Occupation: Bookkeeping, Accounting, and Auditing Clerks
Categories: Debugging

Skill Content

Cross-Reference Audit

Live Counts (source of truth)

Version (init.py): !grep -m1 __version__ src/selectools/__init__.py
Version (pyproject.toml): !grep -m1 "version" pyproject.toml
Tests: !pytest tests/ --collect-only -q 2>/dev/null | tail -1
Models: !grep -c "ModelInfo(" src/selectools/models.py
Examples: !ls examples/*.py | wc -l | tr -d ' '
Module docs: !ls docs/modules/*.md | wc -l | tr -d ' '
Toolbox tools: !grep -roh "@tool" src/selectools/toolbox/*.py | wc -l | tr -d ' '
Observer events (sync): !python3 -c "from selectools.observer import AgentObserver; print(len([m for m in dir(AgentObserver) if m.startswith('on_')]))" 2>/dev/null
Observer events (async): !python3 -c "from selectools.observer import AsyncAgentObserver; print(len([m for m in dir(AsyncAgentObserver) if m.startswith('a_on_')]))" 2>/dev/null

Related Skills

Quick Install

Audit

npx skillvault add johnnichev/johnnichev-selectools-claude-skills-audit-skill-md

Download Skill Open repository

Author: johnnichev
stars: 9
Updated: Mar 24, 2026
Occupation

On this page

01Cross-Reference Audit

StepTypes: !python3 -c "from selectools.trace import StepType; print(len(StepType))" 2>/dev/null

Knowledge store backends: !echo "4 (File, SQLite, Redis, Supabase)"

Last example: !ls examples/*.py | tail -1

Audit Procedure

1. Version Consistency

Verify __init__.py version matches pyproject.toml version.

2. Count Audit

Search each file for hardcoded counts. Report any mismatch against live values.

Test count — check:

README.md, docs/index.md, CLAUDE.md, CONTRIBUTING.md, docs/CONTRIBUTING.md, landing/index.html

Example count — check:

README.md, CLAUDE.md

Model count — check:

README.md, docs/index.md, CLAUDE.md, docs/modules/MODELS.md

Observer event count — check:

CLAUDE.md, docs/modules/AGENT.md, docs/ARCHITECTURE.md, docs/QUICKSTART.md

StepType count — check:

CLAUDE.md, tests/test_phase1_design_patterns.py

3. Content Drift Audit

CLAUDE.md:

Codebase Structure tree matches actual files (check for missing new files)
TraceStep Types table has all StepType members
Current Roadmap matches ROADMAP.md
Observer counts match

docs/ARCHITECTURE.md:

Version header is current
Observer event counts current

docs/modules/AGENT.md:

Lifecycle events table title matches actual count
AsyncAgentObserver event count correct
Hooks referenced as deprecated

docs/modules/KNOWLEDGE.md:

Mentions all 4 store backends
References KnowledgeEntry, KnowledgeStore protocol

docs/modules/TOOLS.md:

Mentions requires_approval parameter
Mentions _serialize_result() behavior

4. New Feature Doc Coverage

Verify each v0.17.3+ feature has:

Module doc in docs/modules/
Example script in examples/
Entry in mkdocs.yml nav

Features to check: Budget, Cancellation, Token Estimation, Model Switching, SimpleStepObserver, Structured Results, Approval Gate, Reasoning Strategies, Tool Result Caching

5. Link Check

cp CHANGELOG.md docs/CHANGELOG.md && mkdocs build

Report any warnings.

6. CHANGELOG Sync

Verify docs/CHANGELOG.md matches CHANGELOG.md:

diff CHANGELOG.md docs/CHANGELOG.md

7. Private Docs (if accessible)

Check .private/master-competitive-plan.md, .private/competitive-analysis.md, and .private/growth-plan.md for stale test counts, example counts, version references, and competitive scorecard accuracy.

8. Output

Present results in two tables:

Count mismatches:

Location	Field	Found	Expected	Status

Content drift:

Location	Issue	Status

Only show mismatches/issues. If everything matches, say "All counts are consistent" and "No content drift detected."

02

Live Counts (source of truth)

03Audit Procedure

041. Version Consistency

052. Count Audit

063. Content Drift Audit

074. New Feature Doc Coverage

085. Link Check

096. CHANGELOG Sync

107. Private Docs (if accessible)

Session Logs

Search and analyze your own session logs (older/parent conversations) using jq.

OpenClaw Test Heap Leaks

Investigate `pnpm test` memory growth, Vitest worker OOMs, and suspicious RSS increases in OpenClaw using the `scripts/test-parallel.mjs` heap snapshot tooling. Use when Codex needs to reproduce test-lane memory growth, collect repeated `.heapsnapshot` files, compare snapshots from the same worker PID, triage likely transformed-module retention versus likely runtime leaks, and fix or reduce the impact by patching cleanup logic or isolating hotspot tests.

Node Connect

Diagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps. Use when QR/setup code/manual connect fails, local Wi-Fi works but VPS/tailnet does not, or errors mention pairing required, unauthorized, bootstrap token invalid or expired, gateway.bind, gateway.remote.url, Tailscale, or plugins.entries.device-pair.config.publicUrl.

Openclaw Qa Testing

Run, watch, debug, and extend OpenClaw QA testing with qa-lab and qa-channel. Use when Codex needs to execute the repo-backed QA suite, inspect live QA artifacts, debug failing scenarios, add new QA scenarios, or explain the OpenClaw QA workflow. Prefer the live OpenAI lane with regular openai/gpt-5.4 in fast mode; do not use gpt-5.4-pro or gpt-5.4-mini unless the user explicitly overrides that policy.

Openclaw Secret Scanning Maintainer

Maintainer-only workflow for handling GitHub Secret Scanning alerts on OpenClaw. Use when Codex needs to triage, redact, clean up, and resolve secret leakage found in issue comments, issue bodies, PR comments, or other GitHub content.

Flags

Use when you need to check feature flag states, compare channels, or debug why a feature behaves differently across release channels.

Bookkeeping, Accounting, and Auditing Clerks