Development workflow, branching, and pipeline execution for OMEGA.
Raw 7z/CSV ──Stage 1──> Base L1 Parquet ──Stage 2──> Feature L2 Parquet ──> Training
(Level-2) (ETL) (ticks/frames) (Physics) (+SRL,TDA,Epi) (XGBoost)
| Stage | Script | Node | Output |
|---|---|---|---|
| Stage 1 | tools/stage1_linux_base_etl.py | Linux | v62_base_l1/host=linux1/ |
| Stage 1 | tools/stage1_windows_base_etl.py |
| Windows |
v62_base_l1/host=windows1/ |
| Stage 2 | tools/stage2_physics_compute.py | Both | v62_feature_l2/host=... |
| Backtest | tools/run_local_backtest.py | Mac | artifacts/ |
mainpytest tests/test_omega_math_core.py -vpython3 tools/deploy.py --dry-run then --skip-commitpython3 tools/cluster_health.pyconfig.py ← Math/physics parameters (ALL agents read this)
configs/node_paths.py ← Host-specific paths (auto-detected)
HOSTS_REGISTRY.yaml ← SSH aliases and network topology
requirements.lock ← Pinned dependencies
L2VolumeClockConfigL2SessionConfig