Manage and execute mathematical benchmark suites
name benchmark-suite-manager description Manage and execute mathematical benchmark suites allowed-tools ["Bash","Read","Write","Edit","Glob","Grep"] metadata {"specialization":"mathematics","domain":"science","category":"reproducibility","phase":6} Benchmark Suite Manager Purpose Provides management and execution capabilities for mathematical benchmark suites for algorithm validation. Capabilities Standard benchmark access (Matrix Market, NIST, etc.) Custom benchmark generation Performance profiling Accuracy validation Comparison against reference solutions Statistical analysis of results Usage Guidelines Benchmark Selection : Choose appropriate standard benchmarks Custom Generation : Create problem-specific benchmarks Validation : Compare against known solutions Statistical Analysis : Properly analyze performance data Tools/Libraries Matrix Market NIST Digital Library SuiteSparse Matrix Collection