Data Engineering
Nonfunctional Requirements for Data Engineering Systems
[WHAT] Guides the agent through trade-off analysis for data engineering systems using nonfunctional requirements: performance, reliability, scalability, and maintainability. Provides layered decision frameworks for system properties, pipeline design, and data operations. [WHEN] Activate when the user is defining SLOs/SLAs for data systems, evaluating pipeline latency vs throughput, choosing batch vs streaming, assessing fault tolerance strategies, planning capacity, or reasoning about ETL vs ELT, error handling, idempotency, or data quality trade-offs. [KEYWORDS] nonfunctional requirements, performance, reliability, scalability, maintainability, SLO, SLA, latency, throughput, percentiles, fault tolerance, batch, streaming, ETL, ELT, idempotency, data quality, observability, trade-off analysis, pipeline design.