Run Quality Checks

Running Individual Checks

pytest - Test Suite

Run unit and integration tests:

python plugins/test-suite/skills/run-quality-checks/scripts/test_runner.py --pytest

Options:

• --pytest-args="-v" - Verbose output
• --pytest-args="-k test_auth" - Run specific tests
• --pytest-args="--maxfail=1" - Stop after first failure

ruff - Linting

Check code style and common errors:

python plugins/test-suite/skills/run-quality-checks/scripts/test_runner.py --ruff

Options:

• --ruff-fix - Auto-fix issues where possible
• --ruff-args="--select E,F" - Select specific rule categories

mypy - Type Checking

Verify type annotations:

python plugins/test-suite/skills/run-quality-checks/scripts/test_runner.py --mypy

Options:

• --mypy-args="--strict" - Strict type checking
• --mypy-args="--ignore-missing-imports" - Ignore missing type stubs

bandit - Security Scanning

Scan for security vulnerabilities:

python plugins/test-suite/skills/run-quality-checks/scripts/test_runner.py --bandit

Options:

• --bandit-args="-ll" - Low and low confidence issues
• --bandit-args="--exclude tests/" - Exclude directories

coverage - Test Coverage

Generate coverage report:

python plugins/test-suite/skills/run-quality-checks/scripts/test_runner.py --coverage

Options:

• --coverage-min=80 - Set minimum coverage threshold
• --coverage-html - Generate HTML coverage report

Configuration Files

pytest - pytest.ini or pyproject.toml

[tool.pytest.ini_options]
testpaths = ["tests"]
python_files = "test_*.py"
python_functions = "test_*"
addopts = "-v --strict-markers"
markers = [
    "unit: Unit tests",
    "integration: Integration tests",
    "slow: Slow tests"
]

ruff - pyproject.toml

[tool.ruff]
line-length = 100
target-version = "py312"

[tool.ruff.lint]
select = ["E", "F", "W", "I", "N", "UP", "S", "B", "A", "C4", "SIM"]
ignore = ["E501"]  # Line too long (handled by formatter)

mypy - pyproject.toml

[tool.mypy]
python_version = "3.12"
warn_return_any = true
warn_unused_configs = true
disallow_untyped_defs = true
ignore_missing_imports = false

bandit - pyproject.toml

[tool.bandit]
exclude_dirs = ["tests", "scripts"]
skips = ["B101", "B601"]  # Skip specific checks

coverage - pyproject.toml

[tool.coverage.run]
source = ["src"]
omit = ["*/tests/*", "*/scripts/*"]

[tool.coverage.report]
precision = 2
show_missing = true
fail_under = 80

Common Issues

Issue: pytest failures

Check:

# Run specific failing test with verbose output
pytest tests/test_auth.py::test_login -v

Solutions:

• Check test dependencies are installed
• Verify test data/fixtures are present
• Check for environment variable requirements
• Review test output for assertion details

Issue: ruff linting errors

Check:

# See detailed error with context
ruff check . --show-source

Solutions:

• Auto-fix where possible: ruff check . --fix
• Update code to match style guidelines
• Add # noqa: E501 to ignore specific line (use sparingly)
• Update ruff configuration if rule is too strict

Issue: mypy type errors

Check:

# Show detailed type error messages
mypy --show-error-codes --pretty

Solutions:

• Add type hints to functions
• Import types: from typing import List, Dict, Optional
• Use # type: ignore for third-party library issues
• Update mypy configuration for gradual typing

Issue: bandit security warnings

Check:

# See detailed security issue descriptions
bandit -r src/ -f txt

Solutions:

• Fix security vulnerabilities (hardcoded passwords, SQL injection)
• Use # nosec comment for false positives (with justification)
• Update dependencies with known vulnerabilities
• Review bandit configuration if too noisy

Issue: Low coverage

Check:

# Generate HTML report to see uncovered lines
coverage html
open htmlcov/index.html

Solutions:

• Add tests for uncovered code paths
• Remove dead code
• Exclude intentionally untested code (config, scripts)
• Focus on critical paths first

CI/CD Integration

GitHub Actions