-
Notifications
You must be signed in to change notification settings - Fork 67
Open
Labels
Milestone
Description
Overview
Comprehensive verification that tests_v2/ has equivalent or better coverage than tests/ before CI cutover.
Scope
- Compare test counts between old and new test structures
- Verify all test behaviors are preserved
- Document any intentionally removed tests
- Generate coverage comparison report
Verification Steps
1. Test Count Comparison
# Count tests in old structure
pytest tests/ --collect-only -q | tail -1
# Count tests in new structure
pytest tests_v2/ --collect-only -q | tail -1
# Compare counts2. Coverage Comparison
# Old structure coverage
pytest tests/ --cov=src/gaia --cov-report=term
# New structure coverage
pytest tests_v2/ --cov=src/gaia --cov-report=term
# Compare coverage percentages3. Test Behavior Verification
- All critical test behaviors preserved
- No regressions introduced
- Anti-patterns successfully removed (13
_TOOL_REGISTRY.clear()calls) - Hardcoded ports replaced with dynamic allocation
4. Documentation
Create verification report documenting:
- Test count comparison (old vs new)
- Coverage comparison (should be ≥ old coverage)
- List of intentionally removed tests (if any)
- Anti-patterns fixed
Acceptance Criteria
- Test count verification complete:
tests_v2/has ≥ tests astests/ - Coverage verification:
tests_v2/coverage ≥ 15% (current target) - All anti-patterns documented as fixed
- Verification report created
- Both test suites pass:
pytest tests/ -vandpytest tests_v2/ -v
Parent Issue
Part of #209 - Test Suite Overhaul Epic
Dependencies
Requires all migration issues (#239-244) to be completed first.
Reactions are currently unavailable