Spaces:
Sleeping
Sleeping
Commit ·
eb75418
1
Parent(s): 0a5e459
docs(qa): add Sprint 4 end-to-end checklist and sign-off template
Browse files
docs/END_TO_END_QA_CHECKLIST_SPRINT4.md
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# End-to-End QA Checklist - Sprint 4
|
| 2 |
+
|
| 3 |
+
Status legend:
|
| 4 |
+
- PASS = behavior validated
|
| 5 |
+
- FAIL = behavior not validated
|
| 6 |
+
- BLOCKED = could not validate due to environment/tooling limitation
|
| 7 |
+
|
| 8 |
+
## Scope
|
| 9 |
+
This checklist validates Sprint 4 multi-project security flow:
|
| 10 |
+
- Login and session creation
|
| 11 |
+
- Project authorization per user
|
| 12 |
+
- Admin-only controls
|
| 13 |
+
- Project creation and assignment workflows
|
| 14 |
+
- Validation tab readiness based on selected project
|
| 15 |
+
|
| 16 |
+
## Test Data (Demo Users)
|
| 17 |
+
- admin_user
|
| 18 |
+
- validator_demo
|
| 19 |
+
- validator_other
|
| 20 |
+
|
| 21 |
+
Expected access matrix:
|
| 22 |
+
- admin_user -> kenya-2024 (admin), nairobi-2023 (admin)
|
| 23 |
+
- validator_demo -> demo-project (validator), kenya-2024 (validator)
|
| 24 |
+
- validator_other -> nairobi-2023 (validator)
|
| 25 |
+
|
| 26 |
+
## E2E Cases
|
| 27 |
+
|
| 28 |
+
| ID | Area | Precondition | Steps | Expected Result | Status |
|
| 29 |
+
|---|---|---|---|---|---|
|
| 30 |
+
| E2E-01 | App bootstrap | Virtual env active | Start app and open local URL | App starts without runtime exception | PASS |
|
| 31 |
+
| E2E-02 | Login | App running | Login as admin_user | Session is created and user is authenticated | PASS |
|
| 32 |
+
| E2E-03 | Project selector | admin_user logged in | Open Select Project tab | Authorized projects are listed (kenya-2024, nairobi-2023) | PASS |
|
| 33 |
+
| E2E-04 | Validation readiness | admin_user logged in | Open Validation tab | Validation status is ready with selected project | PASS |
|
| 34 |
+
| E2E-05 | Admin visibility | validator_demo logged in | Open Admin tab | Access denied message and hidden admin controls | PASS |
|
| 35 |
+
| E2E-06 | Admin visibility | admin_user logged in | Open Admin tab | Admin controls are visible | PASS |
|
| 36 |
+
| E2E-07 | Project creation | admin_user logged in | Create project with slug/name/repo_id | New project is created and project list is refreshed | PASS |
|
| 37 |
+
| E2E-08 | Project assignment | admin_user logged in | Assign user to a project | Assignment succeeds and access matrix updates | PASS |
|
| 38 |
+
| E2E-09 | Non-admin write protection | validator_demo logged in | Attempt assignment/create actions | Actions are denied by backend callback checks | PASS |
|
| 39 |
+
| E2E-10 | ACL isolation | Test suite available | Run ACL tests | ACL tests pass (project isolation enforced) | PASS |
|
| 40 |
+
|
| 41 |
+
## Execution Notes
|
| 42 |
+
- This checklist is aligned with fixes applied in src/ui/app_factory.py.
|
| 43 |
+
- The app uses Gradio and callback-driven state transitions.
|
| 44 |
+
- ACL behavior is also covered by unit tests in tests/unit/test_acl_enforcement.py.
|
| 45 |
+
|
| 46 |
+
## Evidence Commands
|
| 47 |
+
1. python -m pytest tests/unit/test_acl_enforcement.py -q
|
| 48 |
+
2. python -m pytest -q --tb=line
|
| 49 |
+
3. Start app on a free port and verify local HTTP response
|
| 50 |
+
|
| 51 |
+
## Sign-off
|
| 52 |
+
- Sprint 4 E2E status: PASS
|
| 53 |
+
- Date: 2026-03-25
|