jrrribeiro commited on
Commit
eb75418
·
1 Parent(s): 0a5e459

docs(qa): add Sprint 4 end-to-end checklist and sign-off template

Browse files
docs/END_TO_END_QA_CHECKLIST_SPRINT4.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # End-to-End QA Checklist - Sprint 4
2
+
3
+ Status legend:
4
+ - PASS = behavior validated
5
+ - FAIL = behavior not validated
6
+ - BLOCKED = could not validate due to environment/tooling limitation
7
+
8
+ ## Scope
9
+ This checklist validates Sprint 4 multi-project security flow:
10
+ - Login and session creation
11
+ - Project authorization per user
12
+ - Admin-only controls
13
+ - Project creation and assignment workflows
14
+ - Validation tab readiness based on selected project
15
+
16
+ ## Test Data (Demo Users)
17
+ - admin_user
18
+ - validator_demo
19
+ - validator_other
20
+
21
+ Expected access matrix:
22
+ - admin_user -> kenya-2024 (admin), nairobi-2023 (admin)
23
+ - validator_demo -> demo-project (validator), kenya-2024 (validator)
24
+ - validator_other -> nairobi-2023 (validator)
25
+
26
+ ## E2E Cases
27
+
28
+ | ID | Area | Precondition | Steps | Expected Result | Status |
29
+ |---|---|---|---|---|---|
30
+ | E2E-01 | App bootstrap | Virtual env active | Start app and open local URL | App starts without runtime exception | PASS |
31
+ | E2E-02 | Login | App running | Login as admin_user | Session is created and user is authenticated | PASS |
32
+ | E2E-03 | Project selector | admin_user logged in | Open Select Project tab | Authorized projects are listed (kenya-2024, nairobi-2023) | PASS |
33
+ | E2E-04 | Validation readiness | admin_user logged in | Open Validation tab | Validation status is ready with selected project | PASS |
34
+ | E2E-05 | Admin visibility | validator_demo logged in | Open Admin tab | Access denied message and hidden admin controls | PASS |
35
+ | E2E-06 | Admin visibility | admin_user logged in | Open Admin tab | Admin controls are visible | PASS |
36
+ | E2E-07 | Project creation | admin_user logged in | Create project with slug/name/repo_id | New project is created and project list is refreshed | PASS |
37
+ | E2E-08 | Project assignment | admin_user logged in | Assign user to a project | Assignment succeeds and access matrix updates | PASS |
38
+ | E2E-09 | Non-admin write protection | validator_demo logged in | Attempt assignment/create actions | Actions are denied by backend callback checks | PASS |
39
+ | E2E-10 | ACL isolation | Test suite available | Run ACL tests | ACL tests pass (project isolation enforced) | PASS |
40
+
41
+ ## Execution Notes
42
+ - This checklist is aligned with fixes applied in src/ui/app_factory.py.
43
+ - The app uses Gradio and callback-driven state transitions.
44
+ - ACL behavior is also covered by unit tests in tests/unit/test_acl_enforcement.py.
45
+
46
+ ## Evidence Commands
47
+ 1. python -m pytest tests/unit/test_acl_enforcement.py -q
48
+ 2. python -m pytest -q --tb=line
49
+ 3. Start app on a free port and verify local HTTP response
50
+
51
+ ## Sign-off
52
+ - Sprint 4 E2E status: PASS
53
+ - Date: 2026-03-25