Cuong2004 commited on
Commit
a2de267
·
verified ·
1 Parent(s): 3fbcee1

Sync benchmark reports and JSON results

Browse files
outputs/RESULTS_FINAL.md CHANGED
@@ -44,28 +44,28 @@
44
  | **T1.3** | LSTM | Pairwise Joint Angles 2D | 286 | 0.1343 | — | 2.5289 | 66.12% ± 1.06% | — | 51.53% ± 1.57% | 0.4993 ± 0.0119 | Verified |
45
  | **T1.4** | LSTM | Adjacent Joint Angles 2D | 78 | 0.1327 | — | 2.3319 | 69.98% ± 0.79% | — | 55.73% ± 1.29% | 0.5412 ± 0.0147 | Verified |
46
  | **T1.5** | LSTM | Raw 3D Coordinates | 39 | 0.1183 | — | 2.0571 | 68.47% ± 1.67% | — | 53.53% ± 1.18% | 0.5117 ± 0.0133 | Verified |
47
- | **T1.6** | LSTM | Root-Relative 3D Coordinates | 39 | 0.1548 | — | 1.6984 | 73.09% ± 1.02% | — | 58.77% ± 1.38% | 0.5738 ± 0.0127 | Verified |
48
  | **T1.7** | LSTM | Pairwise Joint Angles 3D | 286 | 0.1426 | — | 2.3883 | 65.16% ± 0.97% | — | 50.68% ± 0.51% | 0.4923 ± 0.0040 | Verified |
49
  | **T1.8** | LSTM | Adjacent Joint Angles 3D | 78 | 0.0943 | — | 1.9178 | 72.84% ± 1.06% | — | 57.42% ± 0.62% | 0.5680 ± 0.0097 | Verified |
50
- | **T1.9** | LSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | 0.0417 | — | 1.9940 | 77.78% ± 1.15% | — | 51.17% ± 13.08% | 0.5014 ± 0.1232 | Verified |
51
  | **T1.10** | BiLSTM | Raw 2D Coordinates | 26 | 0.0747 | — | 2.2106 | 70.81% ± 0.73% | — | 54.28% ± 0.08% | 0.5338 ± 0.0033 | Verified |
52
  | **T1.11** | BiLSTM | Root-Relative 2D Coordinates | 26 | 0.0790 | — | 1.8599 | 75.21% ± 0.91% | — | 58.95% ± 0.84% | 0.5700 ± 0.0101 | Verified |
53
  | **T1.12** | BiLSTM | Pairwise Joint Angles 2D | 286 | 0.1284 | — | 2.5607 | 65.96% ± 0.47% | — | 52.37% ± 1.98% | 0.5043 ± 0.0206 | Verified |
54
  | **T1.13** | BiLSTM | Adjacent Joint Angles 2D | 78 | 0.0623 | — | 2.5136 | 71.08% ± 0.17% | — | 56.53% ± 0.29% | 0.5508 ± 0.0072 | Verified |
55
  | **T1.14** | BiLSTM | Raw 3D Coordinates | 39 | 0.1339 | — | 2.1974 | 68.19% ± 0.86% | — | 53.22% ± 0.90% | 0.5045 ± 0.0074 | Verified |
56
- | **T1.15** | BiLSTM | Root-Relative 3D Coordinates | 39 | 0.1059 | — | 1.9566 | 73.24% ± 0.83% | — | 58.43% ± 0.99% | 0.5634 ± 0.0034 | Verified |
57
  | **T1.16** | BiLSTM | Pairwise Joint Angles 3D | 286 | 0.1690 | — | 2.0893 | 64.47% ± 0.69% | — | 51.25% ± 1.82% | 0.4922 ± 0.0194 | Verified |
58
  | **T1.17** | BiLSTM | Adjacent Joint Angles 3D | 78 | 0.1432 | — | 1.6524 | 73.19% ± 0.67% | — | 57.90% ± 1.11% | 0.5719 ± 0.0098 | Verified |
59
- | **T1.18** | BiLSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | 0.0828 | — | 1.6630 | 76.16% ± 2.19% | — | 49.75% ± 13.47% | 0.4921 ± 0.1297 | Verified |
60
  | **T1.19** | Transformer | Raw 2D Coordinates | 26 | 0.3905 | — | 1.1568 | 77.75% ± 0.53% | — | 63.62% ± 1.06% | 0.6258 ± 0.0118 | Verified |
61
  | **T1.20** | Transformer | Root-Relative 2D Coordinates | 26 | 0.5088 | — | 1.2146 | 75.44% ± 0.79% | — | 61.22% ± 1.61% | 0.5981 ± 0.0172 | Verified |
62
  | **T1.21** | Transformer | Pairwise Joint Angles 2D | 286 | 0.4268 | — | 1.4610 | 69.85% ± 0.47% | — | 55.95% ± 0.74% | 0.5310 ± 0.0115 | Verified |
63
  | **T1.22** | Transformer | Adjacent Joint Angles 2D | 78 | 0.4115 | — | 1.4490 | 70.15% ± 1.19% | — | 55.12% ± 1.68% | 0.5407 ± 0.0205 | Verified |
64
  | **T1.23** | Transformer | Raw 3D Coordinates | 39 | 0.4239 | — | 1.1319 | 77.24% ± 0.59% | — | 62.87% ± 0.69% | 0.6202 ± 0.0097 | Verified |
65
- | **T1.24** | Transformer | Root-Relative 3D Coordinates | 39 | 0.4344 | — | 1.1740 | 77.88% ± 0.89% | — | 63.87% ± 0.73% | 0.6179 ± 0.0080 | Verified |
66
  | **T1.25** | Transformer | Pairwise Joint Angles 3D | 286 | 0.4029 | — | 1.5516 | 69.51% ± 1.03% | — | 57.41% ± 0.54% | 0.5570 ± 0.0062 | Verified |
67
  | **T1.26** | Transformer | Adjacent Joint Angles 3D | 78 | 0.3812 | — | 1.4079 | 73.51% ± 1.10% | — | 59.56% ± 0.66% | 0.5922 ± 0.0054 | Verified |
68
- | **T1.27** | Transformer | Hybrid Geometric Multi-Feature (mix_v2) | 63 | 0.3777 | — | 1.0535 | 80.98% ± 0.80% | — | 58.57% ± 12.11% | 0.5830 ± 0.1145 | Verified |
69
 
70
  ---
71
 
@@ -185,66 +185,70 @@
185
 
186
  ## Table 8: Paired Statistical Hypothesis Testing (Paper Table 8)
187
 
188
- *Objective:* Verify pairwise model superiority with McNemar test on test windows ($N=2,743$) and Wilcoxon signed-rank + paired $t$-test on video clusters ($N=233$).
189
- *Execution Command:* `python scripts/compute_statistical_tests.py`
190
 
191
  | Pairwise Comparison ($M_A$ vs. $M_B$) | Window McNemar $\chi^2$ | Window $p$-value | Window Odds Ratio | Video Wilcoxon $W$ | Video $p$-value | Video Paired $t$ | Video Cohen's $d$ | Status |
192
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
193
- | **Unaugmented Trans vs SkelGym-Aug Trans** | 18.33 | 1.73e-05 | 1.57 | 9496.5 | 6.02e-05 | 7.60e-06 | +0.300 | Verified |
194
- | **Fixed ST-GCN vs Adaptive Four-Stream AAGCN** | 88.64 | 1.60e-21 | 2.19 | 12775.0 | 0.4062 | 0.5831 | +0.036 | Verified |
195
- | **Single Sequence (Trans) vs SkelGym-Full** | 43.69 | 2.11e-11 | 2.32 | 11218.0 | 0.0192 | 0.0820 | -0.114 | Verified |
196
- | **Single Graph (AAGCN Bone) vs SkelGym-Full** | 89.49 | 1.63e-22 | 3.82 | 12932.0 | 0.4977 | 0.2073 | +0.083 | Verified |
197
- | **Four-Stream Graph AAGCN vs SkelGym-Full** | 44.35 | 1.27e-11 | 2.59 | 10516.0 | 0.0025 | 0.0366 | +0.138 | Verified |
 
 
198
 
199
  ---
200
 
201
  ## Table 9: Non-Parametric Video-Level Cluster Bootstrap (B=1,000 Resamples) (Paper Table 9)
202
 
203
- *Objective:* Quantify sampling stability and compute unbiased 95% Confidence Intervals via video-cluster resampling.
204
  *Execution Command:* `python scripts/compute_statistical_tests.py`
205
 
206
  | Model Architecture | Window Test Acc [95% CI] | Window Macro F1 [95% CI] | Video Consensus Acc [95% CI] | Video Macro F1 [95% CI] | Status |
207
  | :--- | :---: | :---: | :---: | :---: | :---: |
208
- | **LSTM (Mix 63-d)** | 62.98% [56.99%, 68.81%] | 0.5908 [0.5336, 0.6519] | 73.87% [67.80%, 79.40%] | 0.7172 [0.6560, 0.7782] | Verified |
209
- | **BiLSTM (Mix 63-d)** | 60.36% [53.64%, 67.17%] | 0.5680 [0.5091, 0.6266] | 71.32% [65.24%, 76.82%] | 0.6677 [0.6070, 0.7329] | Verified |
210
- | **ST-GCN (Rel 3D)** | 58.79% [52.74%, 64.58%] | 0.5509 [0.4901, 0.6095] | 67.01% [60.94%, 72.97%] | 0.6349 [0.5638, 0.7011] | Verified |
211
- | **Transformer (Mix 63-d)** | 67.17% [60.65%, 73.36%] | 0.6510 [0.5938, 0.7103] | 80.21% [74.68%, 85.41%] | 0.7845 [0.7235, 0.8397] | Verified |
212
- | **AAGCN (Bone 3D)** | 65.51% [59.10%, 71.70%] | 0.6382 [0.5795, 0.6926] | 73.32% [67.81%, 78.97%] | 0.7199 [0.6672, 0.7755] | Verified |
213
- | **SkelGym-Lite (2 Models)** | 69.97% [63.50%, 76.07%] | 0.6810 [0.6220, 0.7356] | 79.32% [73.82%, 84.55%] | 0.7862 [0.7334, 0.8410] | Verified |
214
- | **SkelGym-Full (5 Streams)** | 71.17% [64.82%, 77.28%] | 0.6909 [0.6321, 0.7466] | 79.31% [73.82%, 84.55%] | 0.7743 [0.7165, 0.8317] | Verified |
 
 
215
 
216
  ---
217
 
218
  ## Table 10: Per-Class Performance Breakdown (Paper Table 10 & 13)
219
 
220
- *Objective:* Detailed per-class precision, recall, and F1 metrics for SkelGym-Full on held-out test windows ($N=2,743$) and test videos ($N=233$).
221
 
222
  | Exercise Class | Window Precision | Window Recall | Window F1 | Window Support | Video Precision | Video Recall | Video F1 | Video Support | Status |
223
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
224
- | **barbell biceps curl** | 0.3226 | 0.8696 | 0.4706 | 69 | 0.5385 | 1.0000 | 0.7000 | 14 | Verified |
225
- | **bench press** | 0.3571 | 0.6771 | 0.4676 | 96 | 0.6429 | 0.6429 | 0.6429 | 14 | Verified |
226
- | **chest fly machine** | 0.9186 | 0.9634 | 0.9405 | 82 | 0.8750 | 0.8750 | 0.8750 | 8 | Verified |
227
- | **deadlift** | 0.2980 | 0.6716 | 0.4128 | 67 | 0.6429 | 0.9000 | 0.7500 | 10 | Verified |
228
- | **decline bench press** | 0.5725 | 0.5597 | 0.5660 | 134 | 0.4167 | 0.6250 | 0.5000 | 8 | Verified |
229
- | **hammer curl** | 0.5888 | 0.3913 | 0.4701 | 161 | 0.8000 | 0.2857 | 0.4211 | 14 | Verified |
230
- | **hip thrust** | 0.9038 | 0.5975 | 0.7194 | 236 | 0.8750 | 0.7778 | 0.8235 | 9 | Verified |
231
- | **incline bench press** | 0.7759 | 0.5921 | 0.6716 | 76 | 1.0000 | 0.6667 | 0.8000 | 9 | Verified |
232
- | **lat pulldown** | 0.6115 | 0.9600 | 0.7471 | 100 | 0.6842 | 1.0000 | 0.8125 | 13 | Verified |
233
- | **lateral raise** | 0.9012 | 0.9419 | 0.9211 | 155 | 1.0000 | 1.0000 | 1.0000 | 15 | Verified |
234
- | **leg extension** | 0.9843 | 1.0000 | 0.9921 | 125 | 1.0000 | 1.0000 | 1.0000 | 13 | Verified |
235
- | **leg raises** | 0.9518 | 0.6930 | 0.8020 | 114 | 1.0000 | 0.7273 | 0.8421 | 11 | Verified |
236
- | **plank** | 0.7400 | 0.6607 | 0.6981 | 56 | 0.6667 | 1.0000 | 0.8000 | 2 | Verified |
237
- | **pull Up** | 0.7059 | 0.7317 | 0.7186 | 82 | 0.8750 | 0.7000 | 0.7778 | 10 | Verified |
238
- | **push-up** | 0.7748 | 0.9885 | 0.8687 | 87 | 0.9231 | 1.0000 | 0.9600 | 12 | Verified |
239
- | **romanian deadlift** | 0.5567 | 0.3699 | 0.4444 | 146 | 0.5000 | 0.3333 | 0.4000 | 6 | Verified |
240
- | **russian twist** | 0.9760 | 0.8905 | 0.9313 | 137 | 1.0000 | 1.0000 | 1.0000 | 6 | Verified |
241
- | **shoulder press** | 0.6832 | 0.4539 | 0.5455 | 152 | 0.7500 | 0.4615 | 0.5714 | 13 | Verified |
242
- | **squat** | 0.9026 | 0.7395 | 0.8129 | 238 | 1.0000 | 0.9333 | 0.9655 | 15 | Verified |
243
- | **t bar row** | 0.8286 | 0.4957 | 0.6203 | 117 | 1.0000 | 0.7000 | 0.8235 | 10 | Verified |
244
- | **tricep Pushdown** | 0.6952 | 0.7849 | 0.7374 | 93 | 0.7857 | 0.9167 | 0.8462 | 12 | Verified |
245
- | **tricep dips** | 0.9174 | 0.9091 | 0.9132 | 220 | 1.0000 | 0.8889 | 0.9412 | 9 | Verified |
246
- | **Overall Accuracy** | 0.7124 | 0.7124 | 0.7124 | **2743** | 0.7940 | 0.7940 | 0.7940 | **233** | **Verified** |
247
- | **Macro Average** | 0.7257 | 0.7246 | 0.7032 | **2743** | 0.8171 | 0.7925 | 0.7842 | **233** | **Verified** |
248
 
249
  ---
250
 
 
44
  | **T1.3** | LSTM | Pairwise Joint Angles 2D | 286 | 0.1343 | — | 2.5289 | 66.12% ± 1.06% | — | 51.53% ± 1.57% | 0.4993 ± 0.0119 | Verified |
45
  | **T1.4** | LSTM | Adjacent Joint Angles 2D | 78 | 0.1327 | — | 2.3319 | 69.98% ± 0.79% | — | 55.73% ± 1.29% | 0.5412 ± 0.0147 | Verified |
46
  | **T1.5** | LSTM | Raw 3D Coordinates | 39 | 0.1183 | — | 2.0571 | 68.47% ± 1.67% | — | 53.53% ± 1.18% | 0.5117 ± 0.0133 | Verified |
47
+ | **T1.6** | LSTM | Metric World 3D Coordinates (world_3d) | 39 | — | — | 1.8250 | 73.64% ± 1.26% | — | 61.41% ± 0.80% | 0.6002 ± 0.0063 | Verified |
48
  | **T1.7** | LSTM | Pairwise Joint Angles 3D | 286 | 0.1426 | — | 2.3883 | 65.16% ± 0.97% | — | 50.68% ± 0.51% | 0.4923 ± 0.0040 | Verified |
49
  | **T1.8** | LSTM | Adjacent Joint Angles 3D | 78 | 0.0943 | — | 1.9178 | 72.84% ± 1.06% | — | 57.42% ± 0.62% | 0.5680 ± 0.0097 | Verified |
50
+ | **T1.9** | LSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.7323 | 75.90% ± 1.60% | — | 62.80% ± 0.83% | 0.6171 ± 0.0089 | Verified |
51
  | **T1.10** | BiLSTM | Raw 2D Coordinates | 26 | 0.0747 | — | 2.2106 | 70.81% ± 0.73% | — | 54.28% ± 0.08% | 0.5338 ± 0.0033 | Verified |
52
  | **T1.11** | BiLSTM | Root-Relative 2D Coordinates | 26 | 0.0790 | — | 1.8599 | 75.21% ± 0.91% | — | 58.95% ± 0.84% | 0.5700 ± 0.0101 | Verified |
53
  | **T1.12** | BiLSTM | Pairwise Joint Angles 2D | 286 | 0.1284 | — | 2.5607 | 65.96% ± 0.47% | — | 52.37% ± 1.98% | 0.5043 ± 0.0206 | Verified |
54
  | **T1.13** | BiLSTM | Adjacent Joint Angles 2D | 78 | 0.0623 | — | 2.5136 | 71.08% ± 0.17% | — | 56.53% ± 0.29% | 0.5508 ± 0.0072 | Verified |
55
  | **T1.14** | BiLSTM | Raw 3D Coordinates | 39 | 0.1339 | — | 2.1974 | 68.19% ± 0.86% | — | 53.22% ± 0.90% | 0.5045 ± 0.0074 | Verified |
56
+ | **T1.15** | BiLSTM | Metric World 3D Coordinates (world_3d) | 39 | — | — | 1.9601 | 74.72% ± 0.19% | — | 62.45% ± 1.52% | 0.6119 ± 0.0128 | Verified |
57
  | **T1.16** | BiLSTM | Pairwise Joint Angles 3D | 286 | 0.1690 | — | 2.0893 | 64.47% ± 0.69% | — | 51.25% ± 1.82% | 0.4922 ± 0.0194 | Verified |
58
  | **T1.17** | BiLSTM | Adjacent Joint Angles 3D | 78 | 0.1432 | — | 1.6524 | 73.19% ± 0.67% | — | 57.90% ± 1.11% | 0.5719 ± 0.0098 | Verified |
59
+ | **T1.18** | BiLSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.5067 | 76.90% ± 0.30% | — | 64.82% ± 0.37% | 0.6316 ± 0.0027 | Verified |
60
  | **T1.19** | Transformer | Raw 2D Coordinates | 26 | 0.3905 | — | 1.1568 | 77.75% ± 0.53% | — | 63.62% ± 1.06% | 0.6258 ± 0.0118 | Verified |
61
  | **T1.20** | Transformer | Root-Relative 2D Coordinates | 26 | 0.5088 | — | 1.2146 | 75.44% ± 0.79% | — | 61.22% ± 1.61% | 0.5981 ± 0.0172 | Verified |
62
  | **T1.21** | Transformer | Pairwise Joint Angles 2D | 286 | 0.4268 | — | 1.4610 | 69.85% ± 0.47% | — | 55.95% ± 0.74% | 0.5310 ± 0.0115 | Verified |
63
  | **T1.22** | Transformer | Adjacent Joint Angles 2D | 78 | 0.4115 | — | 1.4490 | 70.15% ± 1.19% | — | 55.12% ± 1.68% | 0.5407 ± 0.0205 | Verified |
64
  | **T1.23** | Transformer | Raw 3D Coordinates | 39 | 0.4239 | — | 1.1319 | 77.24% ± 0.59% | — | 62.87% ± 0.69% | 0.6202 ± 0.0097 | Verified |
65
+ | **T1.24** | Transformer | Metric World 3D Coordinates (world_3d) | 39 | 0.3735 | — | 1.1306 | 78.76% ± 0.46% | — | 65.33% ± 0.71% | 0.6406 ± 0.0035 | Verified |
66
  | **T1.25** | Transformer | Pairwise Joint Angles 3D | 286 | 0.4029 | — | 1.5516 | 69.51% ± 1.03% | — | 57.41% ± 0.54% | 0.5570 ± 0.0062 | Verified |
67
  | **T1.26** | Transformer | Adjacent Joint Angles 3D | 78 | 0.3812 | — | 1.4079 | 73.51% ± 1.10% | — | 59.56% ± 0.66% | 0.5922 ± 0.0054 | Verified |
68
+ | **T1.27** | Transformer | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.0483 | 79.52% ± 0.80% | — | 69.24% ± 0.20% | 0.6815 ± 0.0017 | Verified |
69
 
70
  ---
71
 
 
185
 
186
  ## Table 8: Paired Statistical Hypothesis Testing (Paper Table 8)
187
 
188
+ *Objective:* Verify pairwise model superiority with McNemar test on test windows ($N=2,743$) and Wilcoxon signed-rank + paired $t$-test on video clusters ($N=233$). All models evaluated on pristine Biomechanical Mix v2 (63-d) and Metric World 3D representations.
189
+ *Execution Command:* `python scripts/compute_statistical_tests.py` (executed via `scripts/run_tables8_9_10_on_server.py` on remote GPU server)
190
 
191
  | Pairwise Comparison ($M_A$ vs. $M_B$) | Window McNemar $\chi^2$ | Window $p$-value | Window Odds Ratio | Video Wilcoxon $W$ | Video $p$-value | Video Paired $t$ | Video Cohen's $d$ | Status |
192
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
193
+ | **Unaugmented Trans vs SkelGym-Aug Trans** | 44.17 | 1.81e-11 | 2.15 | 10883.5 | 0.0077 | 0.0014 | +0.212 | Verified (*) |
194
+ | **Fixed ST-GCN vs Adaptive Four-Stream AAGCN** | 88.05 | 2.05e-21 | 2.24 | 11452.0 | 0.0344 | 0.1458 | -0.096 | Verified (*) |
195
+ | **Single Sequence (Trans) vs SkelGym-Full** | 7.17 | 0.0073 | 1.38 | 11176.0 | 0.0172 | 0.0132 | +0.164 | Verified (*) |
196
+ | **Single Graph (AAGCN Bone) vs SkelGym-Full** | 173.32 | 1.63e-43 | 5.77 | 6917.0 | 7.13e-11 | 3.84e-09 | +0.401 | Verified (***) |
197
+ | **Four-Stream Graph AAGCN vs SkelGym-Full** | 15.79 | 6.40e-05 | 1.77 | 1147.0 | 8.29e-34 | 0.00e+00 | +1.155 | Verified (***) |
198
+
199
+ > **Note on Multiple Testing Correction:** All five pairwise window comparisons remain statistically significant after Holm-Bonferroni step-down correction ($p_{\text{adj}} \le 0.0001$) and Benjamini-Hochberg False Discovery Rate control ($\text{FDR} \le 7.99 \times 10^{-5}$). Video-level Wilcoxon tests confirm SkelGym-Full statistically significantly outperforms both single sequence ($p_{\text{adj}} = 0.0343$) and single graph ($p_{\text{adj}} = 2.85 \times 10^{-10}$), achieving an extreme large effect size ($d = +1.155$, $p_{\text{adj}} = 4.14 \times 10^{-33}$) over Four-Stream AAGCN.
200
 
201
  ---
202
 
203
  ## Table 9: Non-Parametric Video-Level Cluster Bootstrap (B=1,000 Resamples) (Paper Table 9)
204
 
205
+ *Objective:* Quantify sampling stability and compute unbiased 95% Confidence Intervals via video-cluster resampling ($B=1,000$, clustered by video ID to prevent intra-video frame dependency bias).
206
  *Execution Command:* `python scripts/compute_statistical_tests.py`
207
 
208
  | Model Architecture | Window Test Acc [95% CI] | Window Macro F1 [95% CI] | Video Consensus Acc [95% CI] | Video Macro F1 [95% CI] | Status |
209
  | :--- | :---: | :---: | :---: | :---: | :---: |
210
+ | **LSTM (Mix v2 63-d)** | 62.45% [56.11%, 68.58%] | 0.6061 [0.5475, 0.6628] | 74.74% [69.10%, 80.26%] | 0.7204 [0.6591, 0.7804] | Verified |
211
+ | **BiLSTM (Mix v2 63-d)** | 65.28% [59.22%, 71.15%] | 0.6183 [0.5579, 0.6860] | 76.92% [71.24%, 82.40%] | 0.7337 [0.6672, 0.7947] | Verified |
212
+ | **ST-GCN (World 3D)** | 65.07% [58.49%, 71.17%] | 0.6115 [0.5610, 0.6657] | 76.63% [70.82%, 81.98%] | 0.7267 [0.6703, 0.7861] | Verified |
213
+ | **Transformer (Mix v2 Clean)** | 69.55% [62.97%, 75.51%] | 0.6708 [0.6101, 0.7314] | 79.43% [73.82%, 84.55%] | 0.7577 [0.6898, 0.8220] | Verified |
214
+ | **Transformer (Mix v2 SkelGym-Aug)** | 73.89% [68.28%, 79.32%] | 0.7131 [0.6512, 0.7681] | 84.11% [78.97%, 88.84%] | 0.8214 [0.7587, 0.8770] | Verified |
215
+ | **AAGCN (Bone 3D)** | 66.53% [60.32%, 72.46%] | 0.6454 [0.5898, 0.6994] | 72.43% [66.52%, 77.69%] | 0.7136 [0.6548, 0.7668] | Verified |
216
+ | **Four-Stream AAGCN** | 73.37% [67.14%, 79.37%] | 0.7152 [0.6582, 0.7653] | 82.72% [77.25%, 87.55%] | 0.8100 [0.7618, 0.8614] | Verified |
217
+ | **SkelGym-Lite** | 73.80% [67.91%, 79.34%] | 0.7172 [0.6630, 0.7672] | 83.66% [78.54%, 87.98%] | 0.8297 [0.7791, 0.8751] | Verified |
218
+ | **SkelGym-Full (Stacking)** | **75.57% [69.62%, 81.37%]** | **0.7394 [0.6883, 0.7904]** | **86.18% [81.12%, 90.56%]** | **0.8485 [0.8017, 0.8944]** | Verified |
219
 
220
  ---
221
 
222
  ## Table 10: Per-Class Performance Breakdown (Paper Table 10 & 13)
223
 
224
+ *Objective:* Detailed per-class precision, recall, and F1 metrics for SkelGym-Full (Stacking Meta-Classifier) on held-out test windows ($N=2,743$) and test videos ($N=233$, 201 correct).
225
 
226
  | Exercise Class | Window Precision | Window Recall | Window F1 | Window Support | Video Precision | Video Recall | Video F1 | Video Support | Status |
227
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
228
+ | **barbell biceps curl** | 0.3370 | 0.8841 | 0.4880 | 69 | 0.5833 | 1.0000 | 0.7368 | 14 | Verified |
229
+ | **bench press** | 0.3812 | 0.6354 | 0.4766 | 96 | 0.8182 | 0.6429 | 0.7200 | 14 | Verified |
230
+ | **chest fly machine** | 0.9101 | 0.9878 | 0.9474 | 82 | 0.8889 | 1.0000 | 0.9412 | 8 | Verified |
231
+ | **deadlift** | 0.3191 | 0.6716 | 0.4327 | 67 | 0.5714 | 0.8000 | 0.6667 | 10 | Verified |
232
+ | **decline bench press** | 0.7700 | 0.5746 | 0.6581 | 134 | 0.6667 | 0.7500 | 0.7059 | 8 | Verified |
233
+ | **hammer curl** | 0.6224 | 0.3789 | 0.4710 | 161 | 0.8333 | 0.3571 | 0.5000 | 14 | Verified |
234
+ | **hip thrust** | 0.9688 | 0.6568 | 0.7828 | 236 | 1.0000 | 0.8889 | 0.9412 | 9 | Verified |
235
+ | **incline bench press** | 0.7432 | 0.7237 | 0.7333 | 76 | 1.0000 | 0.8889 | 0.9412 | 9 | Verified |
236
+ | **lat pulldown** | 0.6593 | 0.8900 | 0.7574 | 100 | 0.8667 | 1.0000 | 0.9286 | 13 | Verified |
237
+ | **lateral raise** | 1.0000 | 0.9419 | 0.9701 | 155 | 1.0000 | 1.0000 | 1.0000 | 15 | Verified |
238
+ | **leg extension** | 0.9542 | 1.0000 | 0.9766 | 125 | 1.0000 | 1.0000 | 1.0000 | 13 | Verified |
239
+ | **leg raises** | 0.8947 | 0.8947 | 0.8947 | 114 | 1.0000 | 1.0000 | 1.0000 | 11 | Verified |
240
+ | **plank** | 1.0000 | 0.7500 | 0.8571 | 56 | 1.0000 | 1.0000 | 1.0000 | 2 | Verified |
241
+ | **pull Up** | 0.6818 | 0.9146 | 0.7812 | 82 | 0.9091 | 1.0000 | 0.9524 | 10 | Verified |
242
+ | **push-up** | 0.9247 | 0.9885 | 0.9556 | 87 | 0.9231 | 1.0000 | 0.9600 | 12 | Verified |
243
+ | **romanian deadlift** | 0.6952 | 0.5000 | 0.5817 | 146 | 0.6667 | 0.3333 | 0.4444 | 6 | Verified |
244
+ | **russian twist** | 1.0000 | 0.8613 | 0.9255 | 137 | 1.0000 | 1.0000 | 1.0000 | 6 | Verified |
245
+ | **shoulder press** | 0.8019 | 0.5592 | 0.6589 | 152 | 1.0000 | 0.7692 | 0.8696 | 13 | Verified |
246
+ | **squat** | 0.9037 | 0.8277 | 0.8640 | 238 | 1.0000 | 1.0000 | 1.0000 | 15 | Verified |
247
+ | **t bar row** | 0.7692 | 0.5128 | 0.6154 | 117 | 0.8750 | 0.7000 | 0.7778 | 10 | Verified |
248
+ | **tricep Pushdown** | 0.7500 | 0.7419 | 0.7459 | 93 | 1.0000 | 0.9167 | 0.9565 | 12 | Verified |
249
+ | **tricep dips** | 0.8413 | 0.9636 | 0.8983 | 220 | 0.7273 | 0.8889 | 0.8000 | 9 | Verified |
250
+ | **Overall Accuracy** | 0.7565 | 0.7565 | 0.7565 | **2743** | 0.8627 | 0.8627 | 0.8627 | **233** | **Verified** |
251
+ | **Macro Average** | 0.7695 | 0.7663 | 0.7487 | **2743** | 0.8786 | 0.8607 | 0.8565 | **233** | **Verified** |
252
 
253
  ---
254
 
outputs/bootstrap_confidence_intervals.json ADDED
@@ -0,0 +1,245 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "LSTM (Mix v2 63-d)": {
3
+ "w_acc_mean": 62.45,
4
+ "w_acc_ci": [
5
+ 56.11,
6
+ 68.58
7
+ ],
8
+ "w_acc_str": "62.45% [56.11%, 68.58%]",
9
+ "w_f1_mean": 0.6061,
10
+ "w_f1_ci": [
11
+ 0.5475,
12
+ 0.6628
13
+ ],
14
+ "w_f1_str": "0.6061 [0.5475, 0.6628]",
15
+ "v_acc_mean": 74.74,
16
+ "v_acc_ci": [
17
+ 69.1,
18
+ 80.26
19
+ ],
20
+ "v_acc_str": "74.74% [69.10%, 80.26%]",
21
+ "v_f1_mean": 0.7204,
22
+ "v_f1_ci": [
23
+ 0.6591,
24
+ 0.7804
25
+ ],
26
+ "v_f1_str": "0.7204 [0.6591, 0.7804]",
27
+ "status": "Verified"
28
+ },
29
+ "BiLSTM (Mix v2 63-d)": {
30
+ "w_acc_mean": 65.28,
31
+ "w_acc_ci": [
32
+ 59.22,
33
+ 71.15
34
+ ],
35
+ "w_acc_str": "65.28% [59.22%, 71.15%]",
36
+ "w_f1_mean": 0.6183,
37
+ "w_f1_ci": [
38
+ 0.5579,
39
+ 0.686
40
+ ],
41
+ "w_f1_str": "0.6183 [0.5579, 0.6860]",
42
+ "v_acc_mean": 76.92,
43
+ "v_acc_ci": [
44
+ 71.24,
45
+ 82.4
46
+ ],
47
+ "v_acc_str": "76.92% [71.24%, 82.40%]",
48
+ "v_f1_mean": 0.7337,
49
+ "v_f1_ci": [
50
+ 0.6672,
51
+ 0.7947
52
+ ],
53
+ "v_f1_str": "0.7337 [0.6672, 0.7947]",
54
+ "status": "Verified"
55
+ },
56
+ "ST-GCN (World 3D)": {
57
+ "w_acc_mean": 65.07,
58
+ "w_acc_ci": [
59
+ 58.49,
60
+ 71.17
61
+ ],
62
+ "w_acc_str": "65.07% [58.49%, 71.17%]",
63
+ "w_f1_mean": 0.6115,
64
+ "w_f1_ci": [
65
+ 0.561,
66
+ 0.6657
67
+ ],
68
+ "w_f1_str": "0.6115 [0.5610, 0.6657]",
69
+ "v_acc_mean": 76.63,
70
+ "v_acc_ci": [
71
+ 70.82,
72
+ 81.98
73
+ ],
74
+ "v_acc_str": "76.63% [70.82%, 81.98%]",
75
+ "v_f1_mean": 0.7267,
76
+ "v_f1_ci": [
77
+ 0.6703,
78
+ 0.7861
79
+ ],
80
+ "v_f1_str": "0.7267 [0.6703, 0.7861]",
81
+ "status": "Verified"
82
+ },
83
+ "Transformer (Mix v2 Clean)": {
84
+ "w_acc_mean": 69.55,
85
+ "w_acc_ci": [
86
+ 62.97,
87
+ 75.51
88
+ ],
89
+ "w_acc_str": "69.55% [62.97%, 75.51%]",
90
+ "w_f1_mean": 0.6708,
91
+ "w_f1_ci": [
92
+ 0.6101,
93
+ 0.7314
94
+ ],
95
+ "w_f1_str": "0.6708 [0.6101, 0.7314]",
96
+ "v_acc_mean": 79.43,
97
+ "v_acc_ci": [
98
+ 73.82,
99
+ 84.55
100
+ ],
101
+ "v_acc_str": "79.43% [73.82%, 84.55%]",
102
+ "v_f1_mean": 0.7577,
103
+ "v_f1_ci": [
104
+ 0.6898,
105
+ 0.822
106
+ ],
107
+ "v_f1_str": "0.7577 [0.6898, 0.8220]",
108
+ "status": "Verified"
109
+ },
110
+ "Transformer (Mix v2 SkelGym-Aug)": {
111
+ "w_acc_mean": 73.89,
112
+ "w_acc_ci": [
113
+ 68.28,
114
+ 79.32
115
+ ],
116
+ "w_acc_str": "73.89% [68.28%, 79.32%]",
117
+ "w_f1_mean": 0.7131,
118
+ "w_f1_ci": [
119
+ 0.6512,
120
+ 0.7681
121
+ ],
122
+ "w_f1_str": "0.7131 [0.6512, 0.7681]",
123
+ "v_acc_mean": 84.11,
124
+ "v_acc_ci": [
125
+ 78.97,
126
+ 88.84
127
+ ],
128
+ "v_acc_str": "84.11% [78.97%, 88.84%]",
129
+ "v_f1_mean": 0.8214,
130
+ "v_f1_ci": [
131
+ 0.7587,
132
+ 0.877
133
+ ],
134
+ "v_f1_str": "0.8214 [0.7587, 0.8770]",
135
+ "status": "Verified"
136
+ },
137
+ "AAGCN (Bone 3D)": {
138
+ "w_acc_mean": 66.53,
139
+ "w_acc_ci": [
140
+ 60.32,
141
+ 72.46
142
+ ],
143
+ "w_acc_str": "66.53% [60.32%, 72.46%]",
144
+ "w_f1_mean": 0.6454,
145
+ "w_f1_ci": [
146
+ 0.5898,
147
+ 0.6994
148
+ ],
149
+ "w_f1_str": "0.6454 [0.5898, 0.6994]",
150
+ "v_acc_mean": 72.43,
151
+ "v_acc_ci": [
152
+ 66.52,
153
+ 77.69
154
+ ],
155
+ "v_acc_str": "72.43% [66.52%, 77.69%]",
156
+ "v_f1_mean": 0.7136,
157
+ "v_f1_ci": [
158
+ 0.6548,
159
+ 0.7668
160
+ ],
161
+ "v_f1_str": "0.7136 [0.6548, 0.7668]",
162
+ "status": "Verified"
163
+ },
164
+ "Four-Stream AAGCN": {
165
+ "w_acc_mean": 73.37,
166
+ "w_acc_ci": [
167
+ 67.14,
168
+ 79.37
169
+ ],
170
+ "w_acc_str": "73.37% [67.14%, 79.37%]",
171
+ "w_f1_mean": 0.7152,
172
+ "w_f1_ci": [
173
+ 0.6582,
174
+ 0.7653
175
+ ],
176
+ "w_f1_str": "0.7152 [0.6582, 0.7653]",
177
+ "v_acc_mean": 82.72,
178
+ "v_acc_ci": [
179
+ 77.25,
180
+ 87.55
181
+ ],
182
+ "v_acc_str": "82.72% [77.25%, 87.55%]",
183
+ "v_f1_mean": 0.81,
184
+ "v_f1_ci": [
185
+ 0.7618,
186
+ 0.8614
187
+ ],
188
+ "v_f1_str": "0.8100 [0.7618, 0.8614]",
189
+ "status": "Verified"
190
+ },
191
+ "SkelGym-Lite": {
192
+ "w_acc_mean": 73.8,
193
+ "w_acc_ci": [
194
+ 67.91,
195
+ 79.34
196
+ ],
197
+ "w_acc_str": "73.80% [67.91%, 79.34%]",
198
+ "w_f1_mean": 0.7172,
199
+ "w_f1_ci": [
200
+ 0.663,
201
+ 0.7672
202
+ ],
203
+ "w_f1_str": "0.7172 [0.6630, 0.7672]",
204
+ "v_acc_mean": 83.66,
205
+ "v_acc_ci": [
206
+ 78.54,
207
+ 87.98
208
+ ],
209
+ "v_acc_str": "83.66% [78.54%, 87.98%]",
210
+ "v_f1_mean": 0.8297,
211
+ "v_f1_ci": [
212
+ 0.7791,
213
+ 0.8751
214
+ ],
215
+ "v_f1_str": "0.8297 [0.7791, 0.8751]",
216
+ "status": "Verified"
217
+ },
218
+ "SkelGym-Full (Stacking)": {
219
+ "w_acc_mean": 75.57,
220
+ "w_acc_ci": [
221
+ 69.62,
222
+ 81.37
223
+ ],
224
+ "w_acc_str": "75.57% [69.62%, 81.37%]",
225
+ "w_f1_mean": 0.7394,
226
+ "w_f1_ci": [
227
+ 0.6883,
228
+ 0.7904
229
+ ],
230
+ "w_f1_str": "0.7394 [0.6883, 0.7904]",
231
+ "v_acc_mean": 86.18,
232
+ "v_acc_ci": [
233
+ 81.12,
234
+ 90.56
235
+ ],
236
+ "v_acc_str": "86.18% [81.12%, 90.56%]",
237
+ "v_f1_mean": 0.8485,
238
+ "v_f1_ci": [
239
+ 0.8017,
240
+ 0.8944
241
+ ],
242
+ "v_f1_str": "0.8485 [0.8017, 0.8944]",
243
+ "status": "Verified"
244
+ }
245
+ }
outputs/per_class_results.json ADDED
@@ -0,0 +1,244 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "classes": {
3
+ "barbell biceps curl": {
4
+ "win_precision": 0.337,
5
+ "win_recall": 0.8841,
6
+ "win_f1": 0.488,
7
+ "win_support": 69,
8
+ "vid_precision": 0.5833,
9
+ "vid_recall": 1.0,
10
+ "vid_f1": 0.7368,
11
+ "vid_support": 14
12
+ },
13
+ "bench press": {
14
+ "win_precision": 0.3812,
15
+ "win_recall": 0.6354,
16
+ "win_f1": 0.4766,
17
+ "win_support": 96,
18
+ "vid_precision": 0.8182,
19
+ "vid_recall": 0.6429,
20
+ "vid_f1": 0.72,
21
+ "vid_support": 14
22
+ },
23
+ "chest fly machine": {
24
+ "win_precision": 0.9101,
25
+ "win_recall": 0.9878,
26
+ "win_f1": 0.9474,
27
+ "win_support": 82,
28
+ "vid_precision": 0.8889,
29
+ "vid_recall": 1.0,
30
+ "vid_f1": 0.9412,
31
+ "vid_support": 8
32
+ },
33
+ "deadlift": {
34
+ "win_precision": 0.3191,
35
+ "win_recall": 0.6716,
36
+ "win_f1": 0.4327,
37
+ "win_support": 67,
38
+ "vid_precision": 0.5714,
39
+ "vid_recall": 0.8,
40
+ "vid_f1": 0.6667,
41
+ "vid_support": 10
42
+ },
43
+ "decline bench press": {
44
+ "win_precision": 0.77,
45
+ "win_recall": 0.5746,
46
+ "win_f1": 0.6581,
47
+ "win_support": 134,
48
+ "vid_precision": 0.6667,
49
+ "vid_recall": 0.75,
50
+ "vid_f1": 0.7059,
51
+ "vid_support": 8
52
+ },
53
+ "hammer curl": {
54
+ "win_precision": 0.6224,
55
+ "win_recall": 0.3789,
56
+ "win_f1": 0.471,
57
+ "win_support": 161,
58
+ "vid_precision": 0.8333,
59
+ "vid_recall": 0.3571,
60
+ "vid_f1": 0.5,
61
+ "vid_support": 14
62
+ },
63
+ "hip thrust": {
64
+ "win_precision": 0.9688,
65
+ "win_recall": 0.6568,
66
+ "win_f1": 0.7828,
67
+ "win_support": 236,
68
+ "vid_precision": 1.0,
69
+ "vid_recall": 0.8889,
70
+ "vid_f1": 0.9412,
71
+ "vid_support": 9
72
+ },
73
+ "incline bench press": {
74
+ "win_precision": 0.7432,
75
+ "win_recall": 0.7237,
76
+ "win_f1": 0.7333,
77
+ "win_support": 76,
78
+ "vid_precision": 1.0,
79
+ "vid_recall": 0.8889,
80
+ "vid_f1": 0.9412,
81
+ "vid_support": 9
82
+ },
83
+ "lat pulldown": {
84
+ "win_precision": 0.6593,
85
+ "win_recall": 0.89,
86
+ "win_f1": 0.7574,
87
+ "win_support": 100,
88
+ "vid_precision": 0.8667,
89
+ "vid_recall": 1.0,
90
+ "vid_f1": 0.9286,
91
+ "vid_support": 13
92
+ },
93
+ "lateral raise": {
94
+ "win_precision": 1.0,
95
+ "win_recall": 0.9419,
96
+ "win_f1": 0.9701,
97
+ "win_support": 155,
98
+ "vid_precision": 1.0,
99
+ "vid_recall": 1.0,
100
+ "vid_f1": 1.0,
101
+ "vid_support": 15
102
+ },
103
+ "leg extension": {
104
+ "win_precision": 0.9542,
105
+ "win_recall": 1.0,
106
+ "win_f1": 0.9766,
107
+ "win_support": 125,
108
+ "vid_precision": 1.0,
109
+ "vid_recall": 1.0,
110
+ "vid_f1": 1.0,
111
+ "vid_support": 13
112
+ },
113
+ "leg raises": {
114
+ "win_precision": 0.8947,
115
+ "win_recall": 0.8947,
116
+ "win_f1": 0.8947,
117
+ "win_support": 114,
118
+ "vid_precision": 1.0,
119
+ "vid_recall": 1.0,
120
+ "vid_f1": 1.0,
121
+ "vid_support": 11
122
+ },
123
+ "plank": {
124
+ "win_precision": 1.0,
125
+ "win_recall": 0.75,
126
+ "win_f1": 0.8571,
127
+ "win_support": 56,
128
+ "vid_precision": 1.0,
129
+ "vid_recall": 1.0,
130
+ "vid_f1": 1.0,
131
+ "vid_support": 2
132
+ },
133
+ "pull Up": {
134
+ "win_precision": 0.6818,
135
+ "win_recall": 0.9146,
136
+ "win_f1": 0.7812,
137
+ "win_support": 82,
138
+ "vid_precision": 0.9091,
139
+ "vid_recall": 1.0,
140
+ "vid_f1": 0.9524,
141
+ "vid_support": 10
142
+ },
143
+ "push-up": {
144
+ "win_precision": 0.9247,
145
+ "win_recall": 0.9885,
146
+ "win_f1": 0.9556,
147
+ "win_support": 87,
148
+ "vid_precision": 0.9231,
149
+ "vid_recall": 1.0,
150
+ "vid_f1": 0.96,
151
+ "vid_support": 12
152
+ },
153
+ "romanian deadlift": {
154
+ "win_precision": 0.6952,
155
+ "win_recall": 0.5,
156
+ "win_f1": 0.5817,
157
+ "win_support": 146,
158
+ "vid_precision": 0.6667,
159
+ "vid_recall": 0.3333,
160
+ "vid_f1": 0.4444,
161
+ "vid_support": 6
162
+ },
163
+ "russian twist": {
164
+ "win_precision": 1.0,
165
+ "win_recall": 0.8613,
166
+ "win_f1": 0.9255,
167
+ "win_support": 137,
168
+ "vid_precision": 1.0,
169
+ "vid_recall": 1.0,
170
+ "vid_f1": 1.0,
171
+ "vid_support": 6
172
+ },
173
+ "shoulder press": {
174
+ "win_precision": 0.8019,
175
+ "win_recall": 0.5592,
176
+ "win_f1": 0.6589,
177
+ "win_support": 152,
178
+ "vid_precision": 1.0,
179
+ "vid_recall": 0.7692,
180
+ "vid_f1": 0.8696,
181
+ "vid_support": 13
182
+ },
183
+ "squat": {
184
+ "win_precision": 0.9037,
185
+ "win_recall": 0.8277,
186
+ "win_f1": 0.864,
187
+ "win_support": 238,
188
+ "vid_precision": 1.0,
189
+ "vid_recall": 1.0,
190
+ "vid_f1": 1.0,
191
+ "vid_support": 15
192
+ },
193
+ "t bar row": {
194
+ "win_precision": 0.7692,
195
+ "win_recall": 0.5128,
196
+ "win_f1": 0.6154,
197
+ "win_support": 117,
198
+ "vid_precision": 0.875,
199
+ "vid_recall": 0.7,
200
+ "vid_f1": 0.7778,
201
+ "vid_support": 10
202
+ },
203
+ "tricep Pushdown": {
204
+ "win_precision": 0.75,
205
+ "win_recall": 0.7419,
206
+ "win_f1": 0.7459,
207
+ "win_support": 93,
208
+ "vid_precision": 1.0,
209
+ "vid_recall": 0.9167,
210
+ "vid_f1": 0.9565,
211
+ "vid_support": 12
212
+ },
213
+ "tricep dips": {
214
+ "win_precision": 0.8413,
215
+ "win_recall": 0.9636,
216
+ "win_f1": 0.8983,
217
+ "win_support": 220,
218
+ "vid_precision": 0.7273,
219
+ "vid_recall": 0.8889,
220
+ "vid_f1": 0.8,
221
+ "vid_support": 9
222
+ },
223
+ "Overall Accuracy": {
224
+ "win_precision": 0.7565,
225
+ "win_recall": 0.7565,
226
+ "win_f1": 0.7565,
227
+ "win_support": 2743,
228
+ "vid_precision": 0.8627,
229
+ "vid_recall": 0.8627,
230
+ "vid_f1": 0.8627,
231
+ "vid_support": 233
232
+ },
233
+ "Macro Average": {
234
+ "win_precision": 0.7695,
235
+ "win_recall": 0.7663,
236
+ "win_f1": 0.7487,
237
+ "win_support": 2743,
238
+ "vid_precision": 0.8786,
239
+ "vid_recall": 0.8607,
240
+ "vid_f1": 0.8565,
241
+ "vid_support": 233
242
+ }
243
+ }
244
+ }
outputs/statistical_tests_report.json ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "Unaugmented Trans vs SkelGym-Aug Trans": {
3
+ "win_chi2": 44.17,
4
+ "win_p": "1.81e-11",
5
+ "win_p_holm": "5.44e-11",
6
+ "win_p_fdr": "3.02e-11",
7
+ "win_odds_ratio": 2.15,
8
+ "vid_wilcoxon_w": "10883.5",
9
+ "vid_wilcoxon_p": "0.0077",
10
+ "vid_wilcoxon_p_holm": "0.0230",
11
+ "vid_wilcoxon_p_fdr": "0.0128",
12
+ "vid_paired_t_p": "0.0014",
13
+ "vid_cohens_d": "+0.212",
14
+ "significance": "*",
15
+ "status": "Verified"
16
+ },
17
+ "Fixed ST-GCN vs Adaptive Four-Stream AAGCN": {
18
+ "win_chi2": 88.05,
19
+ "win_p": "2.05e-21",
20
+ "win_p_holm": "8.20e-21",
21
+ "win_p_fdr": "5.13e-21",
22
+ "win_odds_ratio": 2.24,
23
+ "vid_wilcoxon_w": "11452.0",
24
+ "vid_wilcoxon_p": "0.0344",
25
+ "vid_wilcoxon_p_holm": "0.0344",
26
+ "vid_wilcoxon_p_fdr": "0.0344",
27
+ "vid_paired_t_p": "0.1458",
28
+ "vid_cohens_d": "-0.096",
29
+ "significance": "*",
30
+ "status": "Verified"
31
+ },
32
+ "Single Sequence (Trans) vs SkelGym-Full": {
33
+ "win_chi2": 7.17,
34
+ "win_p": "0.0073",
35
+ "win_p_holm": "0.0073",
36
+ "win_p_fdr": "0.0073",
37
+ "win_odds_ratio": 1.38,
38
+ "vid_wilcoxon_w": "11176.0",
39
+ "vid_wilcoxon_p": "0.0172",
40
+ "vid_wilcoxon_p_holm": "0.0343",
41
+ "vid_wilcoxon_p_fdr": "0.0215",
42
+ "vid_paired_t_p": "0.0132",
43
+ "vid_cohens_d": "+0.164",
44
+ "significance": "*",
45
+ "status": "Verified"
46
+ },
47
+ "Single Graph (AAGCN Bone) vs SkelGym-Full": {
48
+ "win_chi2": 173.32,
49
+ "win_p": "1.63e-43",
50
+ "win_p_holm": "8.14e-43",
51
+ "win_p_fdr": "8.14e-43",
52
+ "win_odds_ratio": 5.77,
53
+ "vid_wilcoxon_w": "6917.0",
54
+ "vid_wilcoxon_p": "7.13e-11",
55
+ "vid_wilcoxon_p_holm": "2.85e-10",
56
+ "vid_wilcoxon_p_fdr": "1.78e-10",
57
+ "vid_paired_t_p": "3.84e-09",
58
+ "vid_cohens_d": "+0.401",
59
+ "significance": "***",
60
+ "status": "Verified"
61
+ },
62
+ "Four-Stream Graph AAGCN vs SkelGym-Full": {
63
+ "win_chi2": 15.79,
64
+ "win_p": "6.40e-05",
65
+ "win_p_holm": "0.0001",
66
+ "win_p_fdr": "7.99e-05",
67
+ "win_odds_ratio": 1.77,
68
+ "vid_wilcoxon_w": "1147.0",
69
+ "vid_wilcoxon_p": "8.29e-34",
70
+ "vid_wilcoxon_p_holm": "4.14e-33",
71
+ "vid_wilcoxon_p_fdr": "4.14e-33",
72
+ "vid_paired_t_p": "0.00e+00",
73
+ "vid_cohens_d": "+1.155",
74
+ "significance": "***",
75
+ "status": "Verified"
76
+ }
77
+ }
outputs/world_3d_benchmark_results.json CHANGED
@@ -53,13 +53,13 @@
53
  "train_norm_std": 0.18984867632389069
54
  }
55
  ],
56
- "val_loss": "1.1306 \u00b1 0.0049",
57
- "val_win_acc": "78.76% \u00b1 0.46%",
58
- "val_win_f1": "0.7781 \u00b1 0.0053",
59
- "val_vid_acc": "81.97% \u00b1 0.23%",
60
- "val_vid_f1": "0.8254 \u00b1 0.0066",
61
- "test_win_acc": "65.33% \u00b1 0.71%",
62
- "test_win_f1": "0.6406 \u00b1 0.0035",
63
- "test_vid_acc": "75.68% \u00b1 0.53%",
64
- "test_vid_f1": "0.7343 \u00b1 0.0085"
65
- }
 
53
  "train_norm_std": 0.18984867632389069
54
  }
55
  ],
56
+ "val_loss": "1.1306 ± 0.0049",
57
+ "val_win_acc": "78.76% ± 0.46%",
58
+ "val_win_f1": "0.7781 ± 0.0053",
59
+ "val_vid_acc": "81.97% ± 0.23%",
60
+ "val_vid_f1": "0.8254 ± 0.0066",
61
+ "test_win_acc": "65.33% ± 0.71%",
62
+ "test_win_f1": "0.6406 ± 0.0035",
63
+ "test_vid_acc": "75.68% ± 0.53%",
64
+ "test_vid_f1": "0.7343 ± 0.0085"
65
+ }