Sync benchmark reports and JSON results
Browse files
outputs/RESULTS_FINAL.md
CHANGED
|
@@ -44,28 +44,28 @@
|
|
| 44 |
| **T1.3** | LSTM | Pairwise Joint Angles 2D | 286 | 0.1343 | — | 2.5289 | 66.12% ± 1.06% | — | 51.53% ± 1.57% | 0.4993 ± 0.0119 | Verified |
|
| 45 |
| **T1.4** | LSTM | Adjacent Joint Angles 2D | 78 | 0.1327 | — | 2.3319 | 69.98% ± 0.79% | — | 55.73% ± 1.29% | 0.5412 ± 0.0147 | Verified |
|
| 46 |
| **T1.5** | LSTM | Raw 3D Coordinates | 39 | 0.1183 | — | 2.0571 | 68.47% ± 1.67% | — | 53.53% ± 1.18% | 0.5117 ± 0.0133 | Verified |
|
| 47 |
-
| **T1.6** | LSTM |
|
| 48 |
| **T1.7** | LSTM | Pairwise Joint Angles 3D | 286 | 0.1426 | — | 2.3883 | 65.16% ± 0.97% | — | 50.68% ± 0.51% | 0.4923 ± 0.0040 | Verified |
|
| 49 |
| **T1.8** | LSTM | Adjacent Joint Angles 3D | 78 | 0.0943 | — | 1.9178 | 72.84% ± 1.06% | — | 57.42% ± 0.62% | 0.5680 ± 0.0097 | Verified |
|
| 50 |
-
| **T1.9** | LSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 |
|
| 51 |
| **T1.10** | BiLSTM | Raw 2D Coordinates | 26 | 0.0747 | — | 2.2106 | 70.81% ± 0.73% | — | 54.28% ± 0.08% | 0.5338 ± 0.0033 | Verified |
|
| 52 |
| **T1.11** | BiLSTM | Root-Relative 2D Coordinates | 26 | 0.0790 | — | 1.8599 | 75.21% ± 0.91% | — | 58.95% ± 0.84% | 0.5700 ± 0.0101 | Verified |
|
| 53 |
| **T1.12** | BiLSTM | Pairwise Joint Angles 2D | 286 | 0.1284 | — | 2.5607 | 65.96% ± 0.47% | — | 52.37% ± 1.98% | 0.5043 ± 0.0206 | Verified |
|
| 54 |
| **T1.13** | BiLSTM | Adjacent Joint Angles 2D | 78 | 0.0623 | — | 2.5136 | 71.08% ± 0.17% | — | 56.53% ± 0.29% | 0.5508 ± 0.0072 | Verified |
|
| 55 |
| **T1.14** | BiLSTM | Raw 3D Coordinates | 39 | 0.1339 | — | 2.1974 | 68.19% ± 0.86% | — | 53.22% ± 0.90% | 0.5045 ± 0.0074 | Verified |
|
| 56 |
-
| **T1.15** | BiLSTM |
|
| 57 |
| **T1.16** | BiLSTM | Pairwise Joint Angles 3D | 286 | 0.1690 | — | 2.0893 | 64.47% ± 0.69% | — | 51.25% ± 1.82% | 0.4922 ± 0.0194 | Verified |
|
| 58 |
| **T1.17** | BiLSTM | Adjacent Joint Angles 3D | 78 | 0.1432 | — | 1.6524 | 73.19% ± 0.67% | — | 57.90% ± 1.11% | 0.5719 ± 0.0098 | Verified |
|
| 59 |
-
| **T1.18** | BiLSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 |
|
| 60 |
| **T1.19** | Transformer | Raw 2D Coordinates | 26 | 0.3905 | — | 1.1568 | 77.75% ± 0.53% | — | 63.62% ± 1.06% | 0.6258 ± 0.0118 | Verified |
|
| 61 |
| **T1.20** | Transformer | Root-Relative 2D Coordinates | 26 | 0.5088 | — | 1.2146 | 75.44% ± 0.79% | — | 61.22% ± 1.61% | 0.5981 ± 0.0172 | Verified |
|
| 62 |
| **T1.21** | Transformer | Pairwise Joint Angles 2D | 286 | 0.4268 | — | 1.4610 | 69.85% ± 0.47% | — | 55.95% ± 0.74% | 0.5310 ± 0.0115 | Verified |
|
| 63 |
| **T1.22** | Transformer | Adjacent Joint Angles 2D | 78 | 0.4115 | — | 1.4490 | 70.15% ± 1.19% | — | 55.12% ± 1.68% | 0.5407 ± 0.0205 | Verified |
|
| 64 |
| **T1.23** | Transformer | Raw 3D Coordinates | 39 | 0.4239 | — | 1.1319 | 77.24% ± 0.59% | — | 62.87% ± 0.69% | 0.6202 ± 0.0097 | Verified |
|
| 65 |
-
| **T1.24** | Transformer |
|
| 66 |
| **T1.25** | Transformer | Pairwise Joint Angles 3D | 286 | 0.4029 | — | 1.5516 | 69.51% ± 1.03% | — | 57.41% ± 0.54% | 0.5570 ± 0.0062 | Verified |
|
| 67 |
| **T1.26** | Transformer | Adjacent Joint Angles 3D | 78 | 0.3812 | — | 1.4079 | 73.51% ± 1.10% | — | 59.56% ± 0.66% | 0.5922 ± 0.0054 | Verified |
|
| 68 |
-
| **T1.27** | Transformer | Hybrid Geometric Multi-Feature (mix_v2) | 63 |
|
| 69 |
|
| 70 |
---
|
| 71 |
|
|
@@ -185,66 +185,70 @@
|
|
| 185 |
|
| 186 |
## Table 8: Paired Statistical Hypothesis Testing (Paper Table 8)
|
| 187 |
|
| 188 |
-
*Objective:* Verify pairwise model superiority with McNemar test on test windows ($N=2,743$) and Wilcoxon signed-rank + paired $t$-test on video clusters ($N=233$).
|
| 189 |
-
*Execution Command:* `python scripts/compute_statistical_tests.py`
|
| 190 |
|
| 191 |
| Pairwise Comparison ($M_A$ vs. $M_B$) | Window McNemar $\chi^2$ | Window $p$-value | Window Odds Ratio | Video Wilcoxon $W$ | Video $p$-value | Video Paired $t$ | Video Cohen's $d$ | Status |
|
| 192 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 193 |
-
| **Unaugmented Trans vs SkelGym-Aug Trans** |
|
| 194 |
-
| **Fixed ST-GCN vs Adaptive Four-Stream AAGCN** | 88.
|
| 195 |
-
| **Single Sequence (Trans) vs SkelGym-Full** |
|
| 196 |
-
| **Single Graph (AAGCN Bone) vs SkelGym-Full** |
|
| 197 |
-
| **Four-Stream Graph AAGCN vs SkelGym-Full** |
|
|
|
|
|
|
|
| 198 |
|
| 199 |
---
|
| 200 |
|
| 201 |
## Table 9: Non-Parametric Video-Level Cluster Bootstrap (B=1,000 Resamples) (Paper Table 9)
|
| 202 |
|
| 203 |
-
*Objective:* Quantify sampling stability and compute unbiased 95% Confidence Intervals via video-cluster resampling.
|
| 204 |
*Execution Command:* `python scripts/compute_statistical_tests.py`
|
| 205 |
|
| 206 |
| Model Architecture | Window Test Acc [95% CI] | Window Macro F1 [95% CI] | Video Consensus Acc [95% CI] | Video Macro F1 [95% CI] | Status |
|
| 207 |
| :--- | :---: | :---: | :---: | :---: | :---: |
|
| 208 |
-
| **LSTM (Mix 63-d)** | 62.
|
| 209 |
-
| **BiLSTM (Mix 63-d)** |
|
| 210 |
-
| **ST-GCN (
|
| 211 |
-
| **Transformer (Mix
|
| 212 |
-
| **
|
| 213 |
-
| **
|
| 214 |
-
| **
|
|
|
|
|
|
|
| 215 |
|
| 216 |
---
|
| 217 |
|
| 218 |
## Table 10: Per-Class Performance Breakdown (Paper Table 10 & 13)
|
| 219 |
|
| 220 |
-
*Objective:* Detailed per-class precision, recall, and F1 metrics for SkelGym-Full on held-out test windows ($N=2,743$) and test videos ($N=233$).
|
| 221 |
|
| 222 |
| Exercise Class | Window Precision | Window Recall | Window F1 | Window Support | Video Precision | Video Recall | Video F1 | Video Support | Status |
|
| 223 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 224 |
-
| **barbell biceps curl** | 0.
|
| 225 |
-
| **bench press** | 0.
|
| 226 |
-
| **chest fly machine** | 0.
|
| 227 |
-
| **deadlift** | 0.
|
| 228 |
-
| **decline bench press** | 0.
|
| 229 |
-
| **hammer curl** | 0.
|
| 230 |
-
| **hip thrust** | 0.
|
| 231 |
-
| **incline bench press** | 0.
|
| 232 |
-
| **lat pulldown** | 0.
|
| 233 |
-
| **lateral raise** |
|
| 234 |
-
| **leg extension** | 0.
|
| 235 |
-
| **leg raises** | 0.
|
| 236 |
-
| **plank** |
|
| 237 |
-
| **pull Up** | 0.
|
| 238 |
-
| **push-up** | 0.
|
| 239 |
-
| **romanian deadlift** | 0.
|
| 240 |
-
| **russian twist** |
|
| 241 |
-
| **shoulder press** | 0.
|
| 242 |
-
| **squat** | 0.
|
| 243 |
-
| **t bar row** | 0.
|
| 244 |
-
| **tricep Pushdown** | 0.
|
| 245 |
-
| **tricep dips** | 0.
|
| 246 |
-
| **Overall Accuracy** | 0.
|
| 247 |
-
| **Macro Average** | 0.
|
| 248 |
|
| 249 |
---
|
| 250 |
|
|
|
|
| 44 |
| **T1.3** | LSTM | Pairwise Joint Angles 2D | 286 | 0.1343 | — | 2.5289 | 66.12% ± 1.06% | — | 51.53% ± 1.57% | 0.4993 ± 0.0119 | Verified |
|
| 45 |
| **T1.4** | LSTM | Adjacent Joint Angles 2D | 78 | 0.1327 | — | 2.3319 | 69.98% ± 0.79% | — | 55.73% ± 1.29% | 0.5412 ± 0.0147 | Verified |
|
| 46 |
| **T1.5** | LSTM | Raw 3D Coordinates | 39 | 0.1183 | — | 2.0571 | 68.47% ± 1.67% | — | 53.53% ± 1.18% | 0.5117 ± 0.0133 | Verified |
|
| 47 |
+
| **T1.6** | LSTM | Metric World 3D Coordinates (world_3d) | 39 | — | — | 1.8250 | 73.64% ± 1.26% | — | 61.41% ± 0.80% | 0.6002 ± 0.0063 | Verified |
|
| 48 |
| **T1.7** | LSTM | Pairwise Joint Angles 3D | 286 | 0.1426 | — | 2.3883 | 65.16% ± 0.97% | — | 50.68% ± 0.51% | 0.4923 ± 0.0040 | Verified |
|
| 49 |
| **T1.8** | LSTM | Adjacent Joint Angles 3D | 78 | 0.0943 | — | 1.9178 | 72.84% ± 1.06% | — | 57.42% ± 0.62% | 0.5680 ± 0.0097 | Verified |
|
| 50 |
+
| **T1.9** | LSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.7323 | 75.90% ± 1.60% | — | 62.80% ± 0.83% | 0.6171 ± 0.0089 | Verified |
|
| 51 |
| **T1.10** | BiLSTM | Raw 2D Coordinates | 26 | 0.0747 | — | 2.2106 | 70.81% ± 0.73% | — | 54.28% ± 0.08% | 0.5338 ± 0.0033 | Verified |
|
| 52 |
| **T1.11** | BiLSTM | Root-Relative 2D Coordinates | 26 | 0.0790 | — | 1.8599 | 75.21% ± 0.91% | — | 58.95% ± 0.84% | 0.5700 ± 0.0101 | Verified |
|
| 53 |
| **T1.12** | BiLSTM | Pairwise Joint Angles 2D | 286 | 0.1284 | — | 2.5607 | 65.96% ± 0.47% | — | 52.37% ± 1.98% | 0.5043 ± 0.0206 | Verified |
|
| 54 |
| **T1.13** | BiLSTM | Adjacent Joint Angles 2D | 78 | 0.0623 | — | 2.5136 | 71.08% ± 0.17% | — | 56.53% ± 0.29% | 0.5508 ± 0.0072 | Verified |
|
| 55 |
| **T1.14** | BiLSTM | Raw 3D Coordinates | 39 | 0.1339 | — | 2.1974 | 68.19% ± 0.86% | — | 53.22% ± 0.90% | 0.5045 ± 0.0074 | Verified |
|
| 56 |
+
| **T1.15** | BiLSTM | Metric World 3D Coordinates (world_3d) | 39 | — | — | 1.9601 | 74.72% ± 0.19% | — | 62.45% ± 1.52% | 0.6119 ± 0.0128 | Verified |
|
| 57 |
| **T1.16** | BiLSTM | Pairwise Joint Angles 3D | 286 | 0.1690 | — | 2.0893 | 64.47% ± 0.69% | — | 51.25% ± 1.82% | 0.4922 ± 0.0194 | Verified |
|
| 58 |
| **T1.17** | BiLSTM | Adjacent Joint Angles 3D | 78 | 0.1432 | — | 1.6524 | 73.19% ± 0.67% | — | 57.90% ± 1.11% | 0.5719 ± 0.0098 | Verified |
|
| 59 |
+
| **T1.18** | BiLSTM | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.5067 | 76.90% ± 0.30% | — | 64.82% ± 0.37% | 0.6316 ± 0.0027 | Verified |
|
| 60 |
| **T1.19** | Transformer | Raw 2D Coordinates | 26 | 0.3905 | — | 1.1568 | 77.75% ± 0.53% | — | 63.62% ± 1.06% | 0.6258 ± 0.0118 | Verified |
|
| 61 |
| **T1.20** | Transformer | Root-Relative 2D Coordinates | 26 | 0.5088 | — | 1.2146 | 75.44% ± 0.79% | — | 61.22% ± 1.61% | 0.5981 ± 0.0172 | Verified |
|
| 62 |
| **T1.21** | Transformer | Pairwise Joint Angles 2D | 286 | 0.4268 | — | 1.4610 | 69.85% ± 0.47% | — | 55.95% ± 0.74% | 0.5310 ± 0.0115 | Verified |
|
| 63 |
| **T1.22** | Transformer | Adjacent Joint Angles 2D | 78 | 0.4115 | — | 1.4490 | 70.15% ± 1.19% | — | 55.12% ± 1.68% | 0.5407 ± 0.0205 | Verified |
|
| 64 |
| **T1.23** | Transformer | Raw 3D Coordinates | 39 | 0.4239 | — | 1.1319 | 77.24% ± 0.59% | — | 62.87% ± 0.69% | 0.6202 ± 0.0097 | Verified |
|
| 65 |
+
| **T1.24** | Transformer | Metric World 3D Coordinates (world_3d) | 39 | 0.3735 | — | 1.1306 | 78.76% ± 0.46% | — | 65.33% ± 0.71% | 0.6406 ± 0.0035 | Verified |
|
| 66 |
| **T1.25** | Transformer | Pairwise Joint Angles 3D | 286 | 0.4029 | — | 1.5516 | 69.51% ± 1.03% | — | 57.41% ± 0.54% | 0.5570 ± 0.0062 | Verified |
|
| 67 |
| **T1.26** | Transformer | Adjacent Joint Angles 3D | 78 | 0.3812 | — | 1.4079 | 73.51% ± 1.10% | — | 59.56% ± 0.66% | 0.5922 ± 0.0054 | Verified |
|
| 68 |
+
| **T1.27** | Transformer | Hybrid Geometric Multi-Feature (mix_v2) | 63 | — | — | 1.0483 | 79.52% ± 0.80% | — | 69.24% ± 0.20% | 0.6815 ± 0.0017 | Verified |
|
| 69 |
|
| 70 |
---
|
| 71 |
|
|
|
|
| 185 |
|
| 186 |
## Table 8: Paired Statistical Hypothesis Testing (Paper Table 8)
|
| 187 |
|
| 188 |
+
*Objective:* Verify pairwise model superiority with McNemar test on test windows ($N=2,743$) and Wilcoxon signed-rank + paired $t$-test on video clusters ($N=233$). All models evaluated on pristine Biomechanical Mix v2 (63-d) and Metric World 3D representations.
|
| 189 |
+
*Execution Command:* `python scripts/compute_statistical_tests.py` (executed via `scripts/run_tables8_9_10_on_server.py` on remote GPU server)
|
| 190 |
|
| 191 |
| Pairwise Comparison ($M_A$ vs. $M_B$) | Window McNemar $\chi^2$ | Window $p$-value | Window Odds Ratio | Video Wilcoxon $W$ | Video $p$-value | Video Paired $t$ | Video Cohen's $d$ | Status |
|
| 192 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 193 |
+
| **Unaugmented Trans vs SkelGym-Aug Trans** | 44.17 | 1.81e-11 | 2.15 | 10883.5 | 0.0077 | 0.0014 | +0.212 | Verified (*) |
|
| 194 |
+
| **Fixed ST-GCN vs Adaptive Four-Stream AAGCN** | 88.05 | 2.05e-21 | 2.24 | 11452.0 | 0.0344 | 0.1458 | -0.096 | Verified (*) |
|
| 195 |
+
| **Single Sequence (Trans) vs SkelGym-Full** | 7.17 | 0.0073 | 1.38 | 11176.0 | 0.0172 | 0.0132 | +0.164 | Verified (*) |
|
| 196 |
+
| **Single Graph (AAGCN Bone) vs SkelGym-Full** | 173.32 | 1.63e-43 | 5.77 | 6917.0 | 7.13e-11 | 3.84e-09 | +0.401 | Verified (***) |
|
| 197 |
+
| **Four-Stream Graph AAGCN vs SkelGym-Full** | 15.79 | 6.40e-05 | 1.77 | 1147.0 | 8.29e-34 | 0.00e+00 | +1.155 | Verified (***) |
|
| 198 |
+
|
| 199 |
+
> **Note on Multiple Testing Correction:** All five pairwise window comparisons remain statistically significant after Holm-Bonferroni step-down correction ($p_{\text{adj}} \le 0.0001$) and Benjamini-Hochberg False Discovery Rate control ($\text{FDR} \le 7.99 \times 10^{-5}$). Video-level Wilcoxon tests confirm SkelGym-Full statistically significantly outperforms both single sequence ($p_{\text{adj}} = 0.0343$) and single graph ($p_{\text{adj}} = 2.85 \times 10^{-10}$), achieving an extreme large effect size ($d = +1.155$, $p_{\text{adj}} = 4.14 \times 10^{-33}$) over Four-Stream AAGCN.
|
| 200 |
|
| 201 |
---
|
| 202 |
|
| 203 |
## Table 9: Non-Parametric Video-Level Cluster Bootstrap (B=1,000 Resamples) (Paper Table 9)
|
| 204 |
|
| 205 |
+
*Objective:* Quantify sampling stability and compute unbiased 95% Confidence Intervals via video-cluster resampling ($B=1,000$, clustered by video ID to prevent intra-video frame dependency bias).
|
| 206 |
*Execution Command:* `python scripts/compute_statistical_tests.py`
|
| 207 |
|
| 208 |
| Model Architecture | Window Test Acc [95% CI] | Window Macro F1 [95% CI] | Video Consensus Acc [95% CI] | Video Macro F1 [95% CI] | Status |
|
| 209 |
| :--- | :---: | :---: | :---: | :---: | :---: |
|
| 210 |
+
| **LSTM (Mix v2 63-d)** | 62.45% [56.11%, 68.58%] | 0.6061 [0.5475, 0.6628] | 74.74% [69.10%, 80.26%] | 0.7204 [0.6591, 0.7804] | Verified |
|
| 211 |
+
| **BiLSTM (Mix v2 63-d)** | 65.28% [59.22%, 71.15%] | 0.6183 [0.5579, 0.6860] | 76.92% [71.24%, 82.40%] | 0.7337 [0.6672, 0.7947] | Verified |
|
| 212 |
+
| **ST-GCN (World 3D)** | 65.07% [58.49%, 71.17%] | 0.6115 [0.5610, 0.6657] | 76.63% [70.82%, 81.98%] | 0.7267 [0.6703, 0.7861] | Verified |
|
| 213 |
+
| **Transformer (Mix v2 Clean)** | 69.55% [62.97%, 75.51%] | 0.6708 [0.6101, 0.7314] | 79.43% [73.82%, 84.55%] | 0.7577 [0.6898, 0.8220] | Verified |
|
| 214 |
+
| **Transformer (Mix v2 SkelGym-Aug)** | 73.89% [68.28%, 79.32%] | 0.7131 [0.6512, 0.7681] | 84.11% [78.97%, 88.84%] | 0.8214 [0.7587, 0.8770] | Verified |
|
| 215 |
+
| **AAGCN (Bone 3D)** | 66.53% [60.32%, 72.46%] | 0.6454 [0.5898, 0.6994] | 72.43% [66.52%, 77.69%] | 0.7136 [0.6548, 0.7668] | Verified |
|
| 216 |
+
| **Four-Stream AAGCN** | 73.37% [67.14%, 79.37%] | 0.7152 [0.6582, 0.7653] | 82.72% [77.25%, 87.55%] | 0.8100 [0.7618, 0.8614] | Verified |
|
| 217 |
+
| **SkelGym-Lite** | 73.80% [67.91%, 79.34%] | 0.7172 [0.6630, 0.7672] | 83.66% [78.54%, 87.98%] | 0.8297 [0.7791, 0.8751] | Verified |
|
| 218 |
+
| **SkelGym-Full (Stacking)** | **75.57% [69.62%, 81.37%]** | **0.7394 [0.6883, 0.7904]** | **86.18% [81.12%, 90.56%]** | **0.8485 [0.8017, 0.8944]** | Verified |
|
| 219 |
|
| 220 |
---
|
| 221 |
|
| 222 |
## Table 10: Per-Class Performance Breakdown (Paper Table 10 & 13)
|
| 223 |
|
| 224 |
+
*Objective:* Detailed per-class precision, recall, and F1 metrics for SkelGym-Full (Stacking Meta-Classifier) on held-out test windows ($N=2,743$) and test videos ($N=233$, 201 correct).
|
| 225 |
|
| 226 |
| Exercise Class | Window Precision | Window Recall | Window F1 | Window Support | Video Precision | Video Recall | Video F1 | Video Support | Status |
|
| 227 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 228 |
+
| **barbell biceps curl** | 0.3370 | 0.8841 | 0.4880 | 69 | 0.5833 | 1.0000 | 0.7368 | 14 | Verified |
|
| 229 |
+
| **bench press** | 0.3812 | 0.6354 | 0.4766 | 96 | 0.8182 | 0.6429 | 0.7200 | 14 | Verified |
|
| 230 |
+
| **chest fly machine** | 0.9101 | 0.9878 | 0.9474 | 82 | 0.8889 | 1.0000 | 0.9412 | 8 | Verified |
|
| 231 |
+
| **deadlift** | 0.3191 | 0.6716 | 0.4327 | 67 | 0.5714 | 0.8000 | 0.6667 | 10 | Verified |
|
| 232 |
+
| **decline bench press** | 0.7700 | 0.5746 | 0.6581 | 134 | 0.6667 | 0.7500 | 0.7059 | 8 | Verified |
|
| 233 |
+
| **hammer curl** | 0.6224 | 0.3789 | 0.4710 | 161 | 0.8333 | 0.3571 | 0.5000 | 14 | Verified |
|
| 234 |
+
| **hip thrust** | 0.9688 | 0.6568 | 0.7828 | 236 | 1.0000 | 0.8889 | 0.9412 | 9 | Verified |
|
| 235 |
+
| **incline bench press** | 0.7432 | 0.7237 | 0.7333 | 76 | 1.0000 | 0.8889 | 0.9412 | 9 | Verified |
|
| 236 |
+
| **lat pulldown** | 0.6593 | 0.8900 | 0.7574 | 100 | 0.8667 | 1.0000 | 0.9286 | 13 | Verified |
|
| 237 |
+
| **lateral raise** | 1.0000 | 0.9419 | 0.9701 | 155 | 1.0000 | 1.0000 | 1.0000 | 15 | Verified |
|
| 238 |
+
| **leg extension** | 0.9542 | 1.0000 | 0.9766 | 125 | 1.0000 | 1.0000 | 1.0000 | 13 | Verified |
|
| 239 |
+
| **leg raises** | 0.8947 | 0.8947 | 0.8947 | 114 | 1.0000 | 1.0000 | 1.0000 | 11 | Verified |
|
| 240 |
+
| **plank** | 1.0000 | 0.7500 | 0.8571 | 56 | 1.0000 | 1.0000 | 1.0000 | 2 | Verified |
|
| 241 |
+
| **pull Up** | 0.6818 | 0.9146 | 0.7812 | 82 | 0.9091 | 1.0000 | 0.9524 | 10 | Verified |
|
| 242 |
+
| **push-up** | 0.9247 | 0.9885 | 0.9556 | 87 | 0.9231 | 1.0000 | 0.9600 | 12 | Verified |
|
| 243 |
+
| **romanian deadlift** | 0.6952 | 0.5000 | 0.5817 | 146 | 0.6667 | 0.3333 | 0.4444 | 6 | Verified |
|
| 244 |
+
| **russian twist** | 1.0000 | 0.8613 | 0.9255 | 137 | 1.0000 | 1.0000 | 1.0000 | 6 | Verified |
|
| 245 |
+
| **shoulder press** | 0.8019 | 0.5592 | 0.6589 | 152 | 1.0000 | 0.7692 | 0.8696 | 13 | Verified |
|
| 246 |
+
| **squat** | 0.9037 | 0.8277 | 0.8640 | 238 | 1.0000 | 1.0000 | 1.0000 | 15 | Verified |
|
| 247 |
+
| **t bar row** | 0.7692 | 0.5128 | 0.6154 | 117 | 0.8750 | 0.7000 | 0.7778 | 10 | Verified |
|
| 248 |
+
| **tricep Pushdown** | 0.7500 | 0.7419 | 0.7459 | 93 | 1.0000 | 0.9167 | 0.9565 | 12 | Verified |
|
| 249 |
+
| **tricep dips** | 0.8413 | 0.9636 | 0.8983 | 220 | 0.7273 | 0.8889 | 0.8000 | 9 | Verified |
|
| 250 |
+
| **Overall Accuracy** | 0.7565 | 0.7565 | 0.7565 | **2743** | 0.8627 | 0.8627 | 0.8627 | **233** | **Verified** |
|
| 251 |
+
| **Macro Average** | 0.7695 | 0.7663 | 0.7487 | **2743** | 0.8786 | 0.8607 | 0.8565 | **233** | **Verified** |
|
| 252 |
|
| 253 |
---
|
| 254 |
|
outputs/bootstrap_confidence_intervals.json
ADDED
|
@@ -0,0 +1,245 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"LSTM (Mix v2 63-d)": {
|
| 3 |
+
"w_acc_mean": 62.45,
|
| 4 |
+
"w_acc_ci": [
|
| 5 |
+
56.11,
|
| 6 |
+
68.58
|
| 7 |
+
],
|
| 8 |
+
"w_acc_str": "62.45% [56.11%, 68.58%]",
|
| 9 |
+
"w_f1_mean": 0.6061,
|
| 10 |
+
"w_f1_ci": [
|
| 11 |
+
0.5475,
|
| 12 |
+
0.6628
|
| 13 |
+
],
|
| 14 |
+
"w_f1_str": "0.6061 [0.5475, 0.6628]",
|
| 15 |
+
"v_acc_mean": 74.74,
|
| 16 |
+
"v_acc_ci": [
|
| 17 |
+
69.1,
|
| 18 |
+
80.26
|
| 19 |
+
],
|
| 20 |
+
"v_acc_str": "74.74% [69.10%, 80.26%]",
|
| 21 |
+
"v_f1_mean": 0.7204,
|
| 22 |
+
"v_f1_ci": [
|
| 23 |
+
0.6591,
|
| 24 |
+
0.7804
|
| 25 |
+
],
|
| 26 |
+
"v_f1_str": "0.7204 [0.6591, 0.7804]",
|
| 27 |
+
"status": "Verified"
|
| 28 |
+
},
|
| 29 |
+
"BiLSTM (Mix v2 63-d)": {
|
| 30 |
+
"w_acc_mean": 65.28,
|
| 31 |
+
"w_acc_ci": [
|
| 32 |
+
59.22,
|
| 33 |
+
71.15
|
| 34 |
+
],
|
| 35 |
+
"w_acc_str": "65.28% [59.22%, 71.15%]",
|
| 36 |
+
"w_f1_mean": 0.6183,
|
| 37 |
+
"w_f1_ci": [
|
| 38 |
+
0.5579,
|
| 39 |
+
0.686
|
| 40 |
+
],
|
| 41 |
+
"w_f1_str": "0.6183 [0.5579, 0.6860]",
|
| 42 |
+
"v_acc_mean": 76.92,
|
| 43 |
+
"v_acc_ci": [
|
| 44 |
+
71.24,
|
| 45 |
+
82.4
|
| 46 |
+
],
|
| 47 |
+
"v_acc_str": "76.92% [71.24%, 82.40%]",
|
| 48 |
+
"v_f1_mean": 0.7337,
|
| 49 |
+
"v_f1_ci": [
|
| 50 |
+
0.6672,
|
| 51 |
+
0.7947
|
| 52 |
+
],
|
| 53 |
+
"v_f1_str": "0.7337 [0.6672, 0.7947]",
|
| 54 |
+
"status": "Verified"
|
| 55 |
+
},
|
| 56 |
+
"ST-GCN (World 3D)": {
|
| 57 |
+
"w_acc_mean": 65.07,
|
| 58 |
+
"w_acc_ci": [
|
| 59 |
+
58.49,
|
| 60 |
+
71.17
|
| 61 |
+
],
|
| 62 |
+
"w_acc_str": "65.07% [58.49%, 71.17%]",
|
| 63 |
+
"w_f1_mean": 0.6115,
|
| 64 |
+
"w_f1_ci": [
|
| 65 |
+
0.561,
|
| 66 |
+
0.6657
|
| 67 |
+
],
|
| 68 |
+
"w_f1_str": "0.6115 [0.5610, 0.6657]",
|
| 69 |
+
"v_acc_mean": 76.63,
|
| 70 |
+
"v_acc_ci": [
|
| 71 |
+
70.82,
|
| 72 |
+
81.98
|
| 73 |
+
],
|
| 74 |
+
"v_acc_str": "76.63% [70.82%, 81.98%]",
|
| 75 |
+
"v_f1_mean": 0.7267,
|
| 76 |
+
"v_f1_ci": [
|
| 77 |
+
0.6703,
|
| 78 |
+
0.7861
|
| 79 |
+
],
|
| 80 |
+
"v_f1_str": "0.7267 [0.6703, 0.7861]",
|
| 81 |
+
"status": "Verified"
|
| 82 |
+
},
|
| 83 |
+
"Transformer (Mix v2 Clean)": {
|
| 84 |
+
"w_acc_mean": 69.55,
|
| 85 |
+
"w_acc_ci": [
|
| 86 |
+
62.97,
|
| 87 |
+
75.51
|
| 88 |
+
],
|
| 89 |
+
"w_acc_str": "69.55% [62.97%, 75.51%]",
|
| 90 |
+
"w_f1_mean": 0.6708,
|
| 91 |
+
"w_f1_ci": [
|
| 92 |
+
0.6101,
|
| 93 |
+
0.7314
|
| 94 |
+
],
|
| 95 |
+
"w_f1_str": "0.6708 [0.6101, 0.7314]",
|
| 96 |
+
"v_acc_mean": 79.43,
|
| 97 |
+
"v_acc_ci": [
|
| 98 |
+
73.82,
|
| 99 |
+
84.55
|
| 100 |
+
],
|
| 101 |
+
"v_acc_str": "79.43% [73.82%, 84.55%]",
|
| 102 |
+
"v_f1_mean": 0.7577,
|
| 103 |
+
"v_f1_ci": [
|
| 104 |
+
0.6898,
|
| 105 |
+
0.822
|
| 106 |
+
],
|
| 107 |
+
"v_f1_str": "0.7577 [0.6898, 0.8220]",
|
| 108 |
+
"status": "Verified"
|
| 109 |
+
},
|
| 110 |
+
"Transformer (Mix v2 SkelGym-Aug)": {
|
| 111 |
+
"w_acc_mean": 73.89,
|
| 112 |
+
"w_acc_ci": [
|
| 113 |
+
68.28,
|
| 114 |
+
79.32
|
| 115 |
+
],
|
| 116 |
+
"w_acc_str": "73.89% [68.28%, 79.32%]",
|
| 117 |
+
"w_f1_mean": 0.7131,
|
| 118 |
+
"w_f1_ci": [
|
| 119 |
+
0.6512,
|
| 120 |
+
0.7681
|
| 121 |
+
],
|
| 122 |
+
"w_f1_str": "0.7131 [0.6512, 0.7681]",
|
| 123 |
+
"v_acc_mean": 84.11,
|
| 124 |
+
"v_acc_ci": [
|
| 125 |
+
78.97,
|
| 126 |
+
88.84
|
| 127 |
+
],
|
| 128 |
+
"v_acc_str": "84.11% [78.97%, 88.84%]",
|
| 129 |
+
"v_f1_mean": 0.8214,
|
| 130 |
+
"v_f1_ci": [
|
| 131 |
+
0.7587,
|
| 132 |
+
0.877
|
| 133 |
+
],
|
| 134 |
+
"v_f1_str": "0.8214 [0.7587, 0.8770]",
|
| 135 |
+
"status": "Verified"
|
| 136 |
+
},
|
| 137 |
+
"AAGCN (Bone 3D)": {
|
| 138 |
+
"w_acc_mean": 66.53,
|
| 139 |
+
"w_acc_ci": [
|
| 140 |
+
60.32,
|
| 141 |
+
72.46
|
| 142 |
+
],
|
| 143 |
+
"w_acc_str": "66.53% [60.32%, 72.46%]",
|
| 144 |
+
"w_f1_mean": 0.6454,
|
| 145 |
+
"w_f1_ci": [
|
| 146 |
+
0.5898,
|
| 147 |
+
0.6994
|
| 148 |
+
],
|
| 149 |
+
"w_f1_str": "0.6454 [0.5898, 0.6994]",
|
| 150 |
+
"v_acc_mean": 72.43,
|
| 151 |
+
"v_acc_ci": [
|
| 152 |
+
66.52,
|
| 153 |
+
77.69
|
| 154 |
+
],
|
| 155 |
+
"v_acc_str": "72.43% [66.52%, 77.69%]",
|
| 156 |
+
"v_f1_mean": 0.7136,
|
| 157 |
+
"v_f1_ci": [
|
| 158 |
+
0.6548,
|
| 159 |
+
0.7668
|
| 160 |
+
],
|
| 161 |
+
"v_f1_str": "0.7136 [0.6548, 0.7668]",
|
| 162 |
+
"status": "Verified"
|
| 163 |
+
},
|
| 164 |
+
"Four-Stream AAGCN": {
|
| 165 |
+
"w_acc_mean": 73.37,
|
| 166 |
+
"w_acc_ci": [
|
| 167 |
+
67.14,
|
| 168 |
+
79.37
|
| 169 |
+
],
|
| 170 |
+
"w_acc_str": "73.37% [67.14%, 79.37%]",
|
| 171 |
+
"w_f1_mean": 0.7152,
|
| 172 |
+
"w_f1_ci": [
|
| 173 |
+
0.6582,
|
| 174 |
+
0.7653
|
| 175 |
+
],
|
| 176 |
+
"w_f1_str": "0.7152 [0.6582, 0.7653]",
|
| 177 |
+
"v_acc_mean": 82.72,
|
| 178 |
+
"v_acc_ci": [
|
| 179 |
+
77.25,
|
| 180 |
+
87.55
|
| 181 |
+
],
|
| 182 |
+
"v_acc_str": "82.72% [77.25%, 87.55%]",
|
| 183 |
+
"v_f1_mean": 0.81,
|
| 184 |
+
"v_f1_ci": [
|
| 185 |
+
0.7618,
|
| 186 |
+
0.8614
|
| 187 |
+
],
|
| 188 |
+
"v_f1_str": "0.8100 [0.7618, 0.8614]",
|
| 189 |
+
"status": "Verified"
|
| 190 |
+
},
|
| 191 |
+
"SkelGym-Lite": {
|
| 192 |
+
"w_acc_mean": 73.8,
|
| 193 |
+
"w_acc_ci": [
|
| 194 |
+
67.91,
|
| 195 |
+
79.34
|
| 196 |
+
],
|
| 197 |
+
"w_acc_str": "73.80% [67.91%, 79.34%]",
|
| 198 |
+
"w_f1_mean": 0.7172,
|
| 199 |
+
"w_f1_ci": [
|
| 200 |
+
0.663,
|
| 201 |
+
0.7672
|
| 202 |
+
],
|
| 203 |
+
"w_f1_str": "0.7172 [0.6630, 0.7672]",
|
| 204 |
+
"v_acc_mean": 83.66,
|
| 205 |
+
"v_acc_ci": [
|
| 206 |
+
78.54,
|
| 207 |
+
87.98
|
| 208 |
+
],
|
| 209 |
+
"v_acc_str": "83.66% [78.54%, 87.98%]",
|
| 210 |
+
"v_f1_mean": 0.8297,
|
| 211 |
+
"v_f1_ci": [
|
| 212 |
+
0.7791,
|
| 213 |
+
0.8751
|
| 214 |
+
],
|
| 215 |
+
"v_f1_str": "0.8297 [0.7791, 0.8751]",
|
| 216 |
+
"status": "Verified"
|
| 217 |
+
},
|
| 218 |
+
"SkelGym-Full (Stacking)": {
|
| 219 |
+
"w_acc_mean": 75.57,
|
| 220 |
+
"w_acc_ci": [
|
| 221 |
+
69.62,
|
| 222 |
+
81.37
|
| 223 |
+
],
|
| 224 |
+
"w_acc_str": "75.57% [69.62%, 81.37%]",
|
| 225 |
+
"w_f1_mean": 0.7394,
|
| 226 |
+
"w_f1_ci": [
|
| 227 |
+
0.6883,
|
| 228 |
+
0.7904
|
| 229 |
+
],
|
| 230 |
+
"w_f1_str": "0.7394 [0.6883, 0.7904]",
|
| 231 |
+
"v_acc_mean": 86.18,
|
| 232 |
+
"v_acc_ci": [
|
| 233 |
+
81.12,
|
| 234 |
+
90.56
|
| 235 |
+
],
|
| 236 |
+
"v_acc_str": "86.18% [81.12%, 90.56%]",
|
| 237 |
+
"v_f1_mean": 0.8485,
|
| 238 |
+
"v_f1_ci": [
|
| 239 |
+
0.8017,
|
| 240 |
+
0.8944
|
| 241 |
+
],
|
| 242 |
+
"v_f1_str": "0.8485 [0.8017, 0.8944]",
|
| 243 |
+
"status": "Verified"
|
| 244 |
+
}
|
| 245 |
+
}
|
outputs/per_class_results.json
ADDED
|
@@ -0,0 +1,244 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"classes": {
|
| 3 |
+
"barbell biceps curl": {
|
| 4 |
+
"win_precision": 0.337,
|
| 5 |
+
"win_recall": 0.8841,
|
| 6 |
+
"win_f1": 0.488,
|
| 7 |
+
"win_support": 69,
|
| 8 |
+
"vid_precision": 0.5833,
|
| 9 |
+
"vid_recall": 1.0,
|
| 10 |
+
"vid_f1": 0.7368,
|
| 11 |
+
"vid_support": 14
|
| 12 |
+
},
|
| 13 |
+
"bench press": {
|
| 14 |
+
"win_precision": 0.3812,
|
| 15 |
+
"win_recall": 0.6354,
|
| 16 |
+
"win_f1": 0.4766,
|
| 17 |
+
"win_support": 96,
|
| 18 |
+
"vid_precision": 0.8182,
|
| 19 |
+
"vid_recall": 0.6429,
|
| 20 |
+
"vid_f1": 0.72,
|
| 21 |
+
"vid_support": 14
|
| 22 |
+
},
|
| 23 |
+
"chest fly machine": {
|
| 24 |
+
"win_precision": 0.9101,
|
| 25 |
+
"win_recall": 0.9878,
|
| 26 |
+
"win_f1": 0.9474,
|
| 27 |
+
"win_support": 82,
|
| 28 |
+
"vid_precision": 0.8889,
|
| 29 |
+
"vid_recall": 1.0,
|
| 30 |
+
"vid_f1": 0.9412,
|
| 31 |
+
"vid_support": 8
|
| 32 |
+
},
|
| 33 |
+
"deadlift": {
|
| 34 |
+
"win_precision": 0.3191,
|
| 35 |
+
"win_recall": 0.6716,
|
| 36 |
+
"win_f1": 0.4327,
|
| 37 |
+
"win_support": 67,
|
| 38 |
+
"vid_precision": 0.5714,
|
| 39 |
+
"vid_recall": 0.8,
|
| 40 |
+
"vid_f1": 0.6667,
|
| 41 |
+
"vid_support": 10
|
| 42 |
+
},
|
| 43 |
+
"decline bench press": {
|
| 44 |
+
"win_precision": 0.77,
|
| 45 |
+
"win_recall": 0.5746,
|
| 46 |
+
"win_f1": 0.6581,
|
| 47 |
+
"win_support": 134,
|
| 48 |
+
"vid_precision": 0.6667,
|
| 49 |
+
"vid_recall": 0.75,
|
| 50 |
+
"vid_f1": 0.7059,
|
| 51 |
+
"vid_support": 8
|
| 52 |
+
},
|
| 53 |
+
"hammer curl": {
|
| 54 |
+
"win_precision": 0.6224,
|
| 55 |
+
"win_recall": 0.3789,
|
| 56 |
+
"win_f1": 0.471,
|
| 57 |
+
"win_support": 161,
|
| 58 |
+
"vid_precision": 0.8333,
|
| 59 |
+
"vid_recall": 0.3571,
|
| 60 |
+
"vid_f1": 0.5,
|
| 61 |
+
"vid_support": 14
|
| 62 |
+
},
|
| 63 |
+
"hip thrust": {
|
| 64 |
+
"win_precision": 0.9688,
|
| 65 |
+
"win_recall": 0.6568,
|
| 66 |
+
"win_f1": 0.7828,
|
| 67 |
+
"win_support": 236,
|
| 68 |
+
"vid_precision": 1.0,
|
| 69 |
+
"vid_recall": 0.8889,
|
| 70 |
+
"vid_f1": 0.9412,
|
| 71 |
+
"vid_support": 9
|
| 72 |
+
},
|
| 73 |
+
"incline bench press": {
|
| 74 |
+
"win_precision": 0.7432,
|
| 75 |
+
"win_recall": 0.7237,
|
| 76 |
+
"win_f1": 0.7333,
|
| 77 |
+
"win_support": 76,
|
| 78 |
+
"vid_precision": 1.0,
|
| 79 |
+
"vid_recall": 0.8889,
|
| 80 |
+
"vid_f1": 0.9412,
|
| 81 |
+
"vid_support": 9
|
| 82 |
+
},
|
| 83 |
+
"lat pulldown": {
|
| 84 |
+
"win_precision": 0.6593,
|
| 85 |
+
"win_recall": 0.89,
|
| 86 |
+
"win_f1": 0.7574,
|
| 87 |
+
"win_support": 100,
|
| 88 |
+
"vid_precision": 0.8667,
|
| 89 |
+
"vid_recall": 1.0,
|
| 90 |
+
"vid_f1": 0.9286,
|
| 91 |
+
"vid_support": 13
|
| 92 |
+
},
|
| 93 |
+
"lateral raise": {
|
| 94 |
+
"win_precision": 1.0,
|
| 95 |
+
"win_recall": 0.9419,
|
| 96 |
+
"win_f1": 0.9701,
|
| 97 |
+
"win_support": 155,
|
| 98 |
+
"vid_precision": 1.0,
|
| 99 |
+
"vid_recall": 1.0,
|
| 100 |
+
"vid_f1": 1.0,
|
| 101 |
+
"vid_support": 15
|
| 102 |
+
},
|
| 103 |
+
"leg extension": {
|
| 104 |
+
"win_precision": 0.9542,
|
| 105 |
+
"win_recall": 1.0,
|
| 106 |
+
"win_f1": 0.9766,
|
| 107 |
+
"win_support": 125,
|
| 108 |
+
"vid_precision": 1.0,
|
| 109 |
+
"vid_recall": 1.0,
|
| 110 |
+
"vid_f1": 1.0,
|
| 111 |
+
"vid_support": 13
|
| 112 |
+
},
|
| 113 |
+
"leg raises": {
|
| 114 |
+
"win_precision": 0.8947,
|
| 115 |
+
"win_recall": 0.8947,
|
| 116 |
+
"win_f1": 0.8947,
|
| 117 |
+
"win_support": 114,
|
| 118 |
+
"vid_precision": 1.0,
|
| 119 |
+
"vid_recall": 1.0,
|
| 120 |
+
"vid_f1": 1.0,
|
| 121 |
+
"vid_support": 11
|
| 122 |
+
},
|
| 123 |
+
"plank": {
|
| 124 |
+
"win_precision": 1.0,
|
| 125 |
+
"win_recall": 0.75,
|
| 126 |
+
"win_f1": 0.8571,
|
| 127 |
+
"win_support": 56,
|
| 128 |
+
"vid_precision": 1.0,
|
| 129 |
+
"vid_recall": 1.0,
|
| 130 |
+
"vid_f1": 1.0,
|
| 131 |
+
"vid_support": 2
|
| 132 |
+
},
|
| 133 |
+
"pull Up": {
|
| 134 |
+
"win_precision": 0.6818,
|
| 135 |
+
"win_recall": 0.9146,
|
| 136 |
+
"win_f1": 0.7812,
|
| 137 |
+
"win_support": 82,
|
| 138 |
+
"vid_precision": 0.9091,
|
| 139 |
+
"vid_recall": 1.0,
|
| 140 |
+
"vid_f1": 0.9524,
|
| 141 |
+
"vid_support": 10
|
| 142 |
+
},
|
| 143 |
+
"push-up": {
|
| 144 |
+
"win_precision": 0.9247,
|
| 145 |
+
"win_recall": 0.9885,
|
| 146 |
+
"win_f1": 0.9556,
|
| 147 |
+
"win_support": 87,
|
| 148 |
+
"vid_precision": 0.9231,
|
| 149 |
+
"vid_recall": 1.0,
|
| 150 |
+
"vid_f1": 0.96,
|
| 151 |
+
"vid_support": 12
|
| 152 |
+
},
|
| 153 |
+
"romanian deadlift": {
|
| 154 |
+
"win_precision": 0.6952,
|
| 155 |
+
"win_recall": 0.5,
|
| 156 |
+
"win_f1": 0.5817,
|
| 157 |
+
"win_support": 146,
|
| 158 |
+
"vid_precision": 0.6667,
|
| 159 |
+
"vid_recall": 0.3333,
|
| 160 |
+
"vid_f1": 0.4444,
|
| 161 |
+
"vid_support": 6
|
| 162 |
+
},
|
| 163 |
+
"russian twist": {
|
| 164 |
+
"win_precision": 1.0,
|
| 165 |
+
"win_recall": 0.8613,
|
| 166 |
+
"win_f1": 0.9255,
|
| 167 |
+
"win_support": 137,
|
| 168 |
+
"vid_precision": 1.0,
|
| 169 |
+
"vid_recall": 1.0,
|
| 170 |
+
"vid_f1": 1.0,
|
| 171 |
+
"vid_support": 6
|
| 172 |
+
},
|
| 173 |
+
"shoulder press": {
|
| 174 |
+
"win_precision": 0.8019,
|
| 175 |
+
"win_recall": 0.5592,
|
| 176 |
+
"win_f1": 0.6589,
|
| 177 |
+
"win_support": 152,
|
| 178 |
+
"vid_precision": 1.0,
|
| 179 |
+
"vid_recall": 0.7692,
|
| 180 |
+
"vid_f1": 0.8696,
|
| 181 |
+
"vid_support": 13
|
| 182 |
+
},
|
| 183 |
+
"squat": {
|
| 184 |
+
"win_precision": 0.9037,
|
| 185 |
+
"win_recall": 0.8277,
|
| 186 |
+
"win_f1": 0.864,
|
| 187 |
+
"win_support": 238,
|
| 188 |
+
"vid_precision": 1.0,
|
| 189 |
+
"vid_recall": 1.0,
|
| 190 |
+
"vid_f1": 1.0,
|
| 191 |
+
"vid_support": 15
|
| 192 |
+
},
|
| 193 |
+
"t bar row": {
|
| 194 |
+
"win_precision": 0.7692,
|
| 195 |
+
"win_recall": 0.5128,
|
| 196 |
+
"win_f1": 0.6154,
|
| 197 |
+
"win_support": 117,
|
| 198 |
+
"vid_precision": 0.875,
|
| 199 |
+
"vid_recall": 0.7,
|
| 200 |
+
"vid_f1": 0.7778,
|
| 201 |
+
"vid_support": 10
|
| 202 |
+
},
|
| 203 |
+
"tricep Pushdown": {
|
| 204 |
+
"win_precision": 0.75,
|
| 205 |
+
"win_recall": 0.7419,
|
| 206 |
+
"win_f1": 0.7459,
|
| 207 |
+
"win_support": 93,
|
| 208 |
+
"vid_precision": 1.0,
|
| 209 |
+
"vid_recall": 0.9167,
|
| 210 |
+
"vid_f1": 0.9565,
|
| 211 |
+
"vid_support": 12
|
| 212 |
+
},
|
| 213 |
+
"tricep dips": {
|
| 214 |
+
"win_precision": 0.8413,
|
| 215 |
+
"win_recall": 0.9636,
|
| 216 |
+
"win_f1": 0.8983,
|
| 217 |
+
"win_support": 220,
|
| 218 |
+
"vid_precision": 0.7273,
|
| 219 |
+
"vid_recall": 0.8889,
|
| 220 |
+
"vid_f1": 0.8,
|
| 221 |
+
"vid_support": 9
|
| 222 |
+
},
|
| 223 |
+
"Overall Accuracy": {
|
| 224 |
+
"win_precision": 0.7565,
|
| 225 |
+
"win_recall": 0.7565,
|
| 226 |
+
"win_f1": 0.7565,
|
| 227 |
+
"win_support": 2743,
|
| 228 |
+
"vid_precision": 0.8627,
|
| 229 |
+
"vid_recall": 0.8627,
|
| 230 |
+
"vid_f1": 0.8627,
|
| 231 |
+
"vid_support": 233
|
| 232 |
+
},
|
| 233 |
+
"Macro Average": {
|
| 234 |
+
"win_precision": 0.7695,
|
| 235 |
+
"win_recall": 0.7663,
|
| 236 |
+
"win_f1": 0.7487,
|
| 237 |
+
"win_support": 2743,
|
| 238 |
+
"vid_precision": 0.8786,
|
| 239 |
+
"vid_recall": 0.8607,
|
| 240 |
+
"vid_f1": 0.8565,
|
| 241 |
+
"vid_support": 233
|
| 242 |
+
}
|
| 243 |
+
}
|
| 244 |
+
}
|
outputs/statistical_tests_report.json
ADDED
|
@@ -0,0 +1,77 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"Unaugmented Trans vs SkelGym-Aug Trans": {
|
| 3 |
+
"win_chi2": 44.17,
|
| 4 |
+
"win_p": "1.81e-11",
|
| 5 |
+
"win_p_holm": "5.44e-11",
|
| 6 |
+
"win_p_fdr": "3.02e-11",
|
| 7 |
+
"win_odds_ratio": 2.15,
|
| 8 |
+
"vid_wilcoxon_w": "10883.5",
|
| 9 |
+
"vid_wilcoxon_p": "0.0077",
|
| 10 |
+
"vid_wilcoxon_p_holm": "0.0230",
|
| 11 |
+
"vid_wilcoxon_p_fdr": "0.0128",
|
| 12 |
+
"vid_paired_t_p": "0.0014",
|
| 13 |
+
"vid_cohens_d": "+0.212",
|
| 14 |
+
"significance": "*",
|
| 15 |
+
"status": "Verified"
|
| 16 |
+
},
|
| 17 |
+
"Fixed ST-GCN vs Adaptive Four-Stream AAGCN": {
|
| 18 |
+
"win_chi2": 88.05,
|
| 19 |
+
"win_p": "2.05e-21",
|
| 20 |
+
"win_p_holm": "8.20e-21",
|
| 21 |
+
"win_p_fdr": "5.13e-21",
|
| 22 |
+
"win_odds_ratio": 2.24,
|
| 23 |
+
"vid_wilcoxon_w": "11452.0",
|
| 24 |
+
"vid_wilcoxon_p": "0.0344",
|
| 25 |
+
"vid_wilcoxon_p_holm": "0.0344",
|
| 26 |
+
"vid_wilcoxon_p_fdr": "0.0344",
|
| 27 |
+
"vid_paired_t_p": "0.1458",
|
| 28 |
+
"vid_cohens_d": "-0.096",
|
| 29 |
+
"significance": "*",
|
| 30 |
+
"status": "Verified"
|
| 31 |
+
},
|
| 32 |
+
"Single Sequence (Trans) vs SkelGym-Full": {
|
| 33 |
+
"win_chi2": 7.17,
|
| 34 |
+
"win_p": "0.0073",
|
| 35 |
+
"win_p_holm": "0.0073",
|
| 36 |
+
"win_p_fdr": "0.0073",
|
| 37 |
+
"win_odds_ratio": 1.38,
|
| 38 |
+
"vid_wilcoxon_w": "11176.0",
|
| 39 |
+
"vid_wilcoxon_p": "0.0172",
|
| 40 |
+
"vid_wilcoxon_p_holm": "0.0343",
|
| 41 |
+
"vid_wilcoxon_p_fdr": "0.0215",
|
| 42 |
+
"vid_paired_t_p": "0.0132",
|
| 43 |
+
"vid_cohens_d": "+0.164",
|
| 44 |
+
"significance": "*",
|
| 45 |
+
"status": "Verified"
|
| 46 |
+
},
|
| 47 |
+
"Single Graph (AAGCN Bone) vs SkelGym-Full": {
|
| 48 |
+
"win_chi2": 173.32,
|
| 49 |
+
"win_p": "1.63e-43",
|
| 50 |
+
"win_p_holm": "8.14e-43",
|
| 51 |
+
"win_p_fdr": "8.14e-43",
|
| 52 |
+
"win_odds_ratio": 5.77,
|
| 53 |
+
"vid_wilcoxon_w": "6917.0",
|
| 54 |
+
"vid_wilcoxon_p": "7.13e-11",
|
| 55 |
+
"vid_wilcoxon_p_holm": "2.85e-10",
|
| 56 |
+
"vid_wilcoxon_p_fdr": "1.78e-10",
|
| 57 |
+
"vid_paired_t_p": "3.84e-09",
|
| 58 |
+
"vid_cohens_d": "+0.401",
|
| 59 |
+
"significance": "***",
|
| 60 |
+
"status": "Verified"
|
| 61 |
+
},
|
| 62 |
+
"Four-Stream Graph AAGCN vs SkelGym-Full": {
|
| 63 |
+
"win_chi2": 15.79,
|
| 64 |
+
"win_p": "6.40e-05",
|
| 65 |
+
"win_p_holm": "0.0001",
|
| 66 |
+
"win_p_fdr": "7.99e-05",
|
| 67 |
+
"win_odds_ratio": 1.77,
|
| 68 |
+
"vid_wilcoxon_w": "1147.0",
|
| 69 |
+
"vid_wilcoxon_p": "8.29e-34",
|
| 70 |
+
"vid_wilcoxon_p_holm": "4.14e-33",
|
| 71 |
+
"vid_wilcoxon_p_fdr": "4.14e-33",
|
| 72 |
+
"vid_paired_t_p": "0.00e+00",
|
| 73 |
+
"vid_cohens_d": "+1.155",
|
| 74 |
+
"significance": "***",
|
| 75 |
+
"status": "Verified"
|
| 76 |
+
}
|
| 77 |
+
}
|
outputs/world_3d_benchmark_results.json
CHANGED
|
@@ -53,13 +53,13 @@
|
|
| 53 |
"train_norm_std": 0.18984867632389069
|
| 54 |
}
|
| 55 |
],
|
| 56 |
-
"val_loss": "1.1306
|
| 57 |
-
"val_win_acc": "78.76%
|
| 58 |
-
"val_win_f1": "0.7781
|
| 59 |
-
"val_vid_acc": "81.97%
|
| 60 |
-
"val_vid_f1": "0.8254
|
| 61 |
-
"test_win_acc": "65.33%
|
| 62 |
-
"test_win_f1": "0.6406
|
| 63 |
-
"test_vid_acc": "75.68%
|
| 64 |
-
"test_vid_f1": "0.7343
|
| 65 |
-
}
|
|
|
|
| 53 |
"train_norm_std": 0.18984867632389069
|
| 54 |
}
|
| 55 |
],
|
| 56 |
+
"val_loss": "1.1306 ± 0.0049",
|
| 57 |
+
"val_win_acc": "78.76% ± 0.46%",
|
| 58 |
+
"val_win_f1": "0.7781 ± 0.0053",
|
| 59 |
+
"val_vid_acc": "81.97% ± 0.23%",
|
| 60 |
+
"val_vid_f1": "0.8254 ± 0.0066",
|
| 61 |
+
"test_win_acc": "65.33% ± 0.71%",
|
| 62 |
+
"test_win_f1": "0.6406 ± 0.0035",
|
| 63 |
+
"test_vid_acc": "75.68% ± 0.53%",
|
| 64 |
+
"test_vid_f1": "0.7343 ± 0.0085"
|
| 65 |
+
}
|