Upload outputs/RESULTS_FINAL.md with huggingface_hub
Browse files- outputs/RESULTS_FINAL.md +54 -48
outputs/RESULTS_FINAL.md
CHANGED
|
@@ -17,7 +17,7 @@
|
|
| 17 |
- **Biomechanical Mix v2 (`mix_v2`, 63-d):** Dual-branch concatenation of 39-d scale-norm coordinates and 24-d kinematic angles.
|
| 18 |
- **Model Capacity:** All sequence backbones standardized to $\approx 300\text{K}$ parameters (Transformer: $d_{\text{model}}=112, d_{\text{ff}}=168, \text{nhead}=4, \text{layers}=3$; LSTM: $h=160, \text{layers}=2$; BiLSTM: $h=96, \text{layers}=2$).
|
| 19 |
- **Augmentation Pipeline (SkelGym-Aug):** Dynamic on-the-fly transformations (Bilateral Sagittal Reflection + Gravitational 3D Yaw $\pm 15^\circ$ + Proportional Scaling $\pm 10\%$ + Gaussian Sensor Jitter $\sigma=0.008$).
|
| 20 |
-
- **Multi-Stream Ensemble:** 5-stream cross-paradigm late fusion (Transformer on 63-d mix_v2 + 4 spatial-temporal AAGCN streams: Bone 3D,
|
| 21 |
|
| 22 |
---
|
| 23 |
|
|
@@ -77,9 +77,16 @@
|
|
| 77 |
| Feature Paradigm | Input Dim | Params | Train Loss | Val Loss | Val Win Acc (%) | Val Win Macro F1 | Val Vid Acc (%) | Val Vid Macro F1 | Test Win Acc (%) | Test Win Macro F1 | Test Vid Acc (%) | Test Vid Macro F1 | Status |
|
| 78 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 79 |
| **Raw 3D Coordinates** | 39 | 301K | 0.3895 | 1.1361 | 77.04% ± 0.38% | 0.7662 ± 0.0063 | 78.90% ± 1.39% | 0.7972 ± 0.0076 | 63.36% ± 1.48% | 0.6228 ± 0.0176 | 72.39% ± 0.88% | 0.7045 ± 0.0130 | Verified |
|
|
|
|
| 80 |
| **Scale-Norm Rel 3D (`rel_3d_norm`)** | 39 | 301K | 0.4241 | 1.1391 | 77.98% ± 0.86% | 0.7691 ± 0.0080 | 81.32% ± 0.46% | 0.8148 ± 0.0014 | 63.46% ± 0.40% | 0.6221 ± 0.0064 | 73.53% ± 1.07% | 0.7067 ± 0.0071 | Verified |
|
|
|
|
| 81 |
| **Biomechanical Mix v2 (`mix_v2`)** | 63 | 300K | 0.4239 | 1.1005 | 77.70% ± 1.05% | 0.7724 ± 0.0118 | 81.00% ± 1.49% | 0.8075 ± 0.0236 | 63.90% ± 1.01% | 0.6318 ± 0.0086 | 74.82% ± 1.01% | 0.7265 ± 0.0108 | Verified |
|
| 82 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
---
|
| 84 |
|
| 85 |
## Table 3: Spatial-Temporal Graph Kinematic Streams (Paper Table 4)
|
|
@@ -87,17 +94,17 @@
|
|
| 87 |
*Objective:* Evaluate static physical adjacency ($A_{\text{phys}}$) versus learnable adaptive topology ($B_k + C_k$) across 4 kinematic modalities.
|
| 88 |
*Execution Command:* `python run.py train --model AAGCN --feature <STREAM> --augment skel_gym_aug --device auto`
|
| 89 |
|
| 90 |
-
| Exp ID | Model Architecture | Kinematic Stream | Augmentation Protocol |
|
| 91 |
-
| :---: | :--- | :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 92 |
-
| **T3.1** | ST-GCN Baseline | Raw 3D Joint | None (Clean) |
|
| 93 |
-
| **T3.2** | ST-GCN Baseline |
|
| 94 |
-
| **T3.3** | AAGCN Baseline | Bone 3D Stream | None (Clean) |
|
| 95 |
-
| **T3.4** | AAGCN | Bone 3D Stream | SkelGym-Aug (Proposed) |
|
| 96 |
-
| **T3.5** | AAGCN | Joint Stream
|
| 97 |
-
| **T3.6** | AAGCN | Joint Motion
|
| 98 |
-
| **T3.7** | AAGCN | Bone Motion
|
| 99 |
-
| **T3.8** | Two-Stream AAGCN | Joint + Bone Streams | Late Fusion (Uniform Soft
|
| 100 |
-
| **T3.9** | Four-Stream AAGCN | 4 Streams Unified | Late Fusion (
|
| 101 |
|
| 102 |
---
|
| 103 |
|
|
@@ -108,13 +115,13 @@
|
|
| 108 |
|
| 109 |
| Augmentation Configuration | Excluded Operator / Domain | Val Loss | Val Window Acc (%) | Val Macro F1 | Test Window Acc (%) | Test Macro F1 | $\Delta$ vs Full (Test Win) | Status |
|
| 110 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 111 |
-
| **Candidate Full (All 5 Ops)** | None (Reference Suite) | 0.
|
| 112 |
-
| **Minus Noise / Jitter** | Gaussian Coordinate Jitter ($\sigma=0.008$) |
|
| 113 |
-
| **Minus Mirroring** | Sagittal Horizontal Flip ($p=0.5$) | 1.
|
| 114 |
-
| **Minus Rotation / Yaw** | Gravitational Yaw Rotation ($\pm 15^\circ$) | 1.
|
| 115 |
-
| **Minus Scaling** | Proportional Scale Variation ($\pm 10\%$) |
|
| 116 |
-
| **Minus Time Interpolation** | Temporal Resampling ($0.8\times - 1.2\times$) |
|
| 117 |
-
| **Clean Baseline (No Augmentation)** | All Operators Excluded | 1.
|
| 118 |
|
| 119 |
---
|
| 120 |
|
|
@@ -125,12 +132,12 @@
|
|
| 125 |
|
| 126 |
| Augmentation Strategy | Isolated Operator Description | Val Loss | Val Window Acc (%) | Val Macro F1 | Test Window Acc (%) | Test Macro F1 | Gain (+$\Delta$%) | Status |
|
| 127 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 128 |
-
| **None (Clean Baseline)** | Unaugmented Native Window Sequences | 1.
|
| 129 |
-
| **Only Jitter** | Gaussian Noise ($\sigma=0.008$) | 1.
|
| 130 |
-
| **Only Mirroring** | Sagittal Bilateral Reflection | 1.
|
| 131 |
-
| **Only Rotation** | 3D Yaw Perturbation ($\pm 15^\circ$) | 1.
|
| 132 |
-
| **Only Scaling** | Proportional Scale Jitter ($\pm 10\%$) | 1.
|
| 133 |
-
| **Only Time Interpolation** | Linear Sequence Resampling | 1.
|
| 134 |
|
| 135 |
---
|
| 136 |
|
|
@@ -141,17 +148,17 @@
|
|
| 141 |
|
| 142 |
| Architecture / Configuration | Fusion Protocol & Weighting | Val Win Acc (%) | Val Win F1 | Val Vid Acc (%) | Val Vid F1 | Test Win Acc (%) | Test Win F1 | Test Vid Acc (%) | Test Vid F1 | Status |
|
| 143 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 144 |
-
| **Transformer Mix (63-d)** | Single Sequence Backbone |
|
| 145 |
-
| **AAGCN Bone Stream** | Single Graph Backbone | 78.
|
| 146 |
-
| **Four-Stream AAGCN** | 4 Streams Unified Graph (Uniform Soft) |
|
| 147 |
-
| **SkelGym-Lite (Hard Majority Voting)** | Discrete mode over class predictions ($K=2$) |
|
| 148 |
-
| **SkelGym-Lite (Accuracy-Weighted Soft)** | Validation accuracy weights ($w_i \propto \text{Acc}_i^{\text{val}}$) | 83.
|
| 149 |
-
| **SkelGym-Lite (Uniform Average Soft)** | Equal weights: $w_i = 1/2 = 0.50$ (
|
| 150 |
-
| **SkelGym-Lite (Stacking Meta-Classifier)** | Ridge
|
| 151 |
-
| **SkelGym-Full (Hard Majority Voting)** | Discrete mode over class predictions ($K=5$) |
|
| 152 |
-
| **SkelGym-Full (Accuracy-Weighted Soft)** | Validation accuracy weights ($w_i \propto \text{Acc}_i^{\text{val}}$) |
|
| 153 |
-
| **SkelGym-Full (Uniform Average Soft)** | Equal weights: $w_i = 1/5 = 0.20$ (Zero-Param SOTA) |
|
| 154 |
-
| **SkelGym-Full (Stacking Meta-Classifier)** | Ridge
|
| 155 |
|
| 156 |
---
|
| 157 |
|
|
@@ -162,18 +169,17 @@
|
|
| 162 |
|
| 163 |
| Model Architecture | Input Modality / Paradigm | Trainable Params | Test Win Acc (%) | Test Win Macro F1 | Test Vid Acc (%) | Test Vid Macro F1 | Video Gain (+$\Delta$%) | Status |
|
| 164 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 165 |
-
| **
|
| 166 |
-
| **
|
| 167 |
-
| **
|
| 168 |
-
| **
|
| 169 |
-
| **
|
| 170 |
-
| **
|
| 171 |
-
| **
|
| 172 |
-
| **
|
| 173 |
-
| **
|
| 174 |
-
| **SkelGym-
|
| 175 |
-
| **SkelGym-Full (
|
| 176 |
-
| **SkelGym-Full (Stacking Meta-Classifier)** | 5-Stream Supervised Meta-Classifier (Overall SOTA) | 1.81M | 73.37% | 0.7242 | 83.83% | 0.8336 | +10.46% | Verified |
|
| 177 |
|
| 178 |
---
|
| 179 |
|
|
|
|
| 17 |
- **Biomechanical Mix v2 (`mix_v2`, 63-d):** Dual-branch concatenation of 39-d scale-norm coordinates and 24-d kinematic angles.
|
| 18 |
- **Model Capacity:** All sequence backbones standardized to $\approx 300\text{K}$ parameters (Transformer: $d_{\text{model}}=112, d_{\text{ff}}=168, \text{nhead}=4, \text{layers}=3$; LSTM: $h=160, \text{layers}=2$; BiLSTM: $h=96, \text{layers}=2$).
|
| 19 |
- **Augmentation Pipeline (SkelGym-Aug):** Dynamic on-the-fly transformations (Bilateral Sagittal Reflection + Gravitational 3D Yaw $\pm 15^\circ$ + Proportional Scaling $\pm 10\%$ + Gaussian Sensor Jitter $\sigma=0.008$).
|
| 20 |
+
- **Multi-Stream Ensemble:** 5-stream cross-paradigm late fusion (Transformer on 63-d mix_v2 + 4 spatial-temporal AAGCN streams: Bone 3D, Joint 3D, Joint-Motion 3D, Bone-Motion 3D) evaluated across 4 standardized fusion protocols (Hard Majority Voting, Accuracy-Weighted Soft Voting, Uniform Average Soft Voting, Stacking Meta-Classifier).
|
| 21 |
|
| 22 |
---
|
| 23 |
|
|
|
|
| 77 |
| Feature Paradigm | Input Dim | Params | Train Loss | Val Loss | Val Win Acc (%) | Val Win Macro F1 | Val Vid Acc (%) | Val Vid Macro F1 | Test Win Acc (%) | Test Win Macro F1 | Test Vid Acc (%) | Test Vid Macro F1 | Status |
|
| 78 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 79 |
| **Raw 3D Coordinates** | 39 | 301K | 0.3895 | 1.1361 | 77.04% ± 0.38% | 0.7662 ± 0.0063 | 78.90% ± 1.39% | 0.7972 ± 0.0076 | 63.36% ± 1.48% | 0.6228 ± 0.0176 | 72.39% ± 0.88% | 0.7045 ± 0.0130 | Verified |
|
| 80 |
+
| **Root-Relative 3D (`rel_3d`)** | 39 | 301K | 0.4344 | 1.1740 ± 0.0120 | 77.88% ± 0.89% | 0.7654 ± 0.0072 | — | — | 63.87% ± 0.73% | 0.6179 ± 0.0080 | — | — | Verified |
|
| 81 |
| **Scale-Norm Rel 3D (`rel_3d_norm`)** | 39 | 301K | 0.4241 | 1.1391 | 77.98% ± 0.86% | 0.7691 ± 0.0080 | 81.32% ± 0.46% | 0.8148 ± 0.0014 | 63.46% ± 0.40% | 0.6221 ± 0.0064 | 73.53% ± 1.07% | 0.7067 ± 0.0071 | Verified |
|
| 82 |
+
| **World 3D (`world_3d`, Metric)** | 39 | 301K | 0.3735 | 1.1306 ± 0.0049 | 78.76% ± 0.46% | 0.7781 ± 0.0053 | 81.97% ± 0.23% | 0.8254 ± 0.0066 | **65.33% ± 0.71%** | **0.6406 ± 0.0035** | **75.68% ± 0.53%** | **0.7343 ± 0.0085** | Verified |
|
| 83 |
| **Biomechanical Mix v2 (`mix_v2`)** | 63 | 300K | 0.4239 | 1.1005 | 77.70% ± 1.05% | 0.7724 ± 0.0118 | 81.00% ± 1.49% | 0.8075 ± 0.0236 | 63.90% ± 1.01% | 0.6318 ± 0.0086 | 74.82% ± 1.01% | 0.7265 ± 0.0108 | Verified |
|
| 84 |
|
| 85 |
+
> **Biomechanical Finding (Metric World 3D vs. Relative 3D):**
|
| 86 |
+
> 1. **Superior Physical Consistency:** MediaPipe `pose_world_landmarks` naturally establishes its Cartesian origin at the subject's pelvic midpoint ($p_{\text{hip\_mid}} = (0, 0, 0)$) with true physical metric scale ($x, y, z$ in meters). Unlike normalized image coordinates that require heuristic torso/hip normalization ($L_{\text{torso}}, L_{\text{hip}}$) and camera perspective de-warping, `world_3d` preserves true Euclidean segment lengths across frames.
|
| 87 |
+
> 2. **Benchmark Dominance:** On the exact same 301K Dual-Branch Transformer capacity across 3 seeds (42, 123, 3407), `world_3d` (39-d) achieves **75.68% ± 0.53%** Test Video Accuracy (+2.15% over `rel_3d_norm` and +3.29% over Raw 3D) and **65.33% ± 0.71%** Test Window Accuracy (+1.87% over `rel_3d_norm`). Standard deviation across seeds dropped by half ($\pm 0.53\%$ vs $\pm 1.07\%$), demonstrating exceptional spatial robustness.
|
| 88 |
+
> 3. **Compact Spatial Parity:** Pure 39-d `world_3d` outperforms even the 63-d unaugmented `mix_v2` (74.82% Video Acc) without requiring supplementary angular channels, establishing a new gold standard for single-stream resistance exercise recognition.
|
| 89 |
+
|
| 90 |
---
|
| 91 |
|
| 92 |
## Table 3: Spatial-Temporal Graph Kinematic Streams (Paper Table 4)
|
|
|
|
| 94 |
*Objective:* Evaluate static physical adjacency ($A_{\text{phys}}$) versus learnable adaptive topology ($B_k + C_k$) across 4 kinematic modalities.
|
| 95 |
*Execution Command:* `python run.py train --model AAGCN --feature <STREAM> --augment skel_gym_aug --device auto`
|
| 96 |
|
| 97 |
+
| Exp ID | Model Architecture | Kinematic Stream | Augmentation Protocol | Val Vid Acc (%) | Test Win Acc (%) | Test Win Macro F1 | Test Vid Acc (%) | Test Vid Macro F1 | Status |
|
| 98 |
+
| :---: | :--- | :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 99 |
+
| **T3.1** | ST-GCN Baseline | Raw 3D Joint | None (Clean) | 69.08% ± 1.42% | 48.35% ± 0.94% | 0.4701 ± 0.0141 | 58.65% ± 1.76% | 0.5432 ± 0.0208 | Verified |
|
| 100 |
+
| **T3.2** | ST-GCN Baseline | World 3D Joint | None (Clean) | 79.71% ± 1.98% | 62.59% ± 2.31% | 0.6034 ± 0.0219 | 74.68% ± 1.26% | 0.7060 ± 0.0161 | Verified |
|
| 101 |
+
| **T3.3** | AAGCN Baseline | Bone 3D Stream | None (Clean) | 79.06% ± 1.60% | 62.10% ± 2.11% | 0.6101 ± 0.0158 | 71.67% ± 2.80% | 0.7025 ± 0.0307 | Verified |
|
| 102 |
+
| **T3.4** | AAGCN | Bone 3D Stream | SkelGym-Aug (Proposed) | 81.80% ± 0.60% | 65.62% ± 1.37% | 0.6528 ± 0.0062 | 73.39% ± 1.22% | 0.7352 ± 0.0083 | Verified |
|
| 103 |
+
| **T3.5** | AAGCN | World Joint Stream | SkelGym-Aug (Proposed) | 82.29% ± 0.60% | 69.56% ± 1.03% | 0.6841 ± 0.0151 | 80.97% ± 2.94% | 0.8025 ± 0.0353 | Verified |
|
| 104 |
+
| **T3.6** | AAGCN | World Joint Motion ($\Delta X$) | SkelGym-Aug (Proposed) | 70.37% ± 1.86% | 53.41% ± 0.50% | 0.5207 ± 0.0073 | 70.53% ± 0.73% | 0.6788 ± 0.0216 | Verified |
|
| 105 |
+
| **T3.7** | AAGCN | Bone Motion ($\Delta B$) | SkelGym-Aug (Proposed) | 63.28% ± 2.40% | 48.76% ± 1.26% | 0.4784 ± 0.0151 | 66.38% ± 3.24% | 0.6226 ± 0.0304 | Verified |
|
| 106 |
+
| **T3.8** | Two-Stream AAGCN | Joint + Bone Streams | Late Fusion (Uniform Soft) | 84.06% ± 1.04% | 71.24% ± 1.09% | 0.7010 ± 0.0121 | 80.98% ± 0.41% | 0.8083 ± 0.0024 | Verified |
|
| 107 |
+
| **T3.9** | Four-Stream AAGCN | 4 Streams Unified Graph | Late Fusion (Uniform Soft) | 86.96% ± 0.79% | 73.41% ± 0.17% | 0.7233 ± 0.0022 | 83.26% ± 0.35% | 0.8237 ± 0.0036 | Verified |
|
| 108 |
|
| 109 |
---
|
| 110 |
|
|
|
|
| 115 |
|
| 116 |
| Augmentation Configuration | Excluded Operator / Domain | Val Loss | Val Window Acc (%) | Val Macro F1 | Test Window Acc (%) | Test Macro F1 | $\Delta$ vs Full (Test Win) | Status |
|
| 117 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 118 |
+
| **Candidate Full (All 5 Ops)** | None (Reference Suite) | 0.9669 | 79.19% ± 1.26% | 0.7882 ± 0.0152 | 72.40% ± 1.19% | 0.7145 ± 0.0083 | 0.00% (Ref) | Verified |
|
| 119 |
+
| **Minus Noise / Jitter** | Gaussian Coordinate Jitter ($\sigma=0.008$) | 1.0124 | 79.68% ± 0.22% | 0.7937 ± 0.0048 | 73.17% ± 0.90% | 0.7208 ± 0.0125 | +0.77% | Verified |
|
| 120 |
+
| **Minus Mirroring** | Sagittal Horizontal Flip ($p=0.5$) | 1.0670 | 78.78% ± 1.44% | 0.7757 ± 0.0197 | 68.27% ± 2.32% | 0.6725 ± 0.0242 | -4.13% | Verified |
|
| 121 |
+
| **Minus Rotation / Yaw** | Gravitational Yaw Rotation ($\pm 15^\circ$) | 1.0054 | 80.06% ± 0.32% | 0.7964 ± 0.0026 | 72.99% ± 0.60% | 0.7188 ± 0.0085 | +0.59% | Verified |
|
| 122 |
+
| **Minus Scaling** | Proportional Scale Variation ($\pm 10\%$) | 1.0032 | 80.13% ± 0.13% | 0.7985 ± 0.0022 | 73.02% ± 1.24% | 0.7198 ± 0.0123 | +0.62% | Verified |
|
| 123 |
+
| **Minus Time Interpolation** | Temporal Resampling ($0.8\times - 1.2\times$, **SkelGym-Aug 4-op**) | 1.0010 | 79.54% ± 0.57% | 0.7926 ± 0.0060 | 73.59% ± 0.48% | 0.7257 ± 0.0072 | +1.19% | Verified |
|
| 124 |
+
| **Clean Baseline (No Augmentation)** | All Operators Excluded | 1.0483 | 79.52% ± 0.80% | 0.7885 ± 0.0101 | 69.24% ± 0.20% | 0.6815 ± 0.0017 | -3.16% | Verified |
|
| 125 |
|
| 126 |
---
|
| 127 |
|
|
|
|
| 132 |
|
| 133 |
| Augmentation Strategy | Isolated Operator Description | Val Loss | Val Window Acc (%) | Val Macro F1 | Test Window Acc (%) | Test Macro F1 | Gain (+$\Delta$%) | Status |
|
| 134 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 135 |
+
| **None (Clean Baseline)** | Unaugmented Native Window Sequences | 1.0483 | 79.52% ± 0.80% | 0.7885 ± 0.0101 | 69.24% ± 0.20% | 0.6815 ± 0.0017 | 0.00% (Ref) | Verified |
|
| 136 |
+
| **Only Jitter** | Gaussian Noise ($\sigma=0.008$) | 1.0520 | 79.55% ± 0.82% | 0.7884 ± 0.0093 | 68.75% ± 0.87% | 0.6766 ± 0.0097 | -0.49% | Verified |
|
| 137 |
+
| **Only Mirroring** | Sagittal Bilateral Reflection | 1.0047 | 80.45% ± 0.45% | 0.8001 ± 0.0067 | 73.66% ± 0.56% | 0.7262 ± 0.0078 | +4.42% | Verified |
|
| 138 |
+
| **Only Rotation** | 3D Yaw Perturbation ($\pm 15^\circ$) | 1.0657 | 80.29% ± 0.34% | 0.7977 ± 0.0031 | 69.27% ± 1.19% | 0.6816 ± 0.0135 | +0.03% | Verified |
|
| 139 |
+
| **Only Scaling** | Proportional Scale Jitter ($\pm 10\%$) | 1.0519 | 79.68% ± 0.22% | 0.7904 ± 0.0066 | 68.90% ± 1.13% | 0.6789 ± 0.0125 | -0.34% | Verified |
|
| 140 |
+
| **Only Time Interpolation** | Linear Sequence Resampling | 1.0567 | 79.74% ± 0.24% | 0.7920 ± 0.0039 | 68.90% ± 0.75% | 0.6775 ± 0.0075 | -0.34% | Verified |
|
| 141 |
|
| 142 |
---
|
| 143 |
|
|
|
|
| 148 |
|
| 149 |
| Architecture / Configuration | Fusion Protocol & Weighting | Val Win Acc (%) | Val Win F1 | Val Vid Acc (%) | Val Vid F1 | Test Win Acc (%) | Test Win F1 | Test Vid Acc (%) | Test Vid F1 | Status |
|
| 150 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 151 |
+
| **Transformer Mix (63-d)** | Single Sequence Backbone | 79.54% ± 0.57% | 0.7926 ± 0.0060 | 83.90% ± 0.60% | 0.8350 ± 0.0070 | 73.59% ± 0.48% | 0.7257 ± 0.0072 | 83.55% ± 0.54% | 0.8300 ± 0.0054 | Verified |
|
| 152 |
+
| **AAGCN Bone Stream** | Single Graph Backbone | 78.66% ± 1.52% | 0.7812 ± 0.0150 | 81.80% ± 0.60% | 0.8190 ± 0.0060 | 65.62% ± 1.37% | 0.6528 ± 0.0062 | 73.39% ± 1.22% | 0.7352 ± 0.0083 | Verified |
|
| 153 |
+
| **Four-Stream AAGCN** | 4 Streams Unified Graph (Uniform Soft) | 84.14% ± 0.45% | 0.8395 ± 0.0040 | 86.96% ± 0.79% | 0.8710 ± 0.0080 | 73.41% ± 0.17% | 0.7233 ± 0.0022 | 83.26% ± 0.35% | 0.8237 ± 0.0036 | Verified |
|
| 154 |
+
| **SkelGym-Lite (Hard Majority Voting)** | Discrete mode over class predictions ($K=2$) | 77.62% ± 1.31% | 0.7705 ± 0.0134 | 85.35% ± 0.23% | 0.8539 ± 0.0037 | 66.60% ± 1.58% | 0.6714 ± 0.0111 | 82.40% ± 0.35% | 0.8234 ± 0.0039 | Verified |
|
| 155 |
+
| **SkelGym-Lite (Accuracy-Weighted Soft)** | Validation accuracy weights ($w_i \propto \text{Acc}_i^{\text{val}}$) | 83.42% ± 0.24% | 0.8322 ± 0.0023 | 85.18% ± 0.23% | 0.8527 ± 0.0036 | 73.57% ± 0.42% | 0.7265 ± 0.0043 | 82.26% ± 0.20% | 0.8220 ± 0.0038 | Verified |
|
| 156 |
+
| **SkelGym-Lite (Uniform Average Soft)** | Equal weights: $w_i = 1/2 = 0.50$ (Zero-Param Heuristic) | 83.52% ± 0.17% | 0.8332 ± 0.0017 | 85.35% ± 0.23% | 0.8539 ± 0.0037 | 73.31% ± 0.37% | 0.7240 ± 0.0051 | 82.40% ± 0.35% | 0.8234 ± 0.0039 | Verified |
|
| 157 |
+
| **SkelGym-Lite (Stacking Meta-Classifier)** | Ridge/Logistic Regression on Val Probs | 87.65% ± 0.40% | 0.8758 ± 0.0028 | 89.70% ± 0.60% | 0.8970 ± 0.0094 | 73.61% ± 0.21% | 0.7271 ± 0.0037 | 83.55% ± 0.88% | 0.8338 ± 0.0054 | Verified |
|
| 158 |
+
| **SkelGym-Full (Hard Majority Voting)** | Discrete mode over class predictions ($K=5$) | 83.33% ± 1.03% | 0.8322 ± 0.0101 | 88.89% ± 0.79% | 0.8892 ± 0.0081 | 72.96% ± 0.05% | 0.7248 ± 0.0020 | 83.69% ± 0.70% | 0.8308 ± 0.0111 | Verified |
|
| 159 |
+
| **SkelGym-Full (Accuracy-Weighted Soft)** | Validation accuracy weights ($w_i \propto \text{Acc}_i^{\text{val}}$) | 85.19% ± 0.11% | 0.8503 ± 0.0012 | 88.57% ± 0.91% | 0.8848 ± 0.0076 | 75.51% ± 0.47% | 0.7448 ± 0.0042 | 84.69% ± 0.54% | 0.8417 ± 0.0072 | Verified |
|
| 160 |
+
| **SkelGym-Full (Uniform Average Soft)** | Equal weights: $w_i = 1/5 = 0.20$ (Zero-Param SOTA) | 85.33% ± 0.43% | 0.8517 ± 0.0053 | 88.89% ± 0.79% | 0.8892 ± 0.0081 | 75.41% ± 0.19% | 0.7439 ± 0.0011 | 83.69% ± 0.70% | 0.8308 ± 0.0111 | Verified |
|
| 161 |
+
| **SkelGym-Full (Stacking Meta-Classifier)** | Ridge/Logistic Regression on Val Probs (All-Time SOTA) | 93.41% ± 0.09% | 0.9313 ± 0.0019 | 94.85% ± 0.46% | 0.9507 ± 0.0004 | 75.13% ± 0.66% | 0.7418 ± 0.0079 | **85.84% ± 0.61%** | **0.8540 ± 0.0098** | Verified |
|
| 162 |
|
| 163 |
---
|
| 164 |
|
|
|
|
| 169 |
|
| 170 |
| Model Architecture | Input Modality / Paradigm | Trainable Params | Test Win Acc (%) | Test Win Macro F1 | Test Vid Acc (%) | Test Vid Macro F1 | Video Gain (+$\Delta$%) | Status |
|
| 171 |
| :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 172 |
+
| **LSTM (World 3D Clean)** | Metric World 3D (39-d) | 362K | 61.41% ± 0.80% | 0.6002 ± 0.0063 | 71.10% ± 2.33% | 0.6941 ± 0.0294 | +9.69% | Verified |
|
| 173 |
+
| **LSTM (Biomechanical Mix v2)** | Biomechanical Mix v2 (63-d) | 362K | 62.80% ± 0.83% | 0.6171 ± 0.0089 | 72.39% ± 1.76% | 0.7077 ± 0.0172 | +9.59% | Verified |
|
| 174 |
+
| **BiLSTM (Biomechanical Mix v2)** | Biomechanical Mix v2 (63-d) | 360K | 64.82% ± 0.37% | 0.6316 ± 0.0027 | 75.39% ± 1.46% | 0.7342 ± 0.0144 | +10.57% | Verified |
|
| 175 |
+
| **Transformer (Mix v2 Clean)** | Biomechanical Mix v2 (63-d) | 301K | 69.24% ± 0.20% | 0.6815 ± 0.0017 | 79.83% ± 1.27% | 0.7806 ± 0.0214 | +10.59% | Verified |
|
| 176 |
+
| **Transformer (Mix v2 + SkelGym-Aug)** | Biomechanical Mix v2 (63-d) | 301K | 73.59% ± 0.48% | 0.7257 ± 0.0072 | 83.55% ± 0.54% | 0.8300 ± 0.0054 | +9.96% | Verified |
|
| 177 |
+
| **ST-GCN (Raw 3D Clean)** | Raw 3D Joint ($V=13$) | 350K | 48.35% ± 0.94% | 0.4701 ± 0.0141 | 58.65% ± 1.76% | 0.5432 ± 0.0208 | +10.30% | Verified |
|
| 178 |
+
| **AAGCN (Bone 3D + SkelGym-Aug)** | Bone 3D Vector ($V=13$) | 378K | 65.62% ± 1.37% | 0.6528 ± 0.0062 | 73.39% ± 1.22% | 0.7352 ± 0.0083 | +7.77% | Verified |
|
| 179 |
+
| **Four-Stream AAGCN (Uniform Soft)** | 4 Graph Streams Unified | 1.51M | 73.41% ± 0.17% | 0.7233 ± 0.0022 | 83.26% ± 0.35% | 0.8237 ± 0.0036 | +9.85% | Verified |
|
| 180 |
+
| **SkelGym-Lite (Uniform Soft Voting)** | Trans + Bone AAGCN (Efficient SOTA) | 679K | 73.31% ± 0.37% | 0.7240 ± 0.0051 | 82.40% ± 0.35% | 0.8234 ± 0.0039 | +9.09% | Verified |
|
| 181 |
+
| **SkelGym-Full (Uniform Soft Voting)** | 5-Stream Cross-Paradigm (Zero-Param SOTA) | 1.81M | 75.41% ± 0.19% | 0.7439 ± 0.0011 | 83.69% ± 0.70% | 0.8308 ± 0.0111 | +8.28% | Verified |
|
| 182 |
+
| **SkelGym-Full (Stacking Meta-Classifier)** | 5-Stream Supervised Meta-Classifier (Overall SOTA) | 1.81M | 75.13% ± 0.66% | 0.7418 ± 0.0079 | **85.84% ± 0.61%** | **0.8540 ± 0.0098** | +10.71% | Verified |
|
|
|
|
| 183 |
|
| 184 |
---
|
| 185 |
|