Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- time-series
|
| 4 |
+
- kinematics
|
| 5 |
+
- biomechanics
|
| 6 |
+
- gait-analysis
|
| 7 |
+
- transformer
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
library_name: pytorch
|
| 10 |
+
pipeline_tag: time-series-classification
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# PoseT5: Compact Multivariate Gait Kinematics & Keystroke Predictor
|
| 14 |
+
|
| 15 |
+
PoseT5 is a lightweight (~430K parameter) time-series transformer architecture designed for real-time 3D skeletal motion capture and inverse kinematic keystroke estimation.
|
| 16 |
+
|
| 17 |
+
## Organization
|
| 18 |
+
Trained and hosted under **[Learningbase](https://huggingface.co/Learningbase)**.
|
| 19 |
+
|
| 20 |
+
## Performance Metrics
|
| 21 |
+
- **Validation Macro F1**: 0.7110
|
| 22 |
+
- **Hamming Loss**: 0.2041
|
| 23 |
+
|
| 24 |
+
| Keystroke | Action | F1 Score | Precision | Recall |
|
| 25 |
+
|---|---|---|---|---|
|
| 26 |
+
| `W` | Forward Walk/Run | 0.940 | 0.940 | 0.940 |
|
| 27 |
+
| `A` | Yaw Turn Left | 0.385 | 0.263 | 0.724 |
|
| 28 |
+
| `S` | Backward Move | 0.947 | 0.900 | 1.000 |
|
| 29 |
+
| `D` | Yaw Turn Right | 0.440 | 0.289 | 0.923 |
|
| 30 |
+
| `Space` | Jump Dynamics | 0.842 | 0.800 | 0.889 |
|
| 31 |
+
|
| 32 |
+
## Architecture Details
|
| 33 |
+
- **Input Channels**: 22 humanoid anatomical joints $\times$ 7 continuous DOF = **154 continuous channels**.
|
| 34 |
+
- **Instance Normalization**: Reversible Instance Normalization (RevIN).
|
| 35 |
+
- **Temporal Patching**: Slices 32 frames into 4 patches ($P=8$) projected into $d_{\text{model}} = 128$.
|
| 36 |
+
- **Backbone**: 2-layer Multi-Head Self-Attention Transformer Encoder ($430\text{K}$ parameters).
|
| 37 |
+
- **Efficiency**: Sub-millisecond CPU inference latency (< 2ms).
|