File size: 2,108 Bytes
0bf742f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---

license: other
license_name: alphamocap-model-pack
license_link: https://huggingface.co/alpha-studio/alphamocap-models/blob/main/LICENSES/NOTICE.txt
library_name: onnx
pipeline_tag: other
tags:
  - motion-capture
  - pose-estimation
  - onnx
  - blender
---


# AlphaMocap model pack

The models AlphaMocap runs to turn one video of
a person into body motion. AlphaMocap's installer downloads this pack; the
files are ONNX, run by ONNX Runtime on an NVIDIA GPU, and are of no use to
anything but the AlphaMocap solver without its code.

**These are not alpha-studio's models.** They are other people's work, some
exported or changed here to run without PyTorch, each under its own licence
-- read them in `LICENSES/` before using any file on its own.

| File | What | From | Licence |
| --- | --- | --- | --- |
| `yolox.onnx` | YOLOX-X person detector | OpenMMLab, the MMPose RTMPose SDK, as shipped | Apache-2.0 |
| `vitpose.onnx` + `.data` | GEM-X 77-keypoint pose model | NVIDIA [GEM-X](https://huggingface.co/nvidia/GEM-X), weights re-saved into one file | NVIDIA Open Model License |
| `gem.onnx` + `.data` | GEM-X motion regressor | NVIDIA GEM-X, its contact head restored | NVIDIA Open Model License |
| `sam3d.onnx` + `.data` | SAM 3D Body, to its pose token, with the MHR body model inside | Meta [SAM 3D Body](https://github.com/facebookresearch/sam-3d-body) and MHR, exported whole here | SAM License; MHR Apache-2.0 |
| `videomocap.bin` | decoder statistics, skeleton, rest-skeleton model | derived from GEM-X and NVIDIA SOMA | Apache-2.0 |

`vitpose` and `gem`: Licensed by NVIDIA Corporation under the NVIDIA Open Model License.
The NVIDIA Open Model License is in `LICENSES/NVIDIA-Open-Model-License.txt`.

`sam3d`: SAM 3D Body is licensed under the SAM License,
`LICENSES/SAM-LICENSE.txt`, which among other things does not allow its use
for military purposes and makes its use subject to trade controls.

`manifest.json` lists every file with its size and SHA-256.

alpha-studio is not affiliated with, or endorsed by, NVIDIA, Meta or OpenMMLab.