noahcao commited on
Commit
4df098a
·
0 Parent(s):

FAH model weights

Browse files
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FAH model weights: licence
2
+
3
+ This licence covers all FAH model weights, including shared/detector.pt, fitted data files in the code tree,
4
+ and exports derived from them (TensorRT engines, ONNX files and Core ML packages). Code is covered separately by
5
+ LICENSE and NOTICE.
6
+
7
+ Part 3 applies to all FAH Weights. Parts 1 and 2 apply to components derived from SAM and DINOv3 respectively;
8
+ Part 4 records the detector's distribution and training terms. Upstream terms remain applicable and this licence grants no rights
9
+ beyond them.
10
+
11
+
12
+ PART 1. SAM LICENSE (PASS-THROUGH)
13
+
14
+ The pose models derive from SAM 3D Body (Meta Platforms, Inc.): SAM 3D Body was their teacher, and FAH-H also starts
15
+ from its image encoder. The fitters, video refiner, contact models and fitted data were trained on these models or
16
+ their outputs. These SAM-derived components are distributed under the SAM License, reproduced below. Research
17
+ publications using them must acknowledge SAM 3D Body (the SAM Materials). The detector uses FAH-generated labels;
18
+ Part 4 records its distribution and training terms.
19
+
20
+ ----------------------------------------------------------------------------------------------------------------------
21
+ SAM License
22
+ Last Updated: November 19, 2025
23
+
24
+ “Agreement” means the terms and conditions for use, reproduction, distribution and modification of the SAM Materials set forth herein.
25
+
26
+ “SAM Materials” means, collectively, Documentation and the models, software and algorithms, including machine-learning model code, trained model weights, inference-enabling code, training-enabling code, fine-tuning enabling code, and other elements of the foregoing distributed by Meta and made available under this Agreement.
27
+
28
+ “Documentation” means the specifications, manuals and documentation accompanying
29
+ SAM Materials distributed by Meta.
30
+
31
+ “Licensee” or “you” means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity’s behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf.
32
+
33
+ “Meta” or “we” means Meta Platforms Ireland Limited (if you are located in or, if you are an entity, your principal place of business is in the EEA or Switzerland) or Meta Platforms, Inc. (if you are located outside of the EEA or Switzerland).
34
+
35
+ “Sanctions” means any economic or trade sanctions or restrictions administered or enforced by the United States (including the Office of Foreign Assets Control of the U.S. Department of the Treasury (“OFAC”), the U.S. Department of State and the U.S. Department of Commerce), the United Nations, the European Union, or the United Kingdom.
36
+
37
+ “Trade Controls” means any of the following: Sanctions and applicable export and import controls.
38
+
39
+ By using or distributing any portion or element of the SAM Materials, you agree to be bound by this Agreement.
40
+
41
+ 1. License Rights and Redistribution.
42
+
43
+ a. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under Meta’s intellectual property or other rights owned by Meta embodied in the SAM Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the SAM Materials.
44
+
45
+ i. Grant of Patent License. Subject to the terms and conditions of this License, you are granted a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable (except as stated in this section) patent license to make, have made, use, offer to sell, sell, import, and otherwise transfer the Work, where such license applies only to those patent claims licensable by Meta that are necessarily infringed alone or by combination of their contribution(s) with the SAM 3 Materials. If you institute patent litigation against any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the SAM 3 Materials incorporated within the work constitutes direct or contributory patent infringement, then any patent licenses granted to you under this License for that work shall terminate as of the date such litigation is filed.
46
+
47
+ b. Redistribution and Use.
48
+
49
+ i. Distribution of SAM Materials, and any derivative works thereof, are subject to the terms of this Agreement. If you distribute or make the SAM Materials, or any derivative works thereof, available to a third party, you may only do so under the terms of this Agreement and you shall provide a copy of this Agreement with any such SAM Materials.
50
+
51
+ ii. If you submit for publication the results of research you perform on, using, or otherwise in connection with SAM Materials, you must acknowledge the use of SAM Materials in your publication.
52
+
53
+ iii. Your use of the SAM Materials must comply with applicable laws and regulations, including Trade Control Laws and applicable privacy and data protection laws.
54
+ iv. Your use of the SAM Materials will not involve or encourage others to reverse engineer, decompile or discover the underlying components of the SAM Materials.
55
+ v. You are not the target of Trade Controls and your use of SAM Materials must comply with Trade Controls. You agree not to use, or permit others to use, SAM Materials for any activities subject to the International Traffic in Arms Regulations (ITAR) or end uses prohibited by Trade Controls, including those related to military or warfare purposes, nuclear industries or applications, espionage, or the development or use of guns or illegal weapons.
56
+ 2. User Support. Your use of the SAM Materials is done at your own discretion; Meta does not process any information nor provide any service in relation to such use. Meta is under no obligation to provide any support services for the SAM Materials. Any support provided is “as is”, “with all faults”, and without warranty of any kind.
57
+
58
+ 3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE SAM MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE SAM MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE SAM MATERIALS AND ANY OUTPUT AND RESULTS.
59
+
60
+ 4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
61
+
62
+ 5. Intellectual Property.
63
+
64
+ a. Subject to Meta’s ownership of SAM Materials and derivatives made by or for Meta, with respect to any derivative works and modifications of the SAM Materials that are made by you, as between you and Meta, you are and will be the owner of such derivative works and modifications.
65
+
66
+ b. If you institute litigation or other proceedings against Meta or any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the SAM Materials, outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless Meta from and against any claim by any third party arising out of or related to your use or distribution of the SAM Materials.
67
+
68
+ 6. Term and Termination. The term of this Agreement will commence upon your acceptance of this Agreement or access to the SAM Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein. Meta may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of the SAM Materials. Sections 3, 4 and 7 shall survive the termination of this Agreement.
69
+
70
+ 7. Governing Law and Jurisdiction. This Agreement will be governed and construed under the laws of the State of California without regard to choice of law principles, and the UN Convention on Contracts for the International Sale of Goods does not apply to this Agreement. The courts of California shall have exclusive jurisdiction of any dispute arising out of this Agreement.
71
+
72
+ 8. Modifications and Amendments. Meta may modify this Agreement from time to time; provided that they are similar in spirit to the current version of the Agreement, but may differ in detail to address new problems or concerns. All such changes will be effective immediately. Your continued use of the SAM Materials after any modification to this Agreement constitutes your agreement to such modification. Except as provided in this Agreement, no modification or addition to any provision of this Agreement will be binding unless it is in writing and signed by an authorized representative of both you and Meta.
73
+
74
+ ----------------------------------------------------------------------------------------------------------------------
75
+
76
+
77
+ PART 2. DINOV3 LICENSE (PASS-THROUGH)
78
+
79
+ The pose models (FAH-S, FAH-B and FAH-L: encoders initialised from DINOv3; FAH-H: SAM 3D Body's DINOv3 encoder), the
80
+ contact heads (copies of those encoders' last blocks) and the camera-motion head (a DINOv3 ViT-S encoder) are also
81
+ derived from DINOv3 (Meta Platforms, Inc.) and are distributed under the DINOv3 License, reproduced below.
82
+
83
+ Built with DINOv3.
84
+
85
+ ----------------------------------------------------------------------------------------------------------------------
86
+ # DINOv3 License
87
+
88
+ *Last Updated: August 19, 2025*
89
+
90
+ **“Agreement”** means the terms and conditions for use, reproduction, distribution and modification of the DINO Materials set forth herein.
91
+
92
+ **“DINO Materials”** means, collectively, Documentation and the models, software and algorithms, including machine-learning model code, trained model weights, inference-enabling code, training-enabling code, fine-tuning enabling code, and other elements of the foregoing distributed by Meta and made available under this Agreement.
93
+
94
+ **“Documentation”** means the specifications, manuals and documentation accompanying
95
+ DINO Materials distributed by Meta.
96
+
97
+ **“Licensee”** or **“you”** means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity’s behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf.
98
+
99
+ **“Meta”** or **“we”** means Meta Platforms Ireland Limited (if you are located in or, if you are an entity, your principal place of business is in the EEA or Switzerland) or Meta Platforms, Inc. (if you are located outside of the EEA or Switzerland).
100
+
101
+ **“Sanctions”** means any economic or trade sanctions or restrictions administered or enforced by the United States (including the Office of Foreign Assets Control of the U.S. Department of the Treasury (“OFAC”), the U.S. Department of State and the U.S. Department of Commerce), the United Nations, the European Union, or the United Kingdom.
102
+
103
+ **“Trade Controls”** means any of the following: Sanctions and applicable export and import controls.
104
+
105
+ By clicking “I Accept” below or by using or distributing any portion or element of the DINO Materials, you agree to be bound by this Agreement.
106
+
107
+ ## 1. License Rights and Redistribution.
108
+
109
+ a. <ins>Grant of Rights</ins>. You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under Meta’s intellectual property or other rights owned by Meta embodied in the DINO Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the DINO Materials.
110
+
111
+ b. <ins>Redistribution and Use</ins>.
112
+
113
+ i. Distribution of DINO Materials, and any derivative works thereof, are subject to the terms of this Agreement. If you distribute or make the DINO Materials, or any derivative works thereof, available to a third party, you may only do so under the terms of this Agreement and you shall provide a copy of this Agreement with any such DINO Materials.
114
+
115
+ ii. If you submit for publication the results of research you perform on, using, or otherwise in connection with DINO Materials, you must acknowledge the use of DINO Materials in your publication.
116
+
117
+ iii. Your use of the DINO Materials must comply with applicable laws and regulations, including Trade Control Laws and applicable privacy and data protection laws.
118
+
119
+ iv. Your use of the DINO Materials will not involve or encourage others to reverse engineer, decompile or discover the underlying components of the DINO Materials.
120
+
121
+ v. You are not the target of Trade Controls and your use of DINO Materials must comply with Trade Controls. You agree not to use, or permit others to use, DINO Materials for any activities subject to the International Traffic in Arms Regulations (ITAR) or end uses prohibited by Trade Controls, including those related to military or warfare purposes, nuclear industries or applications, espionage, or the development or use of guns or illegal weapons.
122
+
123
+ ## 2. User Support.
124
+
125
+ Your use of the DINO Materials is done at your own discretion; Meta does not process any information nor provide any service in relation to such use. Meta is under no obligation to provide any support services for the DINO Materials. Any support provided is “as is”, “with all faults”, and without warranty of any kind.
126
+
127
+ ## 3. Disclaimer of Warranty.
128
+
129
+ UNLESS REQUIRED BY APPLICABLE LAW, THE DINO MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE DINO MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE DINO MATERIALS AND ANY OUTPUT AND RESULTS.
130
+
131
+ ## 4. Limitation of Liability.
132
+
133
+ IN NO EVENT WILL META OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
134
+
135
+ ## 5. Intellectual Property.
136
+
137
+ a. Subject to Meta’s ownership of DINO Materials and derivatives made by or for Meta, with respect to any derivative works and modifications of the DINO Materials that are made by you, as between you and Meta, you are and will be the owner of such derivative works and modifications.
138
+
139
+ b. If you institute litigation or other proceedings against Meta or any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the DINO Materials, outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless Meta from and against any claim by any third party arising out of or related to your use or distribution of the DINO Materials.
140
+
141
+ ## 6. Term and Termination.
142
+
143
+ The term of this Agreement will commence upon your acceptance of this Agreement or access to the DINO Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein. Meta may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of the DINO Materials. Sections 3, 4 and 7 shall survive the termination of this Agreement.
144
+
145
+ ## 7. Governing Law and Jurisdiction.
146
+
147
+ This Agreement will be governed and construed under the laws of the State of California without regard to choice of law principles, and the UN Convention on Contracts for the International Sale of Goods does not apply to this Agreement. The courts of California shall have exclusive jurisdiction of any dispute arising out of this Agreement.
148
+
149
+ ## 8. Modifications and Amendments.
150
+
151
+ Meta may modify this Agreement from time to time; provided that they are similar in spirit to the current version of the Agreement, but may differ in detail to address new problems or concerns. All such changes will be effective immediately. Your continued use of the DINO Materials after any modification to this Agreement constitutes your agreement to such modification. Except as provided in this Agreement, no modification or addition to any provision of this Agreement will be binding unless it is in writing and signed by an authorized representative of both you and Meta.
152
+
153
+ ----------------------------------------------------------------------------------------------------------------------
154
+
155
+
156
+ PART 3. ADDITIONAL RESTRICTION: RESEARCH AND NON-COMMERCIAL USE ONLY
157
+
158
+ In addition to the applicable upstream terms, the FAH Weights may be used, reproduced, modified and distributed for research and other
159
+ non-commercial purposes only. Any distribution of the FAH Weights or of works derived from them must carry this
160
+ licence, including this restriction.
161
+
162
+ Why: the FAH Weights were trained with models and data whose licences do not allow commercial use of networks trained
163
+ on them.
164
+ - MANO (Max Planck Institute for Intelligent Systems licence): "This license also prohibits the use of the Software to
165
+ train methods/algorithms/neural networks/etc. for commercial, pornographic, military, surveillance, or defamatory use
166
+ of any kind." MANO meshes and fits supervise the pose models, the contact heads and the mesh fitters.
167
+ - ARCTIC (Max Planck Institute for Intelligent Systems licence; the contact heads, the video contact models and the
168
+ camera-motion head): the same prohibition.
169
+ - Training data licensed for non-commercial or research use only: the HOT3D hand annotations (CC BY-NC-SA 4.0), DexYCB
170
+ (CC BY-NC 4.0), InterHand2.6M (CC BY-NC 4.0), HOI4D (CC BY-NC 4.0), COCO-WholeBody, EPIC-KITCHENS-100 and VISOR (CC
171
+ BY-NC 4.0), FreiHAND and HanCo, HO-3D, the CMU Panoptic hand labels, EgoDex (CC BY-NC-ND), MOW with HACO's contact
172
+ labels (CC BY-NC 4.0).
173
+ - WiLoR (CC BY-NC-ND 4.0): its outputs are distillation targets of the pose models.
174
+ - The camera-motion head contains torchvision's pretrained RAFT-small weights, trained on FlyingChairs and FlyingThings3D
175
+ (research use only).
176
+
177
+ The FAH Weights do not contain or redistribute any of these datasets or the MANO model. MANO is downloaded by the user
178
+ under its own licence.
179
+
180
+
181
+ PART 4. DETECTOR PROVENANCE AND UPSTREAM TERMS
182
+
183
+ This part covers the hand detector shared/detector.pt
184
+ and exports derived from it. Non-commercial research use only; Part 3 and the applicable upstream terms apply.
185
+
186
+ The detector checkpoint is provided by FAH.
187
+
188
+ - Ultralytics: the YOLOv8 lineage and training software carry AGPL-3.0 terms to the extent applicable
189
+ (https://github.com/ultralytics/ultralytics). Inference uses FAH's own implementation in fah/yolo.py.
190
+ - Training sources: COCO-WholeBody, VISOR, HOT3D, HInt, CMU Panoptic, HaGRID v2, OakInk2 and reviewed hard hands;
191
+ SAM 2.1 / SAM 3 masks and FAH labels. Dataset terms remain applicable; no dataset is redistributed.
192
+
193
+ When sharing detector weights or publishing results, credit FAH and Ultralytics YOLOv8, and include this licence. Stricter upstream terms prevail; this file does not grant permission to override them.
194
+
195
+ The detector weights are provided AS IS, without warranties of any kind. The authors are not liable for claims,
196
+ damages or other liability arising from their use.
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: fah-weights-license
4
+ license_link: LICENSE
5
+ tags:
6
+ - hand-pose-estimation
7
+ - 3d-hand-reconstruction
8
+ - mano
9
+ - hand-contact
10
+ - egocentric
11
+ ---
12
+
13
+ # FAH model weights
14
+
15
+ Weights for **FAH: Fast and Accurate Hand Estimation in Pixels, Interaction and World Space**.
16
+ Code, installation and usage: [github.com/noahcao/FAH](https://github.com/noahcao/FAH).
17
+
18
+ ## Download
19
+
20
+ ```bash
21
+ hf download noahcao/FAH --exclude "qc/*" --local-dir ~/.cache/fah/weights
22
+ ```
23
+
24
+ FAH reads the weights from `~/.cache/fah/weights`, `$FAH_WEIGHTS` or `--weights DIR`. MANO and the SAM 3D Body
25
+ config are not included; the repository README explains how to get them.
26
+
27
+ ## Contents
28
+
29
+ | Path | Contents |
30
+ |---|---|
31
+ | `fah-s/`, `fah-b/`, `fah/` (FAH-L), `fah-h/` | `model.pt` (pose network), `config.json`, `contact.pt` (contact head), `contact_video.pt` (video contact model) |
32
+ | `shared/detector.pt` | hand detector (boxes, handedness and instance masks) |
33
+ | `shared/mesh_fitter.pt`, `shared/mhr_fitter.pt` | MANO and MHR-Hand fitters |
34
+ | `shared/video_refiner.pt`, `shared/camera_motion.pt` | causal video refiner and camera-motion model |
35
+ | `qc/` | label-QC lists used by the training recipe (`python -m train.fetch_qc`, see `docs/training.md`); not needed for inference |
36
+ | `SHA256SUMS` | checksums of all files (`sha256sum -c SHA256SUMS` in the download directory) |
37
+
38
+ ## Licence
39
+
40
+ Research and non-commercial use only, under [LICENSE](LICENSE). The pose models, fitters, video and contact models
41
+ derive from SAM 3D Body and DINOv3 and carry the SAM License and the DINOv3 License (reproduced in LICENSE).
42
+ Built with DINOv3. The detector's provenance and terms are in Part 4 of LICENSE. No dataset images or the MANO model
43
+ are included.
44
+
45
+ ## Citation
46
+
47
+ ```bibtex
48
+ @misc{fah2026,
49
+ title = {Fast and Accurate Hand Estimation in Pixels, Interaction and World Space},
50
+ author = {Cao, Jinkun},
51
+ year = {2026},
52
+ note = {Project page and paper link to be added}
53
+ }
54
+ ```
SHA256SUMS ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 89a3887ea903f25bf8a47dc831df880f85fdd5978f353ab009729b8f7b3fab21 fah-b/config.json
2
+ dd3be189081b799c13549a0e0e82d1fd4c68471ce26abe62601fca31241b896b fah-b/contact.pt
3
+ 52807b787a7770369ca973d7ddb08c12d369bb93790dd57cd1140dedb55b5bbd fah-b/contact_video.pt
4
+ 49378428ae01228c33748e3f90fb8da4af6f90c86b3304fd3f4eef259e0c74b2 fah-b/model.pt
5
+ 3c2de59590870de66288c58a3795d3da077409e8da020fd0528821d2224c0047 fah-h/config.json
6
+ 9c6e72112b99612b3352db2c96a6c8fc97bd471caed21fe3dc634745c39b7ba6 fah-h/contact.pt
7
+ 63707e6a1dba6f34437826db4668f52109d74df424cac6055fd6ecc2d244e1ac fah-h/contact_video.pt
8
+ 2647268ec978a3eca5daecee6ced349c69de2c95b5530db08020d36738250d94 fah-h/model.pt
9
+ 89a3887ea903f25bf8a47dc831df880f85fdd5978f353ab009729b8f7b3fab21 fah-s/config.json
10
+ b41528d1ffdb8eb00847138dba7577e04055bb670bdd459f4a10cfe65cca4931 fah-s/contact.pt
11
+ f18f03b84ddd18b87b118f5efc4b1be1068268406326c0201c1a4134befef7d3 fah-s/contact_video.pt
12
+ f469c80356391c2993c58b4421ef3ee81c36549af932cffed1824a038147484c fah-s/model.pt
13
+ 89a3887ea903f25bf8a47dc831df880f85fdd5978f353ab009729b8f7b3fab21 fah/config.json
14
+ 21189dca09787e48ee282fbb34b270ca4651a632a089bfa4c132a4936c788721 fah/contact.pt
15
+ 4361149409feb4902cd362b8f18b6cf3b64f096be6ede2b50f4a966d6dd5b79a fah/contact_video.pt
16
+ 3ceccb5e0f944c0949de999aae0eba8736f2ab83b5e934507dc5bb45a115a11b fah/model.pt
17
+ 73b598962ecc2f0dca37812cd2a775b744781135abb7c7659c10a8c5679d66d9 qc/cmu_lab_kin/mask_qc.jsonl.gz
18
+ cf0754399d99dbec48a683de9a9676564c146e7cae0dda1d13cbf8348a2318b1 qc/coco_wb_kin/mask_qc.jsonl.gz
19
+ f104034fa22fb195683eaa4342634541bbfebcb99001b9a47c51a751597e4ce8 qc/egodex_part1_mano/qc.0.jsonl.gz
20
+ b326a609baaeaf124d8cb106e39cf5e0756ade5fce9cc339539be7463a2a4df3 qc/egodex_part1_mano/qc.1.jsonl.gz
21
+ 68c3ee899bee1ea79406e918101e279d2e14ad82c56047a054bfd05ba80a4919 qc/egodex_part1_mano/qc.2.jsonl.gz
22
+ 894fe1b19f9609a62d24c0fe9c11250c9ff09f902d3329edbcc3935973bac683 qc/egodex_part1_mano/qc.3.jsonl.gz
23
+ 77e8f87a6e9795e00d9324d0e5a1071dd8f4f78954c8efd60db2bdd60c0c99a0 qc/egodex_test_mano/mask_qc.jsonl.gz
24
+ 3e438015859d9413990eedee6fd2c06f5d1617e61f2dc0e3c8349d6b2f15fd97 qc/hint_lab_kin/mask_qc.jsonl.gz
25
+ f179dd168d46187b4bf84862111f0791e612e00d87b6ff53b61d8b35c958e5aa shared/camera_motion.pt
26
+ 6924e002703c7b3951bb8c19f9f75dcbfaf395b7ca28490f19bb30aab8561627 shared/detector.pt
27
+ fedc741cc997fd9fa9ebc4b985e5811f687c143afc5459be594c3ccdba31d323 shared/mesh_fitter.pt
28
+ 8701d55807f78802d7a6996c7d36209e2c73f23bcc9888ede4e4205a9cbbf1c9 shared/mhr_fitter.pt
29
+ ec84bfbbe923cd6cdc0dc60dcb59cc16b3ee826976dac6fb15de21a06d3dcc16 shared/video_refiner.pt
fah-b/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "model.pt",
3
+ "detector": "../shared/detector.pt",
4
+ "mesh_fitter": "../shared/mesh_fitter.pt",
5
+ "video_refiner": "../shared/video_refiner.pt",
6
+ "input_size": 320,
7
+ "image": {
8
+ "verify": true,
9
+ "det_conf": 0.05,
10
+ "det_size": 640,
11
+ "recrop_border": 0.03,
12
+ "min_crop": 1.1,
13
+ "pair_keep": 0.15,
14
+ "mesh_fit": 1,
15
+ "mesh_fit_jac": "fd",
16
+ "tip_extend": 0.6,
17
+ "parts_in_mask": true
18
+ },
19
+ "video": {
20
+ "refiner_euro": [
21
+ 12,
22
+ 1
23
+ ],
24
+ "refiner_keep_2d": true,
25
+ "side_memory": 0.8,
26
+ "refiner_euro_2d": [
27
+ 30,
28
+ 0.05
29
+ ]
30
+ }
31
+ }
fah-b/contact.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd3be189081b799c13549a0e0e82d1fd4c68471ce26abe62601fca31241b896b
3
+ size 128967625
fah-b/contact_video.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52807b787a7770369ca973d7ddb08c12d369bb93790dd57cd1140dedb55b5bbd
3
+ size 15082122
fah-b/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49378428ae01228c33748e3f90fb8da4af6f90c86b3304fd3f4eef259e0c74b2
3
+ size 1295234379
fah-h/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "model.pt",
3
+ "detector": "../shared/detector.pt",
4
+ "mesh_fitter": "../shared/mesh_fitter.pt",
5
+ "video_refiner": "../shared/video_refiner.pt",
6
+ "input_size": 448,
7
+ "image": {
8
+ "verify": true,
9
+ "det_conf": 0.05,
10
+ "det_size": 640,
11
+ "recrop_border": 0.03,
12
+ "min_crop": 1.1,
13
+ "pair_keep": 0.15,
14
+ "mesh_fit": 1,
15
+ "mesh_fit_jac": "fd",
16
+ "tip_extend": 0.6,
17
+ "parts_in_mask": true
18
+ },
19
+ "video": {
20
+ "refiner_euro": [
21
+ 12,
22
+ 1
23
+ ],
24
+ "refiner_keep_2d": true,
25
+ "side_memory": 0.8,
26
+ "refiner_euro_2d": [
27
+ 30,
28
+ 0.05
29
+ ]
30
+ }
31
+ }
fah-h/contact.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c6e72112b99612b3352db2c96a6c8fc97bd471caed21fe3dc634745c39b7ba6
3
+ size 435867193
fah-h/contact_video.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63707e6a1dba6f34437826db4668f52109d74df424cac6055fd6ecc2d244e1ac
3
+ size 15082122
fah-h/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2647268ec978a3eca5daecee6ced349c69de2c95b5530db08020d36738250d94
3
+ size 4317413191
fah-s/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "model.pt",
3
+ "detector": "../shared/detector.pt",
4
+ "mesh_fitter": "../shared/mesh_fitter.pt",
5
+ "video_refiner": "../shared/video_refiner.pt",
6
+ "input_size": 320,
7
+ "image": {
8
+ "verify": true,
9
+ "det_conf": 0.05,
10
+ "det_size": 640,
11
+ "recrop_border": 0.03,
12
+ "min_crop": 1.1,
13
+ "pair_keep": 0.15,
14
+ "mesh_fit": 1,
15
+ "mesh_fit_jac": "fd",
16
+ "tip_extend": 0.6,
17
+ "parts_in_mask": true
18
+ },
19
+ "video": {
20
+ "refiner_euro": [
21
+ 12,
22
+ 1
23
+ ],
24
+ "refiner_keep_2d": true,
25
+ "side_memory": 0.8,
26
+ "refiner_euro_2d": [
27
+ 30,
28
+ 0.05
29
+ ]
30
+ }
31
+ }
fah-s/contact.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b41528d1ffdb8eb00847138dba7577e04055bb670bdd459f4a10cfe65cca4931
3
+ size 43559881
fah-s/contact_video.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f18f03b84ddd18b87b118f5efc4b1be1068268406326c0201c1a4134befef7d3
3
+ size 15082122
fah-s/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f469c80356391c2993c58b4421ef3ee81c36549af932cffed1824a038147484c
3
+ size 1037048139
fah/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "model.pt",
3
+ "detector": "../shared/detector.pt",
4
+ "mesh_fitter": "../shared/mesh_fitter.pt",
5
+ "video_refiner": "../shared/video_refiner.pt",
6
+ "input_size": 320,
7
+ "image": {
8
+ "verify": true,
9
+ "det_conf": 0.05,
10
+ "det_size": 640,
11
+ "recrop_border": 0.03,
12
+ "min_crop": 1.1,
13
+ "pair_keep": 0.15,
14
+ "mesh_fit": 1,
15
+ "mesh_fit_jac": "fd",
16
+ "tip_extend": 0.6,
17
+ "parts_in_mask": true
18
+ },
19
+ "video": {
20
+ "refiner_euro": [
21
+ 12,
22
+ 1
23
+ ],
24
+ "refiner_keep_2d": true,
25
+ "side_memory": 0.8,
26
+ "refiner_euro_2d": [
27
+ 30,
28
+ 0.05
29
+ ]
30
+ }
31
+ }
fah/contact.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21189dca09787e48ee282fbb34b270ca4651a632a089bfa4c132a4936c788721
3
+ size 217363401
fah/contact_video.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4361149409feb4902cd362b8f18b6cf3b64f096be6ede2b50f4a966d6dd5b79a
3
+ size 15082122
fah/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ceccb5e0f944c0949de999aae0eba8736f2ab83b5e934507dc5bb45a115a11b
3
+ size 2166338139
qc/cmu_lab_kin/mask_qc.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73b598962ecc2f0dca37812cd2a775b744781135abb7c7659c10a8c5679d66d9
3
+ size 26327
qc/coco_wb_kin/mask_qc.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf0754399d99dbec48a683de9a9676564c146e7cae0dda1d13cbf8348a2318b1
3
+ size 809891
qc/egodex_part1_mano/qc.0.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f104034fa22fb195683eaa4342634541bbfebcb99001b9a47c51a751597e4ce8
3
+ size 3224028
qc/egodex_part1_mano/qc.1.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b326a609baaeaf124d8cb106e39cf5e0756ade5fce9cc339539be7463a2a4df3
3
+ size 3225764
qc/egodex_part1_mano/qc.2.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68c3ee899bee1ea79406e918101e279d2e14ad82c56047a054bfd05ba80a4919
3
+ size 3223879
qc/egodex_part1_mano/qc.3.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:894fe1b19f9609a62d24c0fe9c11250c9ff09f902d3329edbcc3935973bac683
3
+ size 3224499
qc/egodex_test_mano/mask_qc.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77e8f87a6e9795e00d9324d0e5a1071dd8f4f78954c8efd60db2bdd60c0c99a0
3
+ size 1960932
qc/hint_lab_kin/mask_qc.jsonl.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e438015859d9413990eedee6fd2c06f5d1617e61f2dc0e3c8349d6b2f15fd97
3
+ size 171600
shared/camera_motion.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f179dd168d46187b4bf84862111f0791e612e00d87b6ff53b61d8b35c958e5aa
3
+ size 110386431
shared/detector.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6924e002703c7b3951bb8c19f9f75dcbfaf395b7ca28490f19bb30aab8561627
3
+ size 54849448
shared/mesh_fitter.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fedc741cc997fd9fa9ebc4b985e5811f687c143afc5459be594c3ccdba31d323
3
+ size 11493253
shared/mhr_fitter.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8701d55807f78802d7a6996c7d36209e2c73f23bcc9888ede4e4205a9cbbf1c9
3
+ size 11435895
shared/video_refiner.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec84bfbbe923cd6cdc0dc60dcb59cc16b3ee826976dac6fb15de21a06d3dcc16
3
+ size 13135922