Image Classification
Py-Feat
facial-expression-analysis
action-units
emotion-recognition
gaze-estimation
face-landmarks
head-pose
blendshapes
multitask
Instructions to use py-feat/face_multitask_v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Py-Feat
How to use py-feat/face_multitask_v2 with Py-Feat:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Clarify model licensing scope and dataset provenance
Browse filesSeparate implementation licenses from pretrained-weight and training-data terms. Preserve existing valid grants and document unresolved distribution permissions. No weights or access settings changed.
LICENSE
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# face_multitask_v2 — licensing scope notice
|
| 2 |
+
|
| 3 |
+
The weights have been designated for **noncommercial research**. Py-Feat's
|
| 4 |
+
original implementation is MIT, but the initialized
|
| 5 |
+
[`convnextv2_tiny.fcmae_ft_in22k_in1k` weights](https://huggingface.co/timm/convnextv2_tiny.fcmae_ft_in22k_in1k)
|
| 6 |
+
are **CC BY-NC 4.0**, distinct from the backbone's MIT source code.
|
| 7 |
+
|
| 8 |
+
For `face_multitask_v28.safetensors`, DISFA+ and EYEDIAP are excluded from
|
| 9 |
+
gradient training; their benchmark scores were used in checkpoint selection.
|
| 10 |
+
DISFA (without +) is training data. Training also includes BP4D, BP4D+, CK+,
|
| 11 |
+
UNBC-McMaster PAIN, EmotioNet, AM-FED, Aff-Wild2, AffectNet, RAF-DB, FER+,
|
| 12 |
+
ExpW, MELD, AFEW-VA, ETH-XGaze, Gaze360, MPIIGaze, Columbia Gaze, and
|
| 13 |
+
CelebV-HQ across the training stages. Older checkpoints have different
|
| 14 |
+
provenance and must be assessed separately.
|
| 15 |
+
|
| 16 |
+
For the current v2.8 checkpoint, [Gaze360's research license, section 2(3)](https://github.com/erkil1452/gaze360/blob/master/LICENSE.md)
|
| 17 |
+
expressly excludes commercial applications of models trained on its dataset.
|
| 18 |
+
[ETH-XGaze](https://ait.ethz.ch/xgaze) access conditions expressly prohibit
|
| 19 |
+
training models for commercial products. These are express restrictions,
|
| 20 |
+
additional to the pretrained backbone's terms; they are not assumptions that
|
| 21 |
+
all dataset licenses automatically transfer to weights. Gaze360's use and
|
| 22 |
+
redistribution limits and ETH-XGaze's additional dataset/software terms also
|
| 23 |
+
require separate review of public weight-sharing permission. The applicable
|
| 24 |
+
acquisition terms and checkpoint provenance must be established separately
|
| 25 |
+
for older files in this repository.
|
| 26 |
+
|
| 27 |
+
See the [v2 licensing notice](https://github.com/cosanlab/py-feat/blob/main/LICENSES/PYFEAT-V2.md)
|
| 28 |
+
and [dataset register](https://github.com/cosanlab/py-feat/blob/main/LICENSES/DATASETS.md).
|
| 29 |
+
The research designation does not establish unrestricted public redistribution:
|
| 30 |
+
the relevant dataset agreements, chronology, and any required permissions
|
| 31 |
+
must be resolved for each checkpoint. This notice does not grant third-party
|
| 32 |
+
rights or assume that all dataset or teacher terms automatically attach to
|
| 33 |
+
every trained artifact. The optional ArcFace identity branch has its own
|
| 34 |
+
terms and is not the basis for this network's licensing restrictions.
|
| 35 |
+
|
| 36 |
+
This notice clarifies scope; it does not revoke existing valid grants or create a new license for third-party material. Dataset and teacher terms do not automatically relicense every trained artifact or inference output. A software license or model-card badge alone does not establish all checkpoint redistribution or commercial-use permissions.
|
| 37 |
+
|
| 38 |
+
## Commercial-use inquiries
|
| 39 |
+
|
| 40 |
+
These multitask weights are not offered as commercially cleared weights.
|
| 41 |
+
Py-Feat does not broker third-party permissions or offer a commercial
|
| 42 |
+
sublicense overriding upstream terms. Users can use independently cleared
|
| 43 |
+
weights or contact the applicable rights holders directly for any necessary
|
| 44 |
+
permissions covering the exact assets and commercial use. Dataset download
|
| 45 |
+
approval alone is not necessarily such permission. See the
|
| 46 |
+
[v2 commercial-use notice](https://github.com/cosanlab/py-feat/blob/main/LICENSES/PYFEAT-V2.md#commercial-use-inquiries)
|
| 47 |
+
and [commercial retraining table](https://github.com/cosanlab/py-feat/blob/main/LICENSES/COMMERCIAL-RETRAINING.md).
|
| 48 |
+
Existing valid grants remain unchanged; downstream permissions do not
|
| 49 |
+
automatically resolve the distributor's separate obligations.
|
README.md
CHANGED
|
@@ -17,6 +17,8 @@ pipeline_tag: image-classification
|
|
| 17 |
|
| 18 |
# face_multitask_v2
|
| 19 |
|
|
|
|
|
|
|
| 20 |
A single multi-task convolutional model for facial behavior analysis, used by
|
| 21 |
[py-feat](https://github.com/cosanlab/py-feat)'s `Detectorv2`. From one face crop
|
| 22 |
it jointly predicts **action units, categorical emotion, valence/arousal,
|
|
@@ -146,9 +148,53 @@ The model expects a face crop produced by RetinaFace + py-feat's
|
|
| 146 |
`extract_face_from_bbox_torch(frame, bbox, face_size=256, expand_bbox=1.2)`,
|
| 147 |
then center-cropped to 224 and ImageNet-normalized. `Detectorv2` handles this.
|
| 148 |
|
| 149 |
-
## License
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
# face_multitask_v2
|
| 19 |
|
| 20 |
+
> **Licensing scope:** See the [license and provenance notice](LICENSE) before relying on this card's license metadata for pretrained-weight redistribution or commercial use. Existing valid grants are preserved.
|
| 21 |
+
|
| 22 |
A single multi-task convolutional model for facial behavior analysis, used by
|
| 23 |
[py-feat](https://github.com/cosanlab/py-feat)'s `Detectorv2`. From one face crop
|
| 24 |
it jointly predicts **action units, categorical emotion, valence/arousal,
|
|
|
|
| 148 |
`extract_face_from_bbox_torch(frame, bbox, face_size=256, expand_bbox=1.2)`,
|
| 149 |
then center-cropped to 224 and ImageNet-normalized. `Detectorv2` handles this.
|
| 150 |
|
| 151 |
+
## License and provenance
|
| 152 |
+
|
| 153 |
+
The weights have been designated for **noncommercial research**. Py-Feat's
|
| 154 |
+
original implementation is MIT, but the initialized
|
| 155 |
+
[`convnextv2_tiny.fcmae_ft_in22k_in1k` weights](https://huggingface.co/timm/convnextv2_tiny.fcmae_ft_in22k_in1k)
|
| 156 |
+
are **CC BY-NC 4.0**, distinct from the backbone's MIT source code.
|
| 157 |
+
|
| 158 |
+
For `face_multitask_v28.safetensors`, DISFA+ and EYEDIAP are excluded from
|
| 159 |
+
gradient training; their benchmark scores were used in checkpoint selection.
|
| 160 |
+
DISFA (without +) is training data. Training also includes BP4D, BP4D+, CK+,
|
| 161 |
+
UNBC-McMaster PAIN, EmotioNet, AM-FED, Aff-Wild2, AffectNet, RAF-DB, FER+,
|
| 162 |
+
ExpW, MELD, AFEW-VA, ETH-XGaze, Gaze360, MPIIGaze, Columbia Gaze, and
|
| 163 |
+
CelebV-HQ across the training stages. Older checkpoints have different
|
| 164 |
+
provenance and must be assessed separately.
|
| 165 |
+
|
| 166 |
+
For the current v2.8 checkpoint, [Gaze360's research license, section 2(3)](https://github.com/erkil1452/gaze360/blob/master/LICENSE.md)
|
| 167 |
+
expressly excludes commercial applications of models trained on its dataset.
|
| 168 |
+
[ETH-XGaze](https://ait.ethz.ch/xgaze) access conditions expressly prohibit
|
| 169 |
+
training models for commercial products. These are express restrictions,
|
| 170 |
+
additional to the pretrained backbone's terms; they are not assumptions that
|
| 171 |
+
all dataset licenses automatically transfer to weights. Gaze360's use and
|
| 172 |
+
redistribution limits and ETH-XGaze's additional dataset/software terms also
|
| 173 |
+
require separate review of public weight-sharing permission. The applicable
|
| 174 |
+
acquisition terms and checkpoint provenance must be established separately
|
| 175 |
+
for older files in this repository.
|
| 176 |
+
|
| 177 |
+
See the [v2 licensing notice](https://github.com/cosanlab/py-feat/blob/main/LICENSES/PYFEAT-V2.md)
|
| 178 |
+
and [dataset register](https://github.com/cosanlab/py-feat/blob/main/LICENSES/DATASETS.md).
|
| 179 |
+
The research designation does not establish unrestricted public redistribution:
|
| 180 |
+
the relevant dataset agreements, chronology, and any required permissions
|
| 181 |
+
must be resolved for each checkpoint. This notice does not grant third-party
|
| 182 |
+
rights or assume that all dataset or teacher terms automatically attach to
|
| 183 |
+
every trained artifact. The optional ArcFace identity branch has its own
|
| 184 |
+
terms and is not the basis for this network's licensing restrictions.
|
| 185 |
+
|
| 186 |
+
This notice clarifies scope; it does not revoke existing valid grants or create a new license for third-party material. Dataset and teacher terms do not automatically relicense every trained artifact or inference output. A software license or model-card badge alone does not establish all checkpoint redistribution or commercial-use permissions.
|
| 187 |
+
|
| 188 |
+
|
| 189 |
+
## Commercial-use inquiries
|
| 190 |
+
|
| 191 |
+
These multitask weights are not offered as commercially cleared weights.
|
| 192 |
+
Py-Feat does not broker third-party permissions or offer a commercial
|
| 193 |
+
sublicense overriding upstream terms. Users can use independently cleared
|
| 194 |
+
weights or contact the applicable rights holders directly for any necessary
|
| 195 |
+
permissions covering the exact assets and commercial use. Dataset download
|
| 196 |
+
approval alone is not necessarily such permission. See the
|
| 197 |
+
[v2 commercial-use notice](https://github.com/cosanlab/py-feat/blob/main/LICENSES/PYFEAT-V2.md#commercial-use-inquiries)
|
| 198 |
+
and [commercial retraining table](https://github.com/cosanlab/py-feat/blob/main/LICENSES/COMMERCIAL-RETRAINING.md).
|
| 199 |
+
Existing valid grants remain unchanged; downstream permissions do not
|
| 200 |
+
automatically resolve the distributor's separate obligations.
|