subcards
#3
by jroorda - opened
physical_plausibility_evaluator_subcards/bias.md
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Bias
|
| 2 |
+
|
| 3 |
+
| Field | Response |
|
| 4 |
+
| --- | --- |
|
| 5 |
+
| Participation considerations from adversely impacted groups [protected classes][protected] in model design and testing: | Not Applicable |
|
| 6 |
+
| Measures taken to mitigate against unwanted bias: | Not Applicable |
|
| 7 |
+
| Bias Metric (If Measured): | Not measured. |
|
| 8 |
+
|
| 9 |
+
[protected]: https://calcivilrights.ca.gov/disputeresolution/protected-characteristics/
|
physical_plausibility_evaluator_subcards/explainability.md
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Explainability
|
| 2 |
+
|
| 3 |
+
| Field | Response |
|
| 4 |
+
| --- | --- |
|
| 5 |
+
| Intended Task/Domain: | Video quality screening using task-specific good/bad labels. |
|
| 6 |
+
| Model Type: | Frozen video transformer, learned attention pooling and binary linear classifier. |
|
| 7 |
+
| Intended Users: | Developers and researchers evaluating or filtering video datasets. |
|
| 8 |
+
| Output: | Bad-class logit and sigmoid scores and the thresholded good-or-bad decision. |
|
| 9 |
+
| Describe how the model works: | Frozen V-JEPA 2.1 encodes video into space-time tokens. A learned query pools normalized tokens into one vector; a linear classifier produces a bad logit. A calibrated threshold determines the decision. |
|
| 10 |
+
| List the groups (or group characteristics) for which this was tested to produce comparable outcomes: | Not Applicable |
|
| 11 |
+
| Technical Limitations & Mitigation: | Performance can change with scenes, generators, cameras, duration and labels. Sparse sampling can miss brief defects. Evaluate representative held-out videos, separate related scenes, and recalibrate on target data. Attention weights are not validated explanations or localization masks. |
|
| 12 |
+
| Verified to have met prescribed NVIDIA quality standards: | Yes |
|
| 13 |
+
| Performance Metrics: | Bad-class ROC AUC, bad recall and good-video rejection. |
|
| 14 |
+
| Potential Known Risks: | Missed defects, rejection of useful videos and misleading confidence under distribution shift. Scores do not certify physical correctness. Class balancing does not establish demographic fairness or comparable outcomes across groups. |
|
| 15 |
+
| Licensing: | [OpenMDW-1.1](https://openmdw.ai/license/1-1/) |
|
physical_plausibility_evaluator_subcards/privacy.md
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Privacy
|
| 2 |
+
|
| 3 |
+
| Field | Response |
|
| 4 |
+
| :--- | :--- |
|
| 5 |
+
| Generatable or reverse engineerable personal data*? | No |
|
| 6 |
+
| Personal data used to create this model? | No |
|
| 7 |
+
| Was consent obtained for any personal data* used? | Not Applicable |
|
| 8 |
+
| How often is dataset reviewed? | During dataset preparation and annotation. |
|
| 9 |
+
| Is a mechanism in place to honor data subject right of access or deletion of personal data? | Not Applicable |
|
| 10 |
+
| If personal data was collected for the development of the model, was it collected directly by NVIDIA? | Not Applicable |
|
| 11 |
+
| If personal data was collected for the development of the model by NVIDIA, do you maintain or have access to disclosures made to data subjects? | Not Applicable |
|
| 12 |
+
| If personal data was collected for the development of this AI model, was it minimized to only what was required? | Not Applicable |
|
| 13 |
+
| Was data from user interactions with the AI model (e.g. user input and prompts) used to train the model? | No |
|
| 14 |
+
| Is there provenance for all datasets used in training? | Yes |
|
| 15 |
+
| Does data labeling (annotation, metadata) comply with privacy laws? | Not Applicable |
|
| 16 |
+
| Is data compliant with data subject requests for data correction or removal, if such a request was made? | Not Applicable |
|
| 17 |
+
| Applicable Privacy Policy | [NVIDIA Privacy Policy](https://www.nvidia.com/en-us/about-nvidia/privacy-policy/) |
|
| 18 |
+
|
| 19 |
+
*Responses cover the classifier dataset: selected FineVideo source frames/captions, generated videos and annotations.
|
| 20 |
+
They do not characterize Meta's separate encoder-pretraining datasets.
|
physical_plausibility_evaluator_subcards/safety_security.md
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Safety and Security
|
| 2 |
+
|
| 3 |
+
| Field | Response |
|
| 4 |
+
| --- | --- |
|
| 5 |
+
| Model Application Field(s): | Video-level quality assessment and filtering using task-specific acceptability criteria. |
|
| 6 |
+
| Describe the life critical impact: | Not intended as a safety-critical decision system or certification of physical correctness. |
|
| 7 |
+
| Use Case Restrictions: | Abide by [OpenMDW-1.1](https://openmdw.ai/license/1-1/). |
|
| 8 |
+
| Model and dataset restrictions: | Access to the model and dataset during generation and development was restricted to people who needed it, following the principle of least privilege. The dataset will not be released. |
|