Instructions to use nvidia/Cosmos3-Edge-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Cosmos
How to use nvidia/Cosmos3-Edge-FP8 with Cosmos:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Fix model card image and video links to original model assets
Browse files
README.md
CHANGED
|
@@ -275,11 +275,11 @@ For detailed evaluations of the base model, see our [technical paper](https://re
|
|
| 275 |
The table below summarizes Cosmos3-Edge-FP8 across reasoning and generation. Each reasoning column (General, Robotics, Smart Infrastructure, Driving) reports the average score over that capability's benchmarks. For generation, **Image2Video** is the PAIBench overall score and **Policy: Robot** is the RoboLab success rate. In each column, the best result is in **bold** and the second-best is <u>underlined</u>.
|
| 276 |
\* denotes post-trained Cosmos3 variants: [Cosmos3-Nano-Policy-DROID](https://huggingface.co/nvidia/Cosmos3-Nano-Policy-DROID) and [Cosmos3-Edge-Policy-DROID](https://huggingface.co/nvidia/Cosmos3-Edge-Policy-DROID#robolab).
|
| 277 |
|
| 278 |
-

|
| 279 |
|
| 280 |
### Reasoning Benchmarks
|
| 281 |
|
| 282 |
-

|
| 283 |
|
| 284 |
### Generation Benchmarks
|
| 285 |
|
|
@@ -287,7 +287,7 @@ The table below summarizes Cosmos3-Edge-FP8 across reasoning and generation. Eac
|
|
| 287 |
|
| 288 |
All models are evaluated on image-to-video generation at **480p, 24 fps**. Throughput is the number of frames generated per second, measured in eager mode on a single **NVIDIA H100** GPU. Cosmos3-Edge-FP8 delivers the highest generation throughput while achieving competitive quality across PAIBench, RBench, and PhysicsIQ.
|
| 289 |
|
| 290 |
-

|
| 291 |
|
| 292 |
|
| 293 |
#### Action
|
|
@@ -564,7 +564,7 @@ print(f"Saved video to {output_path}")
|
|
| 564 |
|
| 565 |
Example output:
|
| 566 |
|
| 567 |
-
<video controls width="832" height="480" src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 568 |
|
| 569 |
---
|
| 570 |
|
|
@@ -665,7 +665,7 @@ print("stitched resolution:", f"{input_width}x{input_height}")
|
|
| 665 |
|
| 666 |
Example output:
|
| 667 |
|
| 668 |
-
<video width="512" controls src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 669 |
|
| 670 |
###### Action inverse dynamics
|
| 671 |
|
|
@@ -738,9 +738,9 @@ Example outputs:
|
|
| 738 |
- [av_inverse_0 predicted action JSON](https://huggingface.co/nvidia/Cosmos3-Edge-FP8/blob/main/assets/edge_action_id_av_0_output.json)
|
| 739 |
- [av_inverse_1 predicted action JSON](https://huggingface.co/nvidia/Cosmos3-Edge-FP8/blob/main/assets/edge_action_id_av_1_output.json)
|
| 740 |
|
| 741 |
-
<img width="1280" src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 742 |
|
| 743 |
-
<img width="1280" src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 744 |
|
| 745 |
### Diffusers
|
| 746 |
|
|
@@ -819,7 +819,7 @@ print(f"Saved video to {output_path}")
|
|
| 819 |
|
| 820 |
Example output:
|
| 821 |
|
| 822 |
-
<video controls width="832" height="480" src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 823 |
|
| 824 |
---
|
| 825 |
|
|
@@ -894,7 +894,7 @@ print("Saved stitched rollout:", stitched_path)
|
|
| 894 |
|
| 895 |
Example output:
|
| 896 |
|
| 897 |
-
<video controls width="256" height="256" src="https://huggingface.co/nvidia/Cosmos3-Edge
|
| 898 |
|
| 899 |
###### Action inverse dynamics
|
| 900 |
|
|
@@ -998,7 +998,7 @@ vllm serve nvidia/Cosmos3-Edge-FP8 \
|
|
| 998 |
|
| 999 |
Image input:
|
| 1000 |
|
| 1001 |
-
<img src="assets/example_reasoning_input.png" alt="Reasoning example input showing a tabletop robot-manipulation scene" width="640">
|
| 1002 |
|
| 1003 |
User prompt:
|
| 1004 |
|
|
|
|
| 275 |
The table below summarizes Cosmos3-Edge-FP8 across reasoning and generation. Each reasoning column (General, Robotics, Smart Infrastructure, Driving) reports the average score over that capability's benchmarks. For generation, **Image2Video** is the PAIBench overall score and **Policy: Robot** is the RoboLab success rate. In each column, the best result is in **bold** and the second-best is <u>underlined</u>.
|
| 276 |
\* denotes post-trained Cosmos3 variants: [Cosmos3-Nano-Policy-DROID](https://huggingface.co/nvidia/Cosmos3-Nano-Policy-DROID) and [Cosmos3-Edge-Policy-DROID](https://huggingface.co/nvidia/Cosmos3-Edge-Policy-DROID#robolab).
|
| 277 |
|
| 278 |
+

|
| 279 |
|
| 280 |
### Reasoning Benchmarks
|
| 281 |
|
| 282 |
+

|
| 283 |
|
| 284 |
### Generation Benchmarks
|
| 285 |
|
|
|
|
| 287 |
|
| 288 |
All models are evaluated on image-to-video generation at **480p, 24 fps**. Throughput is the number of frames generated per second, measured in eager mode on a single **NVIDIA H100** GPU. Cosmos3-Edge-FP8 delivers the highest generation throughput while achieving competitive quality across PAIBench, RBench, and PhysicsIQ.
|
| 289 |
|
| 290 |
+

|
| 291 |
|
| 292 |
|
| 293 |
#### Action
|
|
|
|
| 564 |
|
| 565 |
Example output:
|
| 566 |
|
| 567 |
+
<video controls width="832" height="480" src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/edge_i2v_output.mp4"></video>
|
| 568 |
|
| 569 |
---
|
| 570 |
|
|
|
|
| 665 |
|
| 666 |
Example output:
|
| 667 |
|
| 668 |
+
<video width="512" controls src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/edge_action_fd_umi_2chunk_output.mp4"></video>
|
| 669 |
|
| 670 |
###### Action inverse dynamics
|
| 671 |
|
|
|
|
| 738 |
- [av_inverse_0 predicted action JSON](https://huggingface.co/nvidia/Cosmos3-Edge-FP8/blob/main/assets/edge_action_id_av_0_output.json)
|
| 739 |
- [av_inverse_1 predicted action JSON](https://huggingface.co/nvidia/Cosmos3-Edge-FP8/blob/main/assets/edge_action_id_av_1_output.json)
|
| 740 |
|
| 741 |
+
<img width="1280" src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/edge_action_id_av_0_output.png">
|
| 742 |
|
| 743 |
+
<img width="1280" src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/edge_action_id_av_1_output.png">
|
| 744 |
|
| 745 |
### Diffusers
|
| 746 |
|
|
|
|
| 819 |
|
| 820 |
Example output:
|
| 821 |
|
| 822 |
+
<video controls width="832" height="480" src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/diffusers_outputs/edge_i2v_diffusers.mp4"></video>
|
| 823 |
|
| 824 |
---
|
| 825 |
|
|
|
|
| 894 |
|
| 895 |
Example output:
|
| 896 |
|
| 897 |
+
<video controls width="256" height="256" src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/diffusers_outputs/edge_action_fd_umi_2chunk_diffusers.mp4"></video>
|
| 898 |
|
| 899 |
###### Action inverse dynamics
|
| 900 |
|
|
|
|
| 998 |
|
| 999 |
Image input:
|
| 1000 |
|
| 1001 |
+
<img src="https://huggingface.co/nvidia/Cosmos3-Edge/resolve/main/assets/example_reasoning_input.png" alt="Reasoning example input showing a tabletop robot-manipulation scene" width="640">
|
| 1002 |
|
| 1003 |
User prompt:
|
| 1004 |
|