Polish model details and organize model card assets
Browse filesReplace internal checkpoint naming with public model specifications and move the pipeline figure under assets/.
- README.md +4 -4
- pipeline.png → assets/pipeline.png +0 -0
README.md
CHANGED
|
@@ -31,7 +31,7 @@ tags:
|
|
| 31 |
|
| 32 |
PRG-Fusion synthesizes photorealistic driving videos along novel trajectories by combining reconstruction evidence with generative video priors. It uses dense 3D Gaussian Splatting (3DGS) renderings for appearance control and sparse LiDAR projections for geometric control.
|
| 33 |
|
| 34 |
-

|
| 35 |
|
| 36 |
PRG-Fusion converts region-wise reconstruction degradation evidence into **Preserve, Repair, and Generate (PRG)** labels. These labels route information across the video diffusion model:
|
| 37 |
|
|
@@ -45,11 +45,11 @@ The model follows a two-stage training strategy: geometric control is first lear
|
|
| 45 |
|
| 46 |
| | |
|
| 47 |
| --- | --- |
|
|
|
|
| 48 |
| **Base model** | [NVIDIA Cosmos-Transfer2.5-2B](https://huggingface.co/nvidia/Cosmos-Transfer2.5-2B) |
|
| 49 |
-
| **
|
| 50 |
-
| **Control branches** | 3DGS appearance + LiDAR geometry |
|
| 51 |
| **Checkpoint format** | PyTorch Distributed Checkpoint (DCP) |
|
| 52 |
-
| **Input** | Text prompt
|
| 53 |
| **Output** | Novel-trajectory driving video |
|
| 54 |
| **Evaluation domain** | Waymo driving scenes |
|
| 55 |
|
|
|
|
| 31 |
|
| 32 |
PRG-Fusion synthesizes photorealistic driving videos along novel trajectories by combining reconstruction evidence with generative video priors. It uses dense 3D Gaussian Splatting (3DGS) renderings for appearance control and sparse LiDAR projections for geometric control.
|
| 33 |
|
| 34 |
+

|
| 35 |
|
| 36 |
PRG-Fusion converts region-wise reconstruction degradation evidence into **Preserve, Repair, and Generate (PRG)** labels. These labels route information across the video diffusion model:
|
| 37 |
|
|
|
|
| 45 |
|
| 46 |
| | |
|
| 47 |
| --- | --- |
|
| 48 |
+
| **Model** | PRG-Fusion |
|
| 49 |
| **Base model** | [NVIDIA Cosmos-Transfer2.5-2B](https://huggingface.co/nvidia/Cosmos-Transfer2.5-2B) |
|
| 50 |
+
| **Conditioning** | Dense 3DGS renderings and sparse LiDAR projections |
|
|
|
|
| 51 |
| **Checkpoint format** | PyTorch Distributed Checkpoint (DCP) |
|
| 52 |
+
| **Input** | Text prompt and aligned target-trajectory control videos |
|
| 53 |
| **Output** | Novel-trajectory driving video |
|
| 54 |
| **Evaluation domain** | Waymo driving scenes |
|
| 55 |
|
pipeline.png → assets/pipeline.png
RENAMED
|
File without changes
|