Post-pone commited on
Commit
0147c3a
·
verified ·
1 Parent(s): caadc9c

Polish model details and organize model card assets

Browse files

Replace internal checkpoint naming with public model specifications and move the pipeline figure under assets/.

README.md CHANGED
@@ -31,7 +31,7 @@ tags:
31
 
32
  PRG-Fusion synthesizes photorealistic driving videos along novel trajectories by combining reconstruction evidence with generative video priors. It uses dense 3D Gaussian Splatting (3DGS) renderings for appearance control and sparse LiDAR projections for geometric control.
33
 
34
- ![PRG-Fusion pipeline](pipeline.png)
35
 
36
  PRG-Fusion converts region-wise reconstruction degradation evidence into **Preserve, Repair, and Generate (PRG)** labels. These labels route information across the video diffusion model:
37
 
@@ -45,11 +45,11 @@ The model follows a two-stage training strategy: geometric control is first lear
45
 
46
  | | |
47
  | --- | --- |
 
48
  | **Base model** | [NVIDIA Cosmos-Transfer2.5-2B](https://huggingface.co/nvidia/Cosmos-Transfer2.5-2B) |
49
- | **Checkpoint** | PRG-Fusion V6 Stage 2 |
50
- | **Control branches** | 3DGS appearance + LiDAR geometry |
51
  | **Checkpoint format** | PyTorch Distributed Checkpoint (DCP) |
52
- | **Input** | Text prompt, aligned 3DGS rendering video, and LiDAR projection video |
53
  | **Output** | Novel-trajectory driving video |
54
  | **Evaluation domain** | Waymo driving scenes |
55
 
 
31
 
32
  PRG-Fusion synthesizes photorealistic driving videos along novel trajectories by combining reconstruction evidence with generative video priors. It uses dense 3D Gaussian Splatting (3DGS) renderings for appearance control and sparse LiDAR projections for geometric control.
33
 
34
+ ![PRG-Fusion pipeline](assets/pipeline.png)
35
 
36
  PRG-Fusion converts region-wise reconstruction degradation evidence into **Preserve, Repair, and Generate (PRG)** labels. These labels route information across the video diffusion model:
37
 
 
45
 
46
  | | |
47
  | --- | --- |
48
+ | **Model** | PRG-Fusion |
49
  | **Base model** | [NVIDIA Cosmos-Transfer2.5-2B](https://huggingface.co/nvidia/Cosmos-Transfer2.5-2B) |
50
+ | **Conditioning** | Dense 3DGS renderings and sparse LiDAR projections |
 
51
  | **Checkpoint format** | PyTorch Distributed Checkpoint (DCP) |
52
+ | **Input** | Text prompt and aligned target-trajectory control videos |
53
  | **Output** | Novel-trajectory driving video |
54
  | **Evaluation domain** | Waymo driving scenes |
55
 
pipeline.png → assets/pipeline.png RENAMED
File without changes