Any-to-Any
Transformers
Safetensors
nlduni
feature-extraction
custom_code
image-text-to-text
text-to-image
image-to-image
Instructions to use nvidia/NLD-Uni with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nvidia/NLD-Uni with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/NLD-Uni", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add license and links to paper, project page, and code
#3
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,15 +1,21 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
pipeline_tag: any-to-any
|
|
|
|
| 4 |
tags:
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
---
|
| 10 |
|
| 11 |
# Nemotron-Labs-Diffusion-Uni-8B
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
## Description
|
| 14 |
|
| 15 |
NLD-Uni is a unified multimodal model for image understanding and image generation. It combines a diffusion language model with specialized visual components and a mixture-of-transformers design. Understanding and generation use distinct transformer parameter paths within a common multimodal framework.
|
|
@@ -63,7 +69,6 @@ python inference.py /path/to/hf_checkpoint --task understand --image blue.png --
|
|
| 63 |
|
| 64 |
Replace the model argument with the published Hugging Face model ID for remote loading. The standalone script only uses Transformers and this repository's model code.
|
| 65 |
|
| 66 |
-
|
| 67 |
### License/Terms of Use
|
| 68 |
|
| 69 |
GOVERNING TERMS: Use of this model is governed by the [NVIDIA Open Source License Agreement](https://huggingface.co/nvidia/NL-Diffusion-Image/raw/main/LICENSE).
|
|
@@ -225,5 +230,4 @@ Users should have appropriate rights and permissions for input images and other
|
|
| 225 |
|
| 226 |
Users are responsible for model inputs and outputs and for implementing appropriate safeguards before deployment.
|
| 227 |
|
| 228 |
-
Report model quality concerns, security vulnerabilities, or NVIDIA AI concerns through [NVIDIA’s reporting channel](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).
|
| 229 |
-
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
pipeline_tag: any-to-any
|
| 4 |
+
license: other
|
| 5 |
tags:
|
| 6 |
+
- custom_code
|
| 7 |
+
- image-text-to-text
|
| 8 |
+
- text-to-image
|
| 9 |
+
- image-to-image
|
| 10 |
---
|
| 11 |
|
| 12 |
# Nemotron-Labs-Diffusion-Uni-8B
|
| 13 |
|
| 14 |
+
This repository contains the model introduced in the paper [Nemotron-Labs-Diffusion-Uni: Elastic Self-Refining Unified Diffusion LLM with Cross-Paradigm On-Policy Distillation](https://huggingface.co/papers/2610.36466).
|
| 15 |
+
|
| 16 |
+
- **Project page:** https://homepage.jackli.org/projects/nl-diffusion-uni/index.html
|
| 17 |
+
- **Code:** https://github.com/NVlabs/Nemotron-Labs-Diffusion-Uni
|
| 18 |
+
|
| 19 |
## Description
|
| 20 |
|
| 21 |
NLD-Uni is a unified multimodal model for image understanding and image generation. It combines a diffusion language model with specialized visual components and a mixture-of-transformers design. Understanding and generation use distinct transformer parameter paths within a common multimodal framework.
|
|
|
|
| 69 |
|
| 70 |
Replace the model argument with the published Hugging Face model ID for remote loading. The standalone script only uses Transformers and this repository's model code.
|
| 71 |
|
|
|
|
| 72 |
### License/Terms of Use
|
| 73 |
|
| 74 |
GOVERNING TERMS: Use of this model is governed by the [NVIDIA Open Source License Agreement](https://huggingface.co/nvidia/NL-Diffusion-Image/raw/main/LICENSE).
|
|
|
|
| 230 |
|
| 231 |
Users are responsible for model inputs and outputs and for implementing appropriate safeguards before deployment.
|
| 232 |
|
| 233 |
+
Report model quality concerns, security vulnerabilities, or NVIDIA AI concerns through [NVIDIA’s reporting channel](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).
|
|
|