Any-to-Any
Transformers
Safetensors
gestalt
multimodal
discrete-diffusion
vision-language
unified-model
custom_code
Instructions to use GeWu-Lab/Gestalt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GeWu-Lab/Gestalt with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import GestaltModelLM model = GestaltModelLM.from_pretrained("GeWu-Lab/Gestalt", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
---
|
| 9 |
|
| 10 |
<p align="center">
|
| 11 |
-
<img src="
|
| 12 |
</p>
|
| 13 |
|
| 14 |
<h1 align="center">Gestalt: Large Multimodal Interplay Model</h1>
|
|
@@ -42,7 +42,7 @@ tags:
|
|
| 42 |
> **Gestalt** is a new paradigm of large multimodal model built around **multimodal interplay**. Guided by a multimodal interplay pyramid — from modality-specific modeling, through cross-modal alignment, to multimodal synergy — Gestalt adopts a unified **discrete diffusion** framework with an interplay-partitioned architecture, where learnable interplay tokens mediate cross-modal exchange and integration. The name is inspired by Gestalt psychology: *the whole is greater than the sum of its parts.*
|
| 43 |
|
| 44 |
<p align="center">
|
| 45 |
-
<img src="
|
| 46 |
</p>
|
| 47 |
|
| 48 |
## Model Description
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
<p align="center">
|
| 11 |
+
<img src="assets/gestalt-logo.svg" alt="Gestalt" width="360"/>
|
| 12 |
</p>
|
| 13 |
|
| 14 |
<h1 align="center">Gestalt: Large Multimodal Interplay Model</h1>
|
|
|
|
| 42 |
> **Gestalt** is a new paradigm of large multimodal model built around **multimodal interplay**. Guided by a multimodal interplay pyramid — from modality-specific modeling, through cross-modal alignment, to multimodal synergy — Gestalt adopts a unified **discrete diffusion** framework with an interplay-partitioned architecture, where learnable interplay tokens mediate cross-modal exchange and integration. The name is inspired by Gestalt psychology: *the whole is greater than the sum of its parts.*
|
| 43 |
|
| 44 |
<p align="center">
|
| 45 |
+
<img src="assets/teaser.png" alt="Gestalt teaser" width="95%"/>
|
| 46 |
</p>
|
| 47 |
|
| 48 |
## Model Description
|