Text-to-Image
Transformers
Safetensors
grt_image
text-generation
grt
grt-image
vision
rotational-transformer
givens-rotations
sophia-torus
matterwave
Instructions to use MatterWaveAI/grt-30m-image with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MatterWaveAI/grt-30m-image with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForSeq2SeqLM model = AutoModelForSeq2SeqLM.from_pretrained("MatterWaveAI/grt-30m-image", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Fix model card formatting (replace raw LaTeX with clean Unicode and code spans)
Browse files
README.md
CHANGED
|
@@ -27,11 +27,11 @@ base_model: MatterWaveAI/grt-30m
|
|
| 27 |
| **Total (`GRT-30M-Image`)** | `GRTImageForConditionalGeneration` (`GRTForTextToImage`) | **`29,371,239`** | **0 `nn.Linear`, 0 `nn.Conv2d`** |
|
| 28 |
| **4-Codebook Visual RVQ Bank** | `GRTVisualRVQCodecBank` (benchmark evaluation head) | `32,772` | 4 planar-pair polar cosine codebooks (`K = 64` entries × `128` pairs per codebook) over RGB spatial-spectral sub-bands |
|
| 29 |
|
| 30 |
-
## Visual Synthesis Alignment Metrics (`HuygensAdam` / Circular Order Parameter
|
| 31 |
|
| 32 |
- **Held-Out Visual RVQ Perplexity**: `81.17` (unaligned) → **`16.98`** (aligned, `4.78×` reduction)
|
| 33 |
- **Visual RVQ Mean Top-1 Accuracy (4 Codebooks)**: `1.48%` → **`25.19%`** (`[20.86%, 25.63%, 26.04%, 28.23%]`, `16.1×` over random chance)
|
| 34 |
-
- **Text-Conditioned Prompt Margin (
|
| 35 |
- **Patch Polar Cosine Similarity**: `0.1004` → **`0.6737`**
|
| 36 |
- **2D Spectral Magnitude Cosine Similarity**: `0.1782` → **`0.7857`**
|
| 37 |
- **Reconstruction PSNR / Spectral SNR**: `11.38 dB` / `-8.20 dB` → **`19.14 dB` PSNR / `+2.31 dB` SNR** (`+10.51 dB` gain)
|
|
@@ -42,7 +42,7 @@ base_model: MatterWaveAI/grt-30m
|
|
| 42 |
|
| 43 |
We benchmarked all 8 classical geometric, symplectic, and gyroscopic optimizers from `transformers.models.grt.optimization_grt` on `MatterWaveAI/grt-30m-image` (`GRTPolarImageDecoderHead` + 4-codebook visual RVQ polar cosine codec bank `GRTVisualRVQCodecBank`, `K = 64` per codebook, `200` steps per optimizer, `batch_size = 36`, `seed = 42`, across a 144-concept procedural text-to-image benchmark of 6 colors × 6 geometric shapes × 4 spatial layouts):
|
| 44 |
|
| 45 |
-
| Rank | Optimizer (`optimizer_type`) | Final Train Loss | Held-Out RVQ Val Loss | Held-Out RVQ Val PPL | RVQ Mean Top-1 Acc (4 Codebooks) | Codebook-0 Primary Acc | Text-Conditioned Margin (
|
| 46 |
| :---: | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 47 |
| **1** | **`HuygensAdam` (`huygens_adam`)** | **`2.8188`** | **`2.8317`** | **`16.9750`** | **`25.19%`** | `20.86%` | **`+0.6440`** | **`0.6737`** | **`2.31` / `19.14 dB`** | `55.59s` |
|
| 48 |
| **2** | **`PolarNaturalAdam` (`polar_natural_adam`)** | `2.8244` | `2.8368` | `17.0605` | `25.08%` | `20.85%` | `+0.6333` | `0.6717` | `2.29` / `19.13 dB` | `185.71s` |
|
|
@@ -54,8 +54,8 @@ We benchmarked all 8 classical geometric, symplectic, and gyroscopic optimizers
|
|
| 54 |
| **8** | **`SymplecticAdam` (`symplectic_adam`)** | `2.8965` | `2.9089` | `18.3370` | `24.01%` | `19.65%` | `+0.6056` | `0.6508` | `2.14` / `18.97 dB` | `65.04s` |
|
| 55 |
|
| 56 |
### Key Geometric Findings on Rotational Text-to-Image (`GRTImage`)
|
| 57 |
-
- **`HuygensAdam` Sweeps #1 Across Visual RVQ Perplexity, Accuracy, Text-Conditioning Margin & Polar Cosine Similarity**: On 2D spatial patch synthesis (`256` patches of `14×14×3` unfolded across 41 Givens butterfly stages), Kuramoto–Huygens circular order-parameter splay torque (
|
| 58 |
-
- **`PolarNaturalAdam` (#2) & `HessianPairAdam` (#3) Excel on Multi-Stage Butterfly Curvature**: Scaling angular updates by the Riemannian polar metric
|
| 59 |
- **`CyclideAdam` Achieves #1 Primary Codebook-0 Accuracy (`20.87%`)**: Dupin cyclide conic metric preconditioning with deviatoric twist attains the highest primary RGB chromatic codebook accuracy (`20.87%`).
|
| 60 |
|
| 61 |
---
|
|
|
|
| 27 |
| **Total (`GRT-30M-Image`)** | `GRTImageForConditionalGeneration` (`GRTForTextToImage`) | **`29,371,239`** | **0 `nn.Linear`, 0 `nn.Conv2d`** |
|
| 28 |
| **4-Codebook Visual RVQ Bank** | `GRTVisualRVQCodecBank` (benchmark evaluation head) | `32,772` | 4 planar-pair polar cosine codebooks (`K = 64` entries × `128` pairs per codebook) over RGB spatial-spectral sub-bands |
|
| 29 |
|
| 30 |
+
## Visual Synthesis Alignment Metrics (`HuygensAdam` / Circular Order Parameter `R_p` Splay Torque)
|
| 31 |
|
| 32 |
- **Held-Out Visual RVQ Perplexity**: `81.17` (unaligned) → **`16.98`** (aligned, `4.78×` reduction)
|
| 33 |
- **Visual RVQ Mean Top-1 Accuracy (4 Codebooks)**: `1.48%` → **`25.19%`** (`[20.86%, 25.63%, 26.04%, 28.23%]`, `16.1×` over random chance)
|
| 34 |
+
- **Text-Conditioned Prompt Margin (`ΔL` vs. Shuffled Prompts)**: `-0.0074` → **`+0.6440` nats**
|
| 35 |
- **Patch Polar Cosine Similarity**: `0.1004` → **`0.6737`**
|
| 36 |
- **2D Spectral Magnitude Cosine Similarity**: `0.1782` → **`0.7857`**
|
| 37 |
- **Reconstruction PSNR / Spectral SNR**: `11.38 dB` / `-8.20 dB` → **`19.14 dB` PSNR / `+2.31 dB` SNR** (`+10.51 dB` gain)
|
|
|
|
| 42 |
|
| 43 |
We benchmarked all 8 classical geometric, symplectic, and gyroscopic optimizers from `transformers.models.grt.optimization_grt` on `MatterWaveAI/grt-30m-image` (`GRTPolarImageDecoderHead` + 4-codebook visual RVQ polar cosine codec bank `GRTVisualRVQCodecBank`, `K = 64` per codebook, `200` steps per optimizer, `batch_size = 36`, `seed = 42`, across a 144-concept procedural text-to-image benchmark of 6 colors × 6 geometric shapes × 4 spatial layouts):
|
| 44 |
|
| 45 |
+
| Rank | Optimizer (`optimizer_type`) | Final Train Loss | Held-Out RVQ Val Loss | Held-Out RVQ Val PPL | RVQ Mean Top-1 Acc (4 Codebooks) | Codebook-0 Primary Acc | Text-Conditioned Margin (`ΔL`) | Patch Polar Cosine Sim | Spectral SNR / PSNR (dB) | Time (s) |
|
| 46 |
| :---: | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 47 |
| **1** | **`HuygensAdam` (`huygens_adam`)** | **`2.8188`** | **`2.8317`** | **`16.9750`** | **`25.19%`** | `20.86%` | **`+0.6440`** | **`0.6737`** | **`2.31` / `19.14 dB`** | `55.59s` |
|
| 48 |
| **2** | **`PolarNaturalAdam` (`polar_natural_adam`)** | `2.8244` | `2.8368` | `17.0605` | `25.08%` | `20.85%` | `+0.6333` | `0.6717` | `2.29` / `19.13 dB` | `185.71s` |
|
|
|
|
| 54 |
| **8** | **`SymplecticAdam` (`symplectic_adam`)** | `2.8965` | `2.9089` | `18.3370` | `24.01%` | `19.65%` | `+0.6056` | `0.6508` | `2.14` / `18.97 dB` | `65.04s` |
|
| 55 |
|
| 56 |
### Key Geometric Findings on Rotational Text-to-Image (`GRTImage`)
|
| 57 |
+
- **`HuygensAdam` Sweeps #1 Across Visual RVQ Perplexity, Accuracy, Text-Conditioning Margin & Polar Cosine Similarity**: On 2D spatial patch synthesis (`256` patches of `14×14×3` unfolded across 41 Givens butterfly stages), Kuramoto–Huygens circular order-parameter splay torque (`R_p = |(1/P) ∑_p exp(i θ_p)|`) prevents angular phase collapse across spatial sub-patches, achieving **#1 held-out RVQ validation loss (`2.8317`, `val_ppl = 16.9750`)**, **#1 4-codebook visual RVQ accuracy (`25.19%`)**, **#1 text-conditioning margin (`+0.6440` nats)**, and **#1 patch polar cosine similarity (`0.6737`, `19.14 dB` PSNR)**.
|
| 58 |
+
- **`PolarNaturalAdam` (#2) & `HessianPairAdam` (#3) Excel on Multi-Stage Butterfly Curvature**: Scaling angular updates by the Riemannian polar metric `1 / (r² + ε)` and Cauchy–Riemann toroidal curvature outperforms first-order `PairAdam` (`2.8368` and `2.8382` vs. `2.8417` validation loss).
|
| 59 |
- **`CyclideAdam` Achieves #1 Primary Codebook-0 Accuracy (`20.87%`)**: Dupin cyclide conic metric preconditioning with deviatoric twist attains the highest primary RGB chromatic codebook accuracy (`20.87%`).
|
| 60 |
|
| 61 |
---
|