diffusiongemma-26B-A4B-it-mic

Slim model weights, executable usage and framework expectations in one repository.

Contract

DiffusionGemma 26B A4B IT block diffusion

Runnable usage and the framework expectations directory are linked above.

Slim model

Slim fixture: diffusiongemma-26B-A4B-it-mic

A 18.7M-parameter fixture for the DiffusionGemma MIC, covering google/diffusiongemma-26B-A4B-it. It is a test artifact, not a usable model, tagged test-artifact to keep it out of candidate-model search.

  • Fixture key eb8c3d454a5f. It covers every checkpoint whose processor files are byte-identical and whose config matches after shrinking.
  • Same architecture, smaller config: DiffusionGemmaForBlockDiffusion, shrunk by the generic rule in sweep.py (text num_hidden_layers 2, vision num_hidden_layers 2).
  • Processor files copied byte for byte from google/diffusiongemma-26B-A4B-it: chat_template.jinja, generation_config.json, model_index.json, processor_config.json, tokenizer.json, tokenizer_config.json.
  • Random weights (seed 17). They passed the input-sensitivity gate: every perturbation of the contract's inputs moved the logits by at least 0.001 (weakest: input_ids:reverse, 0.766), so no training was needed.
  • Same tensor names as the real checkpoint. The real checkpoint has every parameter, and so does the fixture.
  • Saved in bfloat16, the dtype google/diffusiongemma-26B-A4B-it loads in by default.
  • Finite in float32, bfloat16, and float16 (forward, loss, gradients).

Built by build_fixtures.py; build.json records the pinned sources, gate results, and file hashes. This repository includes the slim weights, usage and framework expectations; rebuild the other files with python example/build_fixtures.py --fixture diffusiongemma-26B-A4B-it-mic.

Downloads last month
406
Safetensors
Model size
18.7M params
Tensor type
BF16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for huggingface-mic/diffusiongemma-26B-A4B-it-mic

Finetuned
(39)
this model