StillDeadcode/embeddinggemma2-bf16

EmbeddingGemma 2 BF16 — radiance container

google/embeddinggemma-2 in bf16, exactly as the checkpoint ships it, as a single .rad container for the radiance inference engine. It embeds text, images, video and audio on an AMD card (RDNA4, ROCm) or on the CPU.

File	embeddinggemma2-bf16.rad — 1.40 GiB
Weights	every weight of the model, the vision and audio towers included, bf16 as the checkpoint ships it
Output	768-dimensional vectors, mean-pooled and normalised as the model's sentence-transformers configuration states
Modalities	text, image, video, audio
Needs	radiance 1.5.0 or newer

Serve

radiance --model embeddinggemma2-bf16.rad --host 0.0.0.0 --port 8000

With no card visible, radiance serves it on the CPU. The Docker image is stilldeadcode/radiance. Requests go to /v1/embeddings. input is a string, a list of strings, or content parts:

{"input": [{"type": "image_url", "image_url": {"url": "data:image/png;base64,..."}},
           {"type": "text", "text": "a red square"}]}

Video is a video_url part, and audio an input_audio part ({"data": <base64 wav>, "format": "wav"}). prompt_name applies one of the model's named prompts (query, document, Retrieval-query, ...), dimensions truncates the vector and normalises it again, and image_tokens (70, 140, 280, 560 or 1120) sets an image's token budget.

Accuracy

Cosine similarity against the Hugging Face transformers reference in bf16, served by radiance 1.5.0:

input	R9700	CPU
text, 4 to 6,704 tokens	0.99992 – 0.99997	0.99990 – 0.99998
images	0.99998 – 0.99999	0.99998 – 0.99999
video	0.99997	0.99997
audio (7 s, 30 s)	0.99992 – 0.99993	0.99974 (7 s)
text + image	0.99997	0.99996

A text that itself begins with the literal string <bos> scores 0.998: radiance does not add a second <bos> in front of it, where the reference does.

Speed

On one Radeon AI PRO R9700 (gfx1201): about 148,000 text tokens a second in batches; 27 images a second one at a time and 52 at eight in parallel; a 7 s audio clip in 20 ms and a 30 s clip in 49 ms. On a Ryzen 9 9950X3D: about 12,000 text tokens a second, 2.3 images a second, and a 30 s audio clip in 265 ms.

How this file was made

rad-convert google/embeddinggemma-2 -o embeddinggemma2-bf16.rad

No recipe: every weight is the checkpoint's own.