File size: 3,177 Bytes
48ab30c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
# TPU v5e cold-start cache

Chip-scoped cache for Google Cloud TPU v5e-1 on Colab. It contains the pinned
Python 3.12 `vllm-tpu` virtualenv, `zstd`, the per-model XLA compile caches,
and a per-model manifest. It contains **no model weights**.

Do not use this repo on a GPU or on TPU v6e: the venv, XLA executables, and
`libtpu` are built for one chip and one engine version. Each chip gets its own
`compile-cache-<chip>` repo.

## Layout

```
manifest.json
venv312_cpu.tar.zst                 # fixed filename used by coldstart
zstd_bin                            # fixed filename used by coldstart
models/LFM/LFM2.5-24B-A2B/
  manifest.json
  vllm-tpu-0.32.0/
    len100000__b16-8192__42f6059b.tar
    len100000__b16-8192__noclip__0a680e5e.tar
archive/
  lfm2.5-24b-a2b/                   # superseded LFM caches
  qwen3-4b/                         # legacy Qwen3 caches + versions.json
```

The two root runtime files keep their historical names because
`coldstart/download.py` fetches `venv312_cpu.tar.zst` and `zstd_bin` by
default. Model caches are namespaced paths and are pinned explicitly in the
model TOML via `COLDSTART_CACHE_NAME`.

## Runtime

| File | Size | SHA-256 |
| :--- | ---: | :--- |
| `venv312_cpu.tar.zst` | 1,454,946,513 B | `d3af735580f7ac2e49ba65a394e40ffdd8d1736f1167b00d1c0e0a0405d0df40` |
| `zstd_bin` | 1,022,760 B | `7c5468b370f7c47eda07281e3437fafc568f95d10420051e3aa522709f9342c5` |

Pins recorded inside the venv: Python 3.12, `torch 2.10.0+cpu`,
`vllm-tpu 0.32.0`, `tpu-inference 0.32.0`, `jax 0.11.2`, `jaxlib 0.11.2`,
`libtpu 0.0.48`.

## Active XLA caches

| Variant | Path | Size | SHA-256 | Pinned by |
| :--- | :--- | ---: | :--- | :--- |
| LFM2.5 V1 | `models/LFM/LFM2.5-24B-A2B/vllm-tpu-0.32.0/len100000__b16-8192__42f6059b.tar` | 196,085,760 B | `bdbb4fb3872664a713d8517268dff984af4ee7ceabf9ad90700a2bfba27b41ef` | `config/v5e-w8a8-w4a16.toml` |
| LFM2.5 V2 `noclip` | `models/LFM/LFM2.5-24B-A2B/vllm-tpu-0.32.0/len100000__b16-8192__noclip__0a680e5e.tar` | 199,987,200 B | `32827c9cb9f736d7e66b643813541f9d3f06c1dc2a5cc9ba99a967e8f309f5e7` | `config/v5e-w8a8-w4a16-v2.toml` |

The old `clip99` archive was byte-identical to `noclip` (same SHA-256), so it
is not duplicated here. Superseded caches are under `archive/` and are never
auto-restored.

## Consuming it

```toml
[install]
repo = "avgrocketman/compile-cache-v5e"
filename = "venv312_cpu.tar.zst"

[env]
COLDSTART_CACHE_NAME = "models/LFM/LFM2.5-24B-A2B/vllm-tpu-0.32.0/len100000__b16-8192__42f6059b.tar"
```

A cache is valid only for the exact combination of chip, engine version, model,
`context_length`, sorted buckets, KV mode, and patch set. The filename hash and
the explicit pin enforce that; there is no fallback to another model's cache.

## History

Moved from `avgrocketman/tpu-compile-cache` on 2026-11-06. The old flat-name
caches and the Qwen3 caches are preserved under `archive/`; the old repo is kept
read-only as a redirect. The move is a Hub-side copy, so the archive bytes and
XLA keys are unchanged.

License: the venv contains open-source Python packages under their own licenses;
the cache archives contain compiled XLA programs, not model weights.