FlashSVD checkpoints and BASIS experiment inputs

BASIS: download experiment inputs here

For the Additional Experiments, start with the BASIS data guide.

You need…	Go to…
C4 training data	Six frozen C4 streams: two backbones × three seeds
Q64/Q128 probe and held-out tensors	Probe inputs
Cached per-window gradients	Q128 · Original Q64
Exact frozen compressed Sources	33 hosted native checkpoints, including all 24 exact Table 1 Sources
Tokenizers, original paths, and checksums	Tokenizers · Artifact manifest

The shared data and caches total approximately 4.4 GiB; the 33 hosted native checkpoints total 353.5 GiB. Download only the Source files needed for your task. The guide includes selective download commands, loader instructions, checkpoint coverage, and the seven newly supplied Task 05 GFWSVD/Swift-SVD ratio Sources. Tasks 01–02 already include their numerical inputs in GitHub.

Table 1, verified 2026-09-23: All 24 exact paper Source checkpoints and their loader records are hosted in basis/sources/. The 120 checkpoint files passed remote size/hash audit. Keep the original .pt or sharded format and load with the BASIS handoff code. Download and verification guide.

Added 2026-09-17: GFWSVD r0.5/r0.7 (Llama/Qwen) and Swift-SVD r0.4/r0.5/r0.7 (Qwen), with download instructions and checksums.

Original FlashSVD example checkpoints

This repository contains a small set of curated example low-rank checkpoints for FlashSVD-v1.5 benchmarking and integration tests. The current examples cover SVD-LLM v1, Basis Sharing, and DobiSVD variants.

Properties of these original example checkpoints:

• all uploaded checkpoints remain factorized / low-rank; they are not fused into dense tensors
• removable RoPE runtime buffers are omitted from the SVD-LLM examples
• each example is a self-contained HF export subfolder

Example loader:

from utils.model_utils import get_model_from_source
import torch

source = "Duke-CEI-SVD/FlashSVD/llama_7b/svdllm_v1/whitening_only_0.5_hf"
model, tok = get_model_from_source(source)
model = model.eval().to("cuda", dtype=torch.bfloat16)

BASIS intern code

Use the intern GitHub branch for installation, Source loading/checking, compression, and the five assignments. Tested code revision: 57218ca. The current handoff downloader pins the verified complete checkpoint revision 4ada2a6; download weights/data here and run the commands from that branch.