# FlashSVD checkpoints and BASIS experiment inputs

## BASIS: download experiment inputs here

For the [Additional Experiments](https://github.com/Zishan-Shao/Basis/tree/handoff/paper-20260915/experiments/intern), start with the [BASIS data guide](https://huggingface.co/Duke-CEI-SVD/FlashSVD/blob/main/basis/README.md).

| You need… | Go to… |
|---|---|
| **C4 training data** | [Six frozen C4 streams: two backbones × three seeds](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/data/c4) |
| Q64/Q128 probe and held-out tensors | [Probe inputs](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/data/probes) |
| Cached per-window gradients | [Q128](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/gradients/q128) · [Original Q64](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/gradients/q64) |
| Exact frozen compressed Sources | [33 hosted native checkpoints, including all 24 exact Table 1 Sources](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/sources) |
| Tokenizers, original paths, and checksums | [Tokenizers](https://huggingface.co/Duke-CEI-SVD/FlashSVD/tree/main/basis/tokenizers) · [Artifact manifest](https://huggingface.co/Duke-CEI-SVD/FlashSVD/blob/main/basis/manifest.json) |

The shared data and caches total approximately **4.4 GiB**; the 33 hosted native checkpoints total **353.5 GiB**. Download only the Source files needed for your task. The guide includes selective download commands, loader instructions, checkpoint coverage, and the seven newly supplied Task 05 GFWSVD/Swift-SVD ratio Sources. Tasks 01–02 already include their numerical inputs in GitHub.

**Table 1, verified 2026-09-23:** All 24 exact paper Source checkpoints and their loader records are hosted in `basis/sources/`. The 120 checkpoint files passed remote size/hash audit. Keep the original `.pt` or sharded format and load with the [BASIS handoff code](https://github.com/Zishan-Shao/Basis/tree/handoff/paper-20260915). [Download and verification guide](basis/releases/table1_20260922/README.md).

**Added 2026-09-17:** [GFWSVD r0.5/r0.7 (Llama/Qwen) and Swift-SVD r0.4/r0.5/r0.7 (Qwen), with download instructions and checksums](basis/releases/source_ratios_20260917/README.md).

## Original FlashSVD example checkpoints

This repository contains a small set of curated example low-rank checkpoints for FlashSVD-v1.5 benchmarking and integration tests.
The current examples cover SVD-LLM v1, Basis Sharing, and DobiSVD variants.

Properties of these original example checkpoints:

- all uploaded checkpoints remain factorized / low-rank; they are not fused into dense tensors
- removable RoPE runtime buffers are omitted from the SVD-LLM examples
- each example is a self-contained HF export subfolder

Example loader:

```python
from utils.model_utils import get_model_from_source
import torch

source = "Duke-CEI-SVD/FlashSVD/llama_7b/svdllm_v1/whitening_only_0.5_hf"
model, tok = get_model_from_source(source)
model = model.eval().to("cuda", dtype=torch.bfloat16)
```

## BASIS intern code

Use the [intern GitHub branch](https://github.com/Zishan-Shao/Basis/tree/handoff/paper-20260915) for installation, Source loading/checking, compression, and the five assignments. [Tested code revision](https://github.com/Zishan-Shao/Basis/tree/57218ca8c09e12464adaddddc4924394eac668f5): `57218ca`. The [current handoff downloader](https://github.com/Zishan-Shao/Basis/tree/2801812) pins the verified complete checkpoint revision `4ada2a6`; download weights/data here and run the commands from that branch.