Update DFlash to 1M-verifier continuation step 15000

#2
Files changed (3) hide show
  1. .gitattributes +0 -1
  2. README.md +3 -64
  3. model.safetensors +1 -1
.gitattributes CHANGED
@@ -33,4 +33,3 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
- Laguna-S-2.1-DFlash-BF16.gguf filter=lfs diff=lfs merge=lfs -text
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
README.md CHANGED
@@ -8,72 +8,11 @@ base_model:
8
  - poolside/Laguna-S-2.1
9
  ---
10
 
11
- <p align="center">
12
- <img alt="poolside-banner" src="https://poolside.ai/assets/laguna/laguna-s-2-1-banner.svg" width="800px">
13
- </p>
14
 
15
- <p align="center">
16
- <a href="https://openrouter.ai/poolside/laguna-s-2.1"><strong>Use on OpenRouter</strong></a> ·
17
- <a href="https://vercel.com/ai-gateway/models/laguna-s-2.1"><strong>Use on Vercel AI Gateway</strong></a> ·
18
- <a href="https://poolside.ai/blog/introducing-laguna-s-2-1"><strong>Release blog post</strong></a>
19
- </p>
20
-
21
- <br>
22
-
23
- # Laguna-S-2.1-DFlash
24
-
25
- DFlash speculator (draft model) for
26
- [Laguna S 2.1](https://huggingface.co/poolside/Laguna-S-2.1), bf16.
27
 
28
  - Architecture: `DFlashLagunaForCausalLM` (6 sliding-attention layers, block_size 16).
29
  - Shares token embedding + lm_head with the target; `draft_vocab_size == vocab_size` (no d2t/t2d).
 
30
  - Loads under vLLM (native `laguna_dflash`) and TRT-LLM (pytorch DFlash backend) as the draft model in a speculative config.
31
-
32
- ## Usage
33
-
34
- ### vLLM
35
-
36
- ```shell
37
- vllm serve --model poolside/Laguna-S-2.1 \
38
- --speculative-config '{"model":"poolside/Laguna-S-2.1-DFlash","num_speculative_tokens":7,"method":"dflash"}' \
39
- ...
40
- ```
41
-
42
- ### SGLang
43
-
44
- ```shell
45
- python -m sglang.launch_server --model-path poolside/Laguna-S-2.1 \
46
- --speculative-algorithm DFLASH \
47
- --speculative-draft-model-path poolside/Laguna-S-2.1-DFlash \
48
- ...
49
- ```
50
-
51
- ### llama.cpp (GGUF)
52
-
53
- A llama.cpp conversion of this draft model (`laguna-s-2.1-DFlash-BF16.gguf`) is
54
- published in
55
- [poolside/Laguna-S-2.1-GGUF](https://huggingface.co/poolside/Laguna-S-2.1-GGUF)
56
- alongside the target GGUFs. It embeds the target tokenizer and the DFlash metadata
57
- (`dflash.decoder_arch = laguna`, capture layers, block size), so it works directly
58
- as the `-md` draft model:
59
-
60
- ```shell
61
- git clone --branch laguna https://github.com/poolsideai/llama.cpp
62
- cd llama.cpp && cmake -B build && cmake --build build -j
63
-
64
- ./build/bin/llama-server \
65
- -m laguna-s-2.1-Q4_K_M.gguf \
66
- -md laguna-s-2.1-DFlash-BF16.gguf \
67
- --spec-type draft-dflash --spec-draft-n-max 7 \
68
- -fa on --jinja --port 8000
69
- ```
70
-
71
- `--spec-draft-n-max` is clamped to the trained block size (15 draft tokens + 1).
72
-
73
- > [!NOTE]
74
- > Requires Poolside's llama.cpp fork, branch
75
- > [`laguna`](https://github.com/poolsideai/llama.cpp/tree/laguna). Upstream
76
- > llama.cpp ships the generic DFlash framework but not the Laguna decoder
77
- > contract this draft model needs, and upstream PR
78
- > [ggml-org/llama.cpp#25165](https://github.com/ggml-org/llama.cpp/pull/25165)
79
- > covers the target architecture only.
 
8
  - poolside/Laguna-S-2.1
9
  ---
10
 
11
+ # Laguna-S-2.1-DFlash-polishing
 
 
12
 
13
+ DFlash speculator (drafter) for Laguna-S-2.1, bf16.
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  - Architecture: `DFlashLagunaForCausalLM` (6 sliding-attention layers, block_size 16).
16
  - Shares token embedding + lm_head with the target; `draft_vocab_size == vocab_size` (no d2t/t2d).
17
+ - Source checkpoint: `s3://poolside.titan.checkpoints.us-east-2/adam/checkpoints/ft_sft_e0630_rhiemann_baseline_titan_sft_training/0008400/DFlash_Stage2/25000`
18
  - Loads under vLLM (native `laguna_dflash`) and TRT-LLM (pytorch DFlash backend) as the draft model in a speculative config.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f24f08781c697c19952c02fb2e7e9bdf2071b79a711c2a44b836a74b9b62a1f4
3
  size 2229962896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ab97c555e4d78a8918ed0c444b563875cdf07017f07a201210e543313d55b30
3
  size 2229962896