Instructions to use butternese/self-distillation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use butternese/self-distillation with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="butternese/self-distillation")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("butternese/self-distillation")
model = AutoModelForCausalLM.from_pretrained("butternese/self-distillation", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use butternese/self-distillation with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "butternese/self-distillation"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "butternese/self-distillation",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/butternese/self-distillation

SGLang

How to use butternese/self-distillation with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "butternese/self-distillation" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "butternese/self-distillation",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "butternese/self-distillation" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "butternese/self-distillation",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use butternese/self-distillation with Docker Model Runner:
```
docker model run hf.co/butternese/self-distillation
```

self-distillation

Commit History

Feb 28, 2025

01:37
Training Update: 2025-02-28 08:07:52⁠

butternese

Verified signature
b33dd91

Feb 27, 2025

23:18
Training Update: 2025-02-28 03:19:18⁠

butternese

Verified signature
bedeb98

Feb 13, 2025

18:55
Training Update: 2025-02-14 01:00:48⁠

butternese

Verified signature
2ea9828
17:56
Training Update: 2025-02-14 00:08:30⁠

butternese

Verified signature
233a64a
14:24
Training Update: 2025-02-13 20:27:54⁠

butternese

Verified signature
c7eaf95

Feb 12, 2025

11:21
Training Update: 2025-02-12 17:33:47⁠

butternese

Verified signature
887bac7

Feb 10, 2025

10:23
Training Update: 2025-02-10 16:35:50⁠

butternese

Verified signature
e9917c0

Feb 7, 2025

12:49
Training Update: 2025-02-05 15:59:22⁠

butternese

Verified signature
683a562

Feb 6, 2025

16:17
Training Update: 2025-02-04 19:31:42⁠

butternese

Verified signature
ee04912

Feb 5, 2025

21:48
100000000_at_100000916

butternese

Verified signature
cfec04e
08:33
10000000_at_10000615

butternese

Verified signature
e7931f1
07:12
1000000_at_1001777

butternese

Verified signature
25a29b8
01:18
100000000_at_100000916

butternese

Verified signature
ab13e7a

Feb 4, 2025

12:05
10000000_at_10000615

butternese

Verified signature
db83218
10:44
1000000_at_1001777

butternese

Verified signature
53bcee0
08:28
10000_at_10030

butternese

Verified signature
cd20cf0

Feb 3, 2025

19:52
1_at_1185

butternese

Verified signature
2715147

Jan 29, 2025

22:40
Training Update: 2025-01-30 01:55:42⁠

butternese

Verified signature
24be870

Jan 4, 2025

15:42
Upload SelfDistillationLlama

butternese

Verified signature
fa15516
05:38
Training Update: 2025-01-04 12:23:27⁠

butternese

Verified signature
4c4b95c

Jan 3, 2025

13:26
Training Update: 2025-01-03 20:14:08⁠

butternese

Verified signature
51d00cf
12:46
Training Update: 2025-01-03 19:35:56⁠

butternese

Verified signature
15ed7ed
10:00
Training Update: 2025-01-03 16:48:48⁠

butternese

Verified signature
6166f9c
09:46
Training Update: 2025-01-03 16:34:49⁠

butternese

Verified signature
366442b
09:04
Upload SelfDistillationLlama

butternese

Verified signature
5f1241a
07:57
Upload SelfDistillationLlama

butternese

Verified signature
380fbfc
07:41
Upload SelfDistillationLlama

butternese

Verified signature
bfe243e
07:29
Upload SelfDistillationLlama

butternese

Verified signature
124b403

Jan 2, 2025

01:25
Training Update: 2025-01-02 08:13:54⁠

butternese

Verified signature
aa42d09

Jan 1, 2025

14:47
Training Update: 2025-01-01 21:35:49⁠

butternese

Verified signature
107f90a
14:08
Upload SelfDistillationLlama

butternese

Verified signature
960fb9a
14:03
Upload SelfDistillationLlama

butternese

Verified signature
fcb7839
12:45
Upload SelfDistillationLlama

butternese

Verified signature
87e3c03
12:23
Upload SelfDistillationLlama

butternese

Verified signature
c664727
12:15
Upload tokenizer

butternese

Verified signature
d114c57
12:05
Training Update: 2025-01-01 18:55:00⁠

butternese

Verified signature
afeca99
08:02
Training Update: 2025-01-01 14:51:59⁠

butternese

Verified signature
bbd30ee
00:00
Training Update: 2025-01-01 03:23:56⁠

butternese

Verified signature
6944692

Dec 31, 2024

22:13
Training Update: 2025-01-01 01:31:26⁠

butternese

Verified signature
93ba1c2
22:10
Training Update: 2025-01-01 01:33:36⁠

butternese

Verified signature
f06659e
15:35
Training Update: 2024-12-31 18:52:16⁠

butternese

Verified signature
d74151f
07:54
Training Update: 2024-12-31 11:58:35⁠

butternese

Verified signature
1592902
00:08
Training Update: 2024-12-31 03:57:26⁠

butternese

Verified signature
3c5abf8

Dec 30, 2024

22:27
Training Update: 2024-12-31 04:36:40⁠

butternese

Verified signature
1808171
18:55
Training Update: 2024-12-30 22:51:38⁠

butternese

Verified signature
6c64077

Dec 28, 2024

04:46
Training Update: 2024-12-28 11:26:42⁠

butternese

Verified signature
c4b8d62
02:03
Training Update: 2024-12-28 05:12:27⁠

butternese

Verified signature
097cab2

Dec 27, 2024

21:45
Training Update: 2024-12-28 01:38:14⁠

butternese

Verified signature
525473d
13:03
Training Update: 2024-12-27 15:33:01⁠

butternese

Verified signature
ee7679d
11:50
Training Update: 2024-12-27 14:28:37⁠

butternese

Verified signature
5fe60df

Commit History

Feb 28, 2025

Training Update: 2025-02-28 08:07:52⁠

Feb 27, 2025

Training Update: 2025-02-28 03:19:18⁠

Feb 13, 2025

Training Update: 2025-02-14 01:00:48⁠

Training Update: 2025-02-14 00:08:30⁠

Training Update: 2025-02-13 20:27:54⁠

Feb 12, 2025

Training Update: 2025-02-12 17:33:47⁠

Feb 10, 2025

Training Update: 2025-02-10 16:35:50⁠

Feb 7, 2025

Training Update: 2025-02-05 15:59:22⁠

Feb 6, 2025

Training Update: 2025-02-04 19:31:42⁠

Feb 5, 2025

100000000_at_100000916

10000000_at_10000615

1000000_at_1001777

100000000_at_100000916

Feb 4, 2025

10000000_at_10000615

1000000_at_1001777

10000_at_10030

Feb 3, 2025

1_at_1185

Jan 29, 2025

Training Update: 2025-01-30 01:55:42⁠

Jan 4, 2025

Upload SelfDistillationLlama

Training Update: 2025-01-04 12:23:27⁠

Jan 3, 2025

Training Update: 2025-01-03 20:14:08⁠

Training Update: 2025-01-03 19:35:56⁠

Training Update: 2025-01-03 16:48:48⁠

Training Update: 2025-01-03 16:34:49⁠

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Jan 2, 2025

Training Update: 2025-01-02 08:13:54⁠

Jan 1, 2025

Training Update: 2025-01-01 21:35:49⁠

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Upload SelfDistillationLlama

Upload tokenizer

Training Update: 2025-01-01 18:55:00⁠

Training Update: 2025-01-01 14:51:59⁠

Training Update: 2025-01-01 03:23:56⁠

Dec 31, 2024

Training Update: 2025-01-01 01:31:26⁠

Training Update: 2025-01-01 01:33:36⁠

Training Update: 2024-12-31 18:52:16⁠

Training Update: 2024-12-31 11:58:35⁠

Training Update: 2024-12-31 03:57:26⁠

Dec 30, 2024

Training Update: 2024-12-31 04:36:40⁠

Training Update: 2024-12-30 22:51:38⁠

Dec 28, 2024

Training Update: 2024-12-28 11:26:42⁠

Training Update: 2024-12-28 05:12:27⁠

Dec 27, 2024

Training Update: 2024-12-28 01:38:14⁠

Training Update: 2024-12-27 15:33:01⁠

Training Update: 2024-12-27 14:28:37⁠