Instructions to use ablam/distilgpt2_fine_tuned_gcode with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ablam/distilgpt2_fine_tuned_gcode with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ablam/distilgpt2_fine_tuned_gcode")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ablam/distilgpt2_fine_tuned_gcode")
model = AutoModelForCausalLM.from_pretrained("ablam/distilgpt2_fine_tuned_gcode", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ablam/distilgpt2_fine_tuned_gcode with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ablam/distilgpt2_fine_tuned_gcode"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ablam/distilgpt2_fine_tuned_gcode",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/ablam/distilgpt2_fine_tuned_gcode

SGLang

How to use ablam/distilgpt2_fine_tuned_gcode with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ablam/distilgpt2_fine_tuned_gcode" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ablam/distilgpt2_fine_tuned_gcode",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ablam/distilgpt2_fine_tuned_gcode" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ablam/distilgpt2_fine_tuned_gcode",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use ablam/distilgpt2_fine_tuned_gcode with Docker Model Runner:
```
docker model run hf.co/ablam/distilgpt2_fine_tuned_gcode
```

distilgpt2_fine_tuned_gcode

Commit History

Mar 20, 2023

12:55
Adding `safetensors` variant of this model⁠

SFconvertbot

95be452

Jun 11, 2022

03:52
update model card README.md

ablam

34da971
03:38
End of training

ablam

e404722
03:23
Training in progress, step 50000

ablam

e9a4472
03:09
Training in progress, step 44500

ablam

7fac47f
02:54
Training in progress, step 39000

ablam

c6fa712
02:40
Training in progress, step 33500

ablam

f37398c
02:26
Training in progress, step 28000

ablam

fdb84e3
02:11
Training in progress, step 22500

ablam

ebd5864
01:57
Training in progress, step 17000

ablam

0d2c1ab
01:43
Training in progress, step 11500

ablam

66f2190
01:21
Training in progress, step 500

ablam

f6511b3
00:59
Training in progress, step 27500

ablam

e11cfae
00:46
Training in progress, step 22000

ablam

31e1b83
00:32
Training in progress, step 16500

ablam

5ade2e0
00:19
Training in progress, step 11000

ablam

fa97cec
00:04
Training in progress, step 5500

ablam

116cb99

Jun 10, 2022

23:50
Training in progress, step 500

ablam

e8ffb60
23:41
Merge branch 'main' of https://huggingface.co/ablam/distilgpt2_fine_tuned_gcode

ablam

2f476c2

May 13, 2022

23:12
End of training

ablam

e38d955
23:02
Create README.md

ablam

a120f49
22:54
Training in progress, step 11000

ablam

90dc2e1
22:38
Training in progress, step 7500

ablam

37e618e
22:23
Training in progress, step 4000

ablam

8326c51
22:07
Training in progress, step 500

ablam

cea2adb

May 11, 2022

22:55
Training in progress, step 223000

ablam

c4c6e8f
22:42
Training in progress, step 215000

ablam

f617022
22:28
Training in progress, step 206000

ablam

9c3fce8
22:16
Training in progress, step 198500

ablam

c93ee88
22:04
Training in progress, step 191000

ablam

929f2a7
21:52
Training in progress, step 184000

ablam

96407d6
21:37
Training in progress, step 173000

ablam

10fe45a
21:23
Training in progress, step 163000

ablam

7d24ef6
21:12
Training in progress, step 155000

ablam

57c63c4
21:01
Training in progress, step 148000

ablam

73bbabc
20:51
Training in progress, step 141000

ablam

4c34dde
20:41
Training in progress, step 134000

ablam

531e1d1
20:30
Training in progress, step 126500

ablam

beaae3a
20:20
Training in progress, step 119500

ablam

223b21e
20:10
Training in progress, step 112500

ablam

a8f3951
20:01
Training in progress, step 105500

ablam

b35b921
19:51
Training in progress, step 98000

ablam

01b6629
19:41
Training in progress, step 90500

ablam

1b909bc
19:31
Training in progress, step 83000

ablam

c719615
19:21
Training in progress, step 75500

ablam

b740867
19:12
Training in progress, step 68000

ablam

62e0f04
19:03
Training in progress, step 60500

ablam

3250333
18:54
Training in progress, step 53000

ablam

76ef978
18:45
Training in progress, step 45500

ablam

bef1773
18:36
Training in progress, step 38000

ablam

4dad386

Commit History

Mar 20, 2023

Adding `safetensors` variant of this model⁠

Jun 11, 2022

update model card README.md

End of training

Training in progress, step 50000

Training in progress, step 44500

Training in progress, step 39000

Training in progress, step 33500

Training in progress, step 28000

Training in progress, step 22500

Training in progress, step 17000

Training in progress, step 11500

Training in progress, step 500

Training in progress, step 27500

Training in progress, step 22000

Training in progress, step 16500

Training in progress, step 11000

Training in progress, step 5500

Jun 10, 2022

Training in progress, step 500

Merge branch 'main' of https://huggingface.co/ablam/distilgpt2_fine_tuned_gcode

May 13, 2022

End of training

Create README.md

Training in progress, step 11000

Training in progress, step 7500

Training in progress, step 4000

Training in progress, step 500

May 11, 2022

Training in progress, step 223000

Training in progress, step 215000

Training in progress, step 206000

Training in progress, step 198500

Training in progress, step 191000

Training in progress, step 184000

Training in progress, step 173000

Training in progress, step 163000

Training in progress, step 155000

Training in progress, step 148000

Training in progress, step 141000

Training in progress, step 134000

Training in progress, step 126500

Training in progress, step 119500

Training in progress, step 112500

Training in progress, step 105500

Training in progress, step 98000

Training in progress, step 90500

Training in progress, step 83000

Training in progress, step 75500

Training in progress, step 68000

Training in progress, step 60500

Training in progress, step 53000

Training in progress, step 45500

Training in progress, step 38000