Instructions to use Arjun-G-Ravi/GPT2-Alpaca with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Arjun-G-Ravi/GPT2-Alpaca with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Arjun-G-Ravi/GPT2-Alpaca")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Arjun-G-Ravi/GPT2-Alpaca")
model = AutoModelForCausalLM.from_pretrained("Arjun-G-Ravi/GPT2-Alpaca", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Arjun-G-Ravi/GPT2-Alpaca with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Arjun-G-Ravi/GPT2-Alpaca"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Arjun-G-Ravi/GPT2-Alpaca",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Arjun-G-Ravi/GPT2-Alpaca

SGLang

How to use Arjun-G-Ravi/GPT2-Alpaca with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Arjun-G-Ravi/GPT2-Alpaca" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Arjun-G-Ravi/GPT2-Alpaca",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Arjun-G-Ravi/GPT2-Alpaca" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Arjun-G-Ravi/GPT2-Alpaca",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Arjun-G-Ravi/GPT2-Alpaca with Docker Model Runner:
```
docker model run hf.co/Arjun-G-Ravi/GPT2-Alpaca
```

GPT2-Alpaca

Commit History

Jul 30, 2023

04:11
Adding `safetensors` variant of this model⁠

SFconvertbot

81c9992
04:09
Update README.md

Arjun-G-Ravi

d778524
04:07
Update README.md

Arjun-G-Ravi

cee96fb
04:03
Update README.md

Arjun-G-Ravi

901ea25
04:02
Update README.md

Arjun-G-Ravi

45db21f
03:59
Update README.md

Arjun-G-Ravi

85f418b
03:57
Update README.md

Arjun-G-Ravi

b1f00b0
03:49
Upload 9 files

Arjun-G-Ravi

65e31ce
03:46
Update README.md

Arjun-G-Ravi

f27df4b
03:21
Update README.md

Arjun-G-Ravi

6fc7ce0

Jul 29, 2023

03:47
Update README.md

Arjun-G-Ravi

23a79dc
03:39
Update README.md

Arjun-G-Ravi

09fbe7a
03:39
Update README.md

Arjun-G-Ravi

bbba376
03:34
Update README.md

Arjun-G-Ravi

b5ed3b2
03:33
Update README.md

Arjun-G-Ravi

7f58f4d
03:33
Update README.md

Arjun-G-Ravi

5fa0108
03:32
Update README.md

Arjun-G-Ravi

b17924e
03:29
Update README.md

Arjun-G-Ravi

0f4c55b
03:28
Update README.md

Arjun-G-Ravi

be841c5
03:28
Update README.md

Arjun-G-Ravi

c5235ce
03:27
Update README.md

Arjun-G-Ravi

c512bd2
03:21
Update README.md

Arjun-G-Ravi

797084e
03:19
Upload 9 files

Arjun-G-Ravi

af65b2d
03:19
Delete GPT2-Alpaca

Arjun-G-Ravi

d5e0a9e
03:17
Upload 9 files

Arjun-G-Ravi

4581a3d
03:04
Update README.md

Arjun-G-Ravi

6e925aa
03:01
initial commit

Arjun-G-Ravi

f6f7ce1

Commit History

Jul 30, 2023

Adding `safetensors` variant of this model⁠

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Upload 9 files

Update README.md

Update README.md

Jul 29, 2023

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Upload 9 files

Delete GPT2-Alpaca

Upload 9 files

Update README.md

initial commit