Instructions to use postbot/gpt2-medium-emailgen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use postbot/gpt2-medium-emailgen with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="postbot/gpt2-medium-emailgen")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("postbot/gpt2-medium-emailgen")
model = AutoModelForCausalLM.from_pretrained("postbot/gpt2-medium-emailgen", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use postbot/gpt2-medium-emailgen with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "postbot/gpt2-medium-emailgen"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "postbot/gpt2-medium-emailgen",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/postbot/gpt2-medium-emailgen

SGLang

How to use postbot/gpt2-medium-emailgen with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "postbot/gpt2-medium-emailgen" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "postbot/gpt2-medium-emailgen",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "postbot/gpt2-medium-emailgen" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "postbot/gpt2-medium-emailgen",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use postbot/gpt2-medium-emailgen with Docker Model Runner:
```
docker model run hf.co/postbot/gpt2-medium-emailgen
```

gpt2-medium-emailgen

Commit History

Mar 23, 2023

03:46
Adding `safetensors` variant of this model⁠

SFconvertbot

33497ed

Dec 18, 2022

02:49
Adding ONNX file of this model (#1)⁠

pszemraj

8ccd86c

Nov 4, 2022

18:30
Update README.md

pszemraj

670b3fd
18:28
update license to reasonable

pszemraj

59a2337
05:08
add colab demo

pszemraj

0034dc5

Oct 15, 2022

12:52
add python code as example

pszemraj

cc8b8ac

Oct 1, 2022

19:06
describe license

pszemraj

e838ab8

Sep 29, 2022

21:04
Update README.md

pszemraj

6bda6a9
20:29
Update README.md

pszemraj

bc68fbf
20:11
Update README.md

pszemraj

7a16ef2
20:08
Update README.md

pszemraj

dbafa58
20:05
Update README.md

pszemraj

ef0b9de
19:34
adding model files

pszemraj

de4b817
19:22
Upload tokenizer

pszemraj

407841f
10:01
initial commit

pszemraj

10f2d22

Commit History

Mar 23, 2023

Adding `safetensors` variant of this model⁠

Dec 18, 2022

Adding ONNX file of this model (#1)⁠

Nov 4, 2022

Update README.md

update license to reasonable

add colab demo

Oct 15, 2022

add python code as example

Oct 1, 2022

describe license

Sep 29, 2022

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

adding model files

Upload tokenizer

initial commit