Instructions to use huggingtweets/gailsimone with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use huggingtweets/gailsimone with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="huggingtweets/gailsimone")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("huggingtweets/gailsimone")
model = AutoModelForCausalLM.from_pretrained("huggingtweets/gailsimone", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use huggingtweets/gailsimone with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "huggingtweets/gailsimone"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/gailsimone",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/huggingtweets/gailsimone

SGLang

How to use huggingtweets/gailsimone with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "huggingtweets/gailsimone" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/gailsimone",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "huggingtweets/gailsimone" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/gailsimone",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use huggingtweets/gailsimone with Docker Model Runner:
```
docker model run hf.co/huggingtweets/gailsimone
```

gailsimone

Commit History

May 22, 2021

04:59
upload flax model

patrickvonplaten

776a234
04:59
allow flax

patrickvonplaten

d200120

Sep 28, 2020

07:01
Update README.md

system HF Staff

c00b36b
07:01
Update README.md

system HF Staff

542483d
07:00
Update README.md

system HF Staff

8697a2b
06:59
Update README.md

system HF Staff

5d98425
06:59
Update config.json

system HF Staff

072f8ee
06:59
Update tokenizer_config.json

system HF Staff

5126e4b
06:59
Update vocab.json

system HF Staff

bf48529
06:59
Update pytorch_model.bin

system HF Staff

5c2b0e8
06:59
Update merges.txt

system HF Staff

993c138
06:59
Update README.md

system HF Staff

f369a57
06:59
Update special_tokens_map.json

system HF Staff

0a95b01
06:59
initial commit

system HF Staff

90eb5c1

Commit History

May 22, 2021

upload flax model

allow flax

Sep 28, 2020

Update README.md

Update README.md

Update README.md

Update README.md

Update config.json

Update tokenizer_config.json

Update vocab.json

Update pytorch_model.bin

Update merges.txt

Update README.md

Update special_tokens_map.json

initial commit