Instructions to use huggingtweets/cassidoo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use huggingtweets/cassidoo with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="huggingtweets/cassidoo")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("huggingtweets/cassidoo")
model = AutoModelForCausalLM.from_pretrained("huggingtweets/cassidoo", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use huggingtweets/cassidoo with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "huggingtweets/cassidoo"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/cassidoo",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/huggingtweets/cassidoo

SGLang

How to use huggingtweets/cassidoo with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "huggingtweets/cassidoo" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/cassidoo",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "huggingtweets/cassidoo" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huggingtweets/cassidoo",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use huggingtweets/cassidoo with Docker Model Runner:
```
docker model run hf.co/huggingtweets/cassidoo
```

cassidoo

Commit History

May 21, 2021

21:54
upload flax model

patrickvonplaten

8fe0905
21:54
allow flax

patrickvonplaten

c5d9edf

Oct 9, 2020

19:14
Update README.md

system HF Staff

7d28907
19:14
Update README.md

system HF Staff

7d34425
19:13
Update README.md

system HF Staff

b0d349d
19:08
Update README.md

system HF Staff

3f7753e
19:08
Update README.md

system HF Staff

09a435e
19:07
Update README.md

system HF Staff

bd69807
19:07
Update README.md

system HF Staff

71d6061
19:04
Update README.md

system HF Staff

2e23811
19:02
Update README.md

system HF Staff

becbe08
19:01
Update README.md

system HF Staff

15e14e2
19:00
Update README.md

system HF Staff

ad13216
18:59
Update README.md

system HF Staff

4f581a3
18:57
Update README.md

system HF Staff

f538288
18:54
Update README.md

system HF Staff

e38e298
18:52
Update README.md

system HF Staff

4bf5a6a
18:50
Update README.md

system HF Staff

500deee
18:50
Update README.md

system HF Staff

3c9d304
18:49
Update merges.txt

system HF Staff

0746bed
18:49
Update vocab.json

system HF Staff

f5c60db
18:49
Update config.json

system HF Staff

03864db
18:49
Update special_tokens_map.json

system HF Staff

bcccf67
18:49
Update tokenizer_config.json

system HF Staff

e4aaa9d
18:49
Update README.md

system HF Staff

98c915a
18:49
Update pytorch_model.bin

system HF Staff

b9701d2
15:28
Update README.md

system HF Staff

9e35ce1
15:26
Update README.md

system HF Staff

eb01c92
15:24
Update vocab.json

system HF Staff

eb45230
15:24
Update README.md

system HF Staff

90dc86f
15:24
Update merges.txt

system HF Staff

6ab0306
15:24
Update tokenizer_config.json

system HF Staff

0dd4363
15:24
Update config.json

system HF Staff

cec58d5
15:24
Update special_tokens_map.json

system HF Staff

badf2a3
08:48
Update README.md

system HF Staff

bfc4309
08:47
Update vocab.json

system HF Staff

a424776
08:47
Update tokenizer_config.json

system HF Staff

fb63fa2
08:47
Update README.md

system HF Staff

2a4dc2e
08:47
Update merges.txt

system HF Staff

5d81d56
08:47
Update config.json

system HF Staff

f52f5be
08:47
Update special_tokens_map.json

system HF Staff

3e6cd4d
08:47
initial commit

system HF Staff

2345269

Commit History

May 21, 2021

upload flax model

allow flax

Oct 9, 2020

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update merges.txt

Update vocab.json

Update config.json

Update special_tokens_map.json

Update tokenizer_config.json

Update README.md

Update pytorch_model.bin

Update README.md

Update README.md

Update vocab.json

Update README.md

Update merges.txt

Update tokenizer_config.json

Update config.json

Update special_tokens_map.json

Update README.md

Update vocab.json

Update tokenizer_config.json

Update README.md

Update merges.txt

Update config.json

Update special_tokens_map.json

initial commit