Instructions to use 0Tick/e621TagAutocomplete with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use 0Tick/e621TagAutocomplete with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="0Tick/e621TagAutocomplete")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("0Tick/e621TagAutocomplete")
model = AutoModelForCausalLM.from_pretrained("0Tick/e621TagAutocomplete", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use 0Tick/e621TagAutocomplete with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "0Tick/e621TagAutocomplete"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0Tick/e621TagAutocomplete",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/0Tick/e621TagAutocomplete

SGLang

How to use 0Tick/e621TagAutocomplete with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "0Tick/e621TagAutocomplete" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0Tick/e621TagAutocomplete",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "0Tick/e621TagAutocomplete" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "0Tick/e621TagAutocomplete",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use 0Tick/e621TagAutocomplete with Docker Model Runner:
```
docker model run hf.co/0Tick/e621TagAutocomplete
```

e621TagAutocomplete / README.md

Commit History

Librarian Bot: Add base_model information to model (#3)

111edf4

0Tick

librarian-bot commited on Sep 11, 2023

Include Dataset

0076716

0Tick commited on Mar 2, 2023

Update README.md

9c8232e

0Tick commited on Feb 20, 2023

Add required files

38cc64e

0Tick commited on Feb 20, 2023

initial commit

d585801

0Tick commited on Feb 20, 2023

Commit History

Librarian Bot: Add base_model information to model (#3) 111edf4

Include Dataset 0076716

Update README.md 9c8232e

Add required files 38cc64e

initial commit d585801

Librarian Bot: Add base_model information to model (#3)

111edf4

Include Dataset

0076716

Update README.md

9c8232e

Add required files

38cc64e

initial commit

d585801