Instructions to use jonng1000/git-base-pokemon with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use jonng1000/git-base-pokemon with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="jonng1000/git-base-pokemon")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("jonng1000/git-base-pokemon")
model = AutoModelForMultimodalLM.from_pretrained("jonng1000/git-base-pokemon", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use jonng1000/git-base-pokemon with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "jonng1000/git-base-pokemon"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/jonng1000/git-base-pokemon

SGLang

How to use jonng1000/git-base-pokemon with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "jonng1000/git-base-pokemon" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "jonng1000/git-base-pokemon" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jonng1000/git-base-pokemon",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use jonng1000/git-base-pokemon with Docker Model Runner:
```
docker model run hf.co/jonng1000/git-base-pokemon
```

git-base-pokemon

Commit History

Jul 30, 2023

05:08
Adding `safetensors` variant of this model⁠

SFconvertbot

b505251
03:58
update model card README.md

jonng1000

2dda124
03:56
Model save

jonng1000

c085f88

Jul 29, 2023

10:20
Training in progress, step 740

jonng1000

0d70949
10:18
Training in progress, step 500

jonng1000

873c629
10:16
Training in progress, step 260

jonng1000

a7f6e80
10:14
Training in progress, step 20

jonng1000

e54d960
08:48
initial commit

jonng1000

5a01929

Commit History

Jul 30, 2023

Adding `safetensors` variant of this model⁠

update model card README.md

Model save

Jul 29, 2023

Training in progress, step 740

Training in progress, step 500

Training in progress, step 260

Training in progress, step 20

initial commit