Instructions to use nide01/pokemon_captions with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use nide01/pokemon_captions with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="nide01/pokemon_captions")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("nide01/pokemon_captions")
model = AutoModelForMultimodalLM.from_pretrained("nide01/pokemon_captions", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use nide01/pokemon_captions with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "nide01/pokemon_captions"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nide01/pokemon_captions",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/nide01/pokemon_captions

SGLang

How to use nide01/pokemon_captions with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "nide01/pokemon_captions" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nide01/pokemon_captions",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "nide01/pokemon_captions" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nide01/pokemon_captions",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use nide01/pokemon_captions with Docker Model Runner:
```
docker model run hf.co/nide01/pokemon_captions
```

nide01 commited on Nov 21, 2023

Commit

0a84fb1

1 Parent(s): da50a5d

End of training

Browse files

Files changed (2) hide show

README.md +6 -6
runs/Nov21_08-52-25_Heribertos-MacBook-Pro.local/events.out.tfevents.1700556745.Heribertos-MacBook-Pro.local.11575.0 +2 -2

README.md CHANGED Viewed

@@ -15,8 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 6.8491
-- Wer Score: 27.3311
 ## Model description
@@ -49,10 +49,10 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss | Wer Score |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|
-| 9.5592        | 0.21  | 10   | 8.4159          | 77.3246   |
-| 8.0991        | 0.43  | 20   | 7.6337          | 77.4139   |
-| 7.4706        | 0.64  | 30   | 7.1321          | 54.4126   |
-| 7.0716        | 0.85  | 40   | 6.8491          | 27.3311   |
 ### Framework versions

 This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 6.8347
+- Wer Score: 36.5683
 ## Model description
 | Training Loss | Epoch | Step | Validation Loss | Wer Score |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|
+| 9.5449        | 0.21  | 10   | 8.4043          | 75.6190   |
+| 8.092         | 0.43  | 20   | 7.6198          | 76.5618   |
+| 7.4582        | 0.64  | 30   | 7.1177          | 60.0286   |
+| 7.0634        | 0.85  | 40   | 6.8347          | 36.5683   |
 ### Framework versions

runs/Nov21_08-52-25_Heribertos-MacBook-Pro.local/events.out.tfevents.1700556745.Heribertos-MacBook-Pro.local.11575.0 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cf5977ff11a465668b446bac058d96bf02afd59924b2788fc71b26e40bd45c7e
-size 6289

 version https://git-lfs.github.com/spec/v1
+oid sha256:78b36ee941fc117a6295aa916e6d2b791c3f9dd9de738c19b1984eee04962aa3
+size 6637