Instructions to use tampajohn/meow-lite-v6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tampajohn/meow-lite-v6 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="tampajohn/meow-lite-v6")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("tampajohn/meow-lite-v6")
model = AutoModelForCausalLM.from_pretrained("tampajohn/meow-lite-v6", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use tampajohn/meow-lite-v6 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tampajohn/meow-lite-v6"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tampajohn/meow-lite-v6",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/tampajohn/meow-lite-v6

SGLang

How to use tampajohn/meow-lite-v6 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "tampajohn/meow-lite-v6" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tampajohn/meow-lite-v6",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "tampajohn/meow-lite-v6" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tampajohn/meow-lite-v6",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use tampajohn/meow-lite-v6 with Docker Model Runner:
```
docker model run hf.co/tampajohn/meow-lite-v6
```

meow-lite-v6

The meow-lite family

meow-lite — v4 classic: the 104K meow toy behind the OpenAI/Anthropic shim (497 organic downloads and counting)
meow-lite-v5 — the chaotic cat: 6.8M from-scratch BPE GPT, 73.7% held-out comprehension, 15% leak
meow-lite-v6 — the calmer cat: same architecture, 68.5% comprehension, 0% leak
meow-lite-v6-dataset — the 16,633-pair teacher web + full methodology
github.com/tampajohn/meow-lite — server, specs, eval batteries (MIT) The calmer cat. A 6,836,224-parameter from-scratch BPE GPT that reads English and can only speak cat. Minds its manners: 97% of everyday prompts get pure, well-formed meow.

Two temperaments

	v5	v6 (this)
Temperament	chaotic	calmer
Held-out synonym accuracy	73.7%	68.5%
Fresh-neutral leak	15%	0%
Vibe	comprehends more, interrupts more	comprehends slightly less, minds its manners

Served with action damping d=2 (inference-time prior suppression): the numbers above are the served reality, measured on the full held-out battery. Both were trained on the identical corpus with the identical recipe; the difference is which seed the dice favored. We ship both, because cats are inconsistent.

Architecture

GPT-2 (from-scratch, random init): n_layer=6, n_head=8, n_embd=256, n_positions=192
Tokenizer: byte-level BPE (~8k) + 10 cat action tokens as specials
Trained in minutes on a laptop (the 16,633-pair teacher web took ~13h on 2x GB10)
Output hard-masked to cat tokens (CatMask LogitsProcessor): non-cat output is impossible by construction
ActionOnce: each action token fires once per response (repeat biting 100% -> 0%)
ActionDamping d=2: prior suppression of action logits (the served numbers above)
Deterministic: sha256(prompt) seeds sampling; same prompt, same cat

Samples

"can I rub her tummy?" -> " Purrr!"
"How was your day" -> "Mewmew!!"
"what is the date" -> "Mrow?"
"Explain gravity" -> "Mrrp."
"is that a glass on the table" -> " Prrrt?"

Usage

Server, tokenizer, eval batteries, and the companion chaotic model: https://github.com/tampajohn/meow-lite (MEOW_LITE_ENGINE=v6)

Dataset + full methodology: https://huggingface.co/datasets/tampajohn/meow-lite-v6-dataset

Downloads last month: 249

Safetensors

Model size

6.84M params

Tensor type

F32