Instructions to use juinron/Hummingbird-V2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use juinron/Hummingbird-V2 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="juinron/Hummingbird-V2", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("juinron/Hummingbird-V2", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use juinron/Hummingbird-V2 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "juinron/Hummingbird-V2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "juinron/Hummingbird-V2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/juinron/Hummingbird-V2

SGLang

How to use juinron/Hummingbird-V2 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "juinron/Hummingbird-V2" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "juinron/Hummingbird-V2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "juinron/Hummingbird-V2" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "juinron/Hummingbird-V2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use juinron/Hummingbird-V2 with Docker Model Runner:
```
docker model run hf.co/juinron/Hummingbird-V2
```

Hummingbird-V2

File size: 3,539 Bytes

{
  "base_token_presentations": 0,
  "checkpoint": "artifacts/runs/flightmix_10b_balanced_10m_muon_lrfix_20260921/checkpoint-tokens-10000000000",
  "checkpoint_model_sha256": "4a7070feab2f6e6231597566e7049bab9e4acb283035674b357e33a1eabbda5f",
  "cumulative_token_presentations": 10000000000,
  "files": {
    "LICENSE": {
      "bytes": 11357,
      "sha256": "c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4"
    },
    "NOTICE": {
      "bytes": 581,
      "sha256": "6125f403571b9c2bdf9995946836026822688f56db5ee15ac3e93292573e1ff2"
    },
    "README.md": {
      "bytes": 3275,
      "sha256": "07660e0fd62867bbdb48dec5332cf455a086a52e0d3032580368a72324eb4c30"
    },
    "TRAINING_DATA.md": {
      "bytes": 1953,
      "sha256": "29ede51040f52d51f6fd867c0e4c2f539021decbb598249b93cceccc0c929d12"
    },
    "chat_template.jinja": {
      "bytes": 184,
      "sha256": "df23563531f85f90a16699e28d1fe2458f8d6e46e9a4ab61a9ce0d3b1459bf8c"
    },
    "config.json": {
      "bytes": 2205,
      "sha256": "4d0918c0c25f9b8ab211f99c3636e3f70e2398800d5723b4dd768752448dc763"
    },
    "configuration_microloop.py": {
      "bytes": 14396,
      "sha256": "b30c3e8002d64a3cb3ce79b562bf7d28a35c6a5f5cd5ab03fb8cacb5e5aed640"
    },
    "evaluation/arithmark_3.json": {
      "bytes": 4814,
      "sha256": "f22aec4d51a6702830f280328a0df5141741e5752cf816c5c82b62e4bcd278c2"
    },
    "evaluation/open_slm.json": {
      "bytes": 10854,
      "sha256": "c47c9cf09f055e75842d158c0933e57612115f186ae69c66462374915a4d2fa9"
    },
    "generation_config.json": {
      "bytes": 250,
      "sha256": "c086c408dba55e547bac299549a8b7713c768cb94a52fd2043429b1564d76094"
    },
    "hummingbird-v2-banner.jpg": {
      "bytes": 135376,
      "sha256": "f91214ac9d73b3ce3fd855d1c0d875e7b07e86688c14ab11cb0b6095a5cec948"
    },
    "model.safetensors": {
      "bytes": 39041336,
      "sha256": "4a7070feab2f6e6231597566e7049bab9e4acb283035674b357e33a1eabbda5f"
    },
    "modeling_microloop.py": {
      "bytes": 56187,
      "sha256": "8c0c2e82238c562bceb740b251c3515e080c34adf8b6e32d719c071fc7e65312"
    },
    "prefix_lm.py": {
      "bytes": 1792,
      "sha256": "21c20eb64f9e6a83740f9cc65265cc962e73656b5bb560422824cd84c9c11363"
    },
    "tokenizer.json": {
      "bytes": 265304,
      "sha256": "c063fd42efccd8416d0375230767949356088cc430c8e74d4547438479889077"
    },
    "tokenizer_config.json": {
      "bytes": 482,
      "sha256": "87e2a284910c5738892c66e027fa8d9a9d2a4cdc7311a4e9503cffbb7997eeb8"
    },
    "training/corpus_contract.yaml": {
      "bytes": 6657,
      "sha256": "73cd71ff4f7849d939606bd77434df4697d590bdfe2202ba1681b267c63f6786"
    },
    "training/packed_metadata.json": {
      "bytes": 7849,
      "sha256": "299c06fc6281817997b2ac1f90a176d18b10136b8567f62d58013a0c2b7838ef"
    },
    "training/provenance.json": {
      "bytes": 3026,
      "sha256": "01ebc88c052474820381609e2a613a2c7209add45e9f4da3c777d441bd4d51b2"
    }
  },
  "format_version": 1,
  "license": "apache-2.0",
  "model_id": "juinron/Hummingbird-V2",
  "parameter_count": 9592720,
  "release_name": "Hummingbird-V2",
  "scores": {
    "arc_challenge": 21.160409556313994,
    "arc_easy": 39.39393939393939,
    "arithmark_3": 36.0,
    "hellaswag": 27.633937462656842,
    "int_index": 9.556212826458404,
    "piqa": 57.399347116430896
  },
  "tokenizer": "artifacts/runs/e3_tokenizers/tok_4k_digit",
  "tokens_seen": 10000000000
}