Instructions to use bhaiyasingh45/functiongemma-multiagent-router with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use bhaiyasingh45/functiongemma-multiagent-router with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="bhaiyasingh45/functiongemma-multiagent-router")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("bhaiyasingh45/functiongemma-multiagent-router")
model = AutoModelForCausalLM.from_pretrained("bhaiyasingh45/functiongemma-multiagent-router", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use bhaiyasingh45/functiongemma-multiagent-router with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "bhaiyasingh45/functiongemma-multiagent-router"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bhaiyasingh45/functiongemma-multiagent-router",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/bhaiyasingh45/functiongemma-multiagent-router

SGLang

How to use bhaiyasingh45/functiongemma-multiagent-router with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "bhaiyasingh45/functiongemma-multiagent-router" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bhaiyasingh45/functiongemma-multiagent-router",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "bhaiyasingh45/functiongemma-multiagent-router" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bhaiyasingh45/functiongemma-multiagent-router",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use bhaiyasingh45/functiongemma-multiagent-router with Docker Model Runner:
```
docker model run hf.co/bhaiyasingh45/functiongemma-multiagent-router
```

functiongemma-multiagent-router / runs

Commit History

Jan 5

16:17
Model save

Bhaiya Hari Narayan Singh

Verified signature
2140560
16:13
Training in progress, epoch 14

Bhaiya Hari Narayan Singh

Verified signature
5bae55c
16:10
Training in progress, epoch 13

Bhaiya Hari Narayan Singh

Verified signature
d4776d0
16:07
Training in progress, epoch 12

Bhaiya Hari Narayan Singh

Verified signature
7e8caaa
16:05
Training in progress, epoch 11

Bhaiya Hari Narayan Singh

Verified signature
368ee5d
16:03
Training in progress, epoch 10

Bhaiya Hari Narayan Singh

Verified signature
d0ff23f
16:01
Training in progress, epoch 9

Bhaiya Hari Narayan Singh

Verified signature
b1a028b
15:58
Training in progress, epoch 8

Bhaiya Hari Narayan Singh

Verified signature
b105c33
15:55
Training in progress, epoch 7

Bhaiya Hari Narayan Singh

Verified signature
6fd4ce1
15:54
Training in progress, epoch 6

Bhaiya Hari Narayan Singh

Verified signature
44a6f58
15:51
Training in progress, epoch 5

Bhaiya Hari Narayan Singh

Verified signature
20ad3f9
15:48
Training in progress, epoch 4

Bhaiya Hari Narayan Singh

Verified signature
61e4c42
15:46
Training in progress, epoch 3

Bhaiya Hari Narayan Singh

Verified signature
13bda4f
15:44
Training in progress, epoch 2

Bhaiya Hari Narayan Singh

Verified signature
500c437
15:42
Training in progress, epoch 1

Bhaiya Hari Narayan Singh

Verified signature
0f8133d
07:40
Training in progress, epoch 10

Bhaiya Hari Narayan Singh

Verified signature
a3f638f
07:38
Training in progress, epoch 9

Bhaiya Hari Narayan Singh

Verified signature
6a3f70f
07:35
Training in progress, epoch 8

Bhaiya Hari Narayan Singh

Verified signature
b8fe5f5
07:32
Training in progress, epoch 7

Bhaiya Hari Narayan Singh

Verified signature
bc4a90d
07:30
Training in progress, epoch 6

Bhaiya Hari Narayan Singh

Verified signature
af166b3
07:27
Training in progress, epoch 5

Bhaiya Hari Narayan Singh

Verified signature
b805b9e
07:24
Training in progress, epoch 4

Bhaiya Hari Narayan Singh

Verified signature
75979f9
07:22
Training in progress, epoch 3

Bhaiya Hari Narayan Singh

Verified signature
8855ac1
07:20
Training in progress, epoch 2

Bhaiya Hari Narayan Singh

Verified signature
d12d1d5
07:17
Training in progress, epoch 1

Bhaiya Hari Narayan Singh

Verified signature
f651ffd
07:05
Training in progress, epoch 8

Bhaiya Hari Narayan Singh

Verified signature
955e1c6
07:02
Training in progress, epoch 7

Bhaiya Hari Narayan Singh

Verified signature
892af0f
07:00
Training in progress, epoch 6

Bhaiya Hari Narayan Singh

Verified signature
9e5b9d1
06:56
Training in progress, epoch 4

Bhaiya Hari Narayan Singh

Verified signature
f522595
06:55
Training in progress, epoch 3

Bhaiya Hari Narayan Singh

Verified signature
ee06633
06:54
Training in progress, epoch 1

Bhaiya Hari Narayan Singh

Verified signature
83f3692
06:51
Training in progress, epoch 8

Bhaiya Hari Narayan Singh

Verified signature
6966e25
06:48
Training in progress, epoch 4

Bhaiya Hari Narayan Singh

Verified signature
7b05a85
06:47
Training in progress, epoch 3

Bhaiya Hari Narayan Singh

Verified signature
a8339b9
06:46
Training in progress, epoch 2

Bhaiya Hari Narayan Singh

Verified signature
dbf066f
06:45
Training in progress, epoch 1

Bhaiya Hari Narayan Singh

Verified signature
82e9c48

Commit History

Jan 5

Model save

Training in progress, epoch 14

Training in progress, epoch 13

Training in progress, epoch 12

Training in progress, epoch 11

Training in progress, epoch 10

Training in progress, epoch 9

Training in progress, epoch 8

Training in progress, epoch 7

Training in progress, epoch 6

Training in progress, epoch 5

Training in progress, epoch 4

Training in progress, epoch 3

Training in progress, epoch 2

Training in progress, epoch 1

Training in progress, epoch 10

Training in progress, epoch 9

Training in progress, epoch 8

Training in progress, epoch 7

Training in progress, epoch 6

Training in progress, epoch 5

Training in progress, epoch 4

Training in progress, epoch 3

Training in progress, epoch 2

Training in progress, epoch 1

Training in progress, epoch 8

Training in progress, epoch 7

Training in progress, epoch 6

Training in progress, epoch 4

Training in progress, epoch 3

Training in progress, epoch 1

Training in progress, epoch 8

Training in progress, epoch 4

Training in progress, epoch 3

Training in progress, epoch 2

Training in progress, epoch 1