Instructions to use Bingguang/FunReason-MT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Bingguang/FunReason-MT with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Bingguang/FunReason-MT")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Bingguang/FunReason-MT")
model = AutoModelForCausalLM.from_pretrained("Bingguang/FunReason-MT", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Bingguang/FunReason-MT with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Bingguang/FunReason-MT"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Bingguang/FunReason-MT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Bingguang/FunReason-MT

SGLang

How to use Bingguang/FunReason-MT with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Bingguang/FunReason-MT" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Bingguang/FunReason-MT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Bingguang/FunReason-MT" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Bingguang/FunReason-MT",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Bingguang/FunReason-MT with Docker Model Runner:
```
docker model run hf.co/Bingguang/FunReason-MT
```

FunReason-MT

Commit History

Oct 30, 2025

03:15
Improve model card: Add pipeline tag, library name, and explicit links⁠

nielsr HF Staff

Verified signature
44d4106

Oct 29, 2025

16:16
Update README.md

Bingguang

Verified signature
0e78e55
13:19
Update README.md

Bingguang

Verified signature
3465bfd
02:19
Update README.md

Bingguang

Verified signature
163f267
02:14
Update README.md

Bingguang

Verified signature
d29eeec

Oct 28, 2025

14:59
Update README.md

Bingguang

Verified signature
9f3ea6d
14:59
Update README.md

Bingguang

Verified signature
b54f848

Oct 27, 2025

16:23
Update README.md

Bingguang

Verified signature
056cde6
16:10
Update README.md

Bingguang

Verified signature
c1387ef

Oct 24, 2025

07:28
Update README.md

Bingguang

Verified signature
9efc216

Oct 23, 2025

01:59
Update README.md

Bingguang

Verified signature
d85d724

Oct 22, 2025

09:25
Upload 11 files

Bingguang

Verified signature
07c7e0c
08:46
initial commit

Bingguang

Verified signature
a69dffb

Commit History

Oct 30, 2025

Improve model card: Add pipeline tag, library name, and explicit links⁠

Oct 29, 2025

Update README.md

Update README.md

Update README.md

Update README.md

Oct 28, 2025

Update README.md

Update README.md

Oct 27, 2025

Update README.md

Update README.md

Oct 24, 2025

Update README.md

Oct 23, 2025

Update README.md

Oct 22, 2025

Upload 11 files

initial commit