How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tryretool/bron-model"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tryretool/bron-model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker
docker model run hf.co/tryretool/bron-model
Quick Links

Bron: Building Retool Optimized Networks

image/png

  • Developed by: tryretool
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-Coder-7B-Instruct

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
9
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for tryretool/bron-model

Base model

Qwen/Qwen2.5-7B
Finetuned
(67)
this model