Text Generation
Transformers
Safetensors
English
qwen3
deepbrainz
reasoning
mathematics
code
enterprise
4b
long-context
conversational
text-generation-inference
Instructions to use DeepBrainz/DeepBrainz-R1-4B-16K with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DeepBrainz/DeepBrainz-R1-4B-16K with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="DeepBrainz/DeepBrainz-R1-4B-16K") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("DeepBrainz/DeepBrainz-R1-4B-16K") model = AutoModelForCausalLM.from_pretrained("DeepBrainz/DeepBrainz-R1-4B-16K", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use DeepBrainz/DeepBrainz-R1-4B-16K with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DeepBrainz/DeepBrainz-R1-4B-16K" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepBrainz/DeepBrainz-R1-4B-16K", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/DeepBrainz/DeepBrainz-R1-4B-16K
- SGLang
How to use DeepBrainz/DeepBrainz-R1-4B-16K with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "DeepBrainz/DeepBrainz-R1-4B-16K" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepBrainz/DeepBrainz-R1-4B-16K", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "DeepBrainz/DeepBrainz-R1-4B-16K" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DeepBrainz/DeepBrainz-R1-4B-16K", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use DeepBrainz/DeepBrainz-R1-4B-16K with Docker Model Runner:
docker model run hf.co/DeepBrainz/DeepBrainz-R1-4B-16K
File size: 2,719 Bytes
ea02051 f1435f7 c89abb5 ea02051 f1435f7 df506da ea02051 c89abb5 ea02051 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 16a5331 c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 16a5331 c89abb5 16a5331 c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da c89abb5 df506da f1435f7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 | ---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- deepbrainz
- reasoning
- mathematics
- code
- enterprise
- 4b
- long-context
library_name: transformers
---
# DeepBrainz-R1-4B-16K
**DeepBrainz-R1-4B-16K** is a compact, high-performance reasoning model engineered by **DeepBrainz AI & Labs**. Designed for scalability and efficiency, it specializes in structured chain-of-thought reasoning, mathematical problem solving, and logical analysis.
This model is part of the **DeepBrainz-R1 Series**, built to deliver frontier-class reasoning capabilities in cost-effective parameter sizes.
---
## ๐ Model Highlights
- **Parameter Count:** ~4B
- **Context Window:** 16,384 tokens
- **Specialization:** STEM Reasoning, Logic, Code Analysis
- **Architecture:** Optimized Dense Transformer (Qwen2.5/3 Compatible)
- **Deployment:** Ready for vLLM, TGI, and local inference
---
## ๐ฏ Intended Use Cases
- **Agentic Workflows:** Reliability in multi-step planning tasks.
- **Math & Science:** Solving complex word problems and equations.
- **Code Generation:** Writing and debugging algorithms.
- **Structured Data Extraction:** Parsing and reasoning over unstructured text.
> **Note:** This is a post-trained reasoning variant intended for evaluation and experimentation.
> It is not production-validated and is not optimized for open-ended conversational chat.
---
## ๐ป Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "DeepBrainz/DeepBrainz-R1-4B-16K"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype="bfloat16",
device_map="auto"
)
prompt = "Analyze the time complexity of the following algorithm:"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```
---
## ๐๏ธ Technical Summary
This model has undergone **post-training** to improve structured reasoning behavior, mathematical problem solving, and robustness in agentic workflows.
*Detailed post-training recipes and dataset compositions are not fully disclosed.*
---
## ๐ก๏ธ Limitations & Safety
While this model demonstrates strong reasoning capabilities, it may still produce inaccurate information ("hallucinations"). Users should implement appropriate guardrails for production deployments.
---
## ๐ License
This model is released under the **Apache 2.0** license, allowing for academic and commercial use.
---
<div align="center">
<b>DeepBrainz AI & Labs</b><br>
<i>Advancing General Intelligence through Scalable Reasoning</i>
</div> |