Instructions to use Arx12/AREX-Base-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Arx12/AREX-Base-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arx12/AREX-Base-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf Arx12/AREX-Base-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arx12/AREX-Base-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf Arx12/AREX-Base-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Arx12/AREX-Base-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Arx12/AREX-Base-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Arx12/AREX-Base-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Arx12/AREX-Base-GGUF:Q4_K_M
Use Docker
docker model run hf.co/Arx12/AREX-Base-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Arx12/AREX-Base-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Arx12/AREX-Base-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Arx12/AREX-Base-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Arx12/AREX-Base-GGUF:Q4_K_M
- Ollama
How to use Arx12/AREX-Base-GGUF with Ollama:
ollama run hf.co/Arx12/AREX-Base-GGUF:Q4_K_M
- Unsloth Studio
How to use Arx12/AREX-Base-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Arx12/AREX-Base-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Arx12/AREX-Base-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Arx12/AREX-Base-GGUF to start chatting
- Pi
How to use Arx12/AREX-Base-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arx12/AREX-Base-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Arx12/AREX-Base-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use Arx12/AREX-Base-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arx12/AREX-Base-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Arx12/AREX-Base-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use Arx12/AREX-Base-GGUF with Docker Model Runner:
docker model run hf.co/Arx12/AREX-Base-GGUF:Q4_K_M
- Lemonade
How to use Arx12/AREX-Base-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Arx12/AREX-Base-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.AREX-Base-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Arx12/AREX-Base-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arx12/AREX-Base-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Arx12/AREX-Base-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
AREX-Base-GGUF
Introduction
AREX is a family of deep research agents developed by the Beijing Academy of Artificial Intelligence (BAAI). It is designed for long-horizon tasks in which an agent must search across sources, assemble candidate answers, verify multiple constraints, and revise its research plan when the available evidence is incomplete.
AREX follows a recursive self-improvement framework consisting of an inner research loop and an outer self-improvement loop. The inner loop conducts deep research, while the outer loop evaluates and improves the research process.
This repository contains AREX-Base, the larger model in the AREX family. It is built on Qwen3.5-122B-A10B and uses a Mixture-of-Experts architecture with 122B total parameters and 10B activated parameters.
- Architecture: Mixture-of-Experts
- Parameters: 122B
- Context length: 262,144 tokens
Key Features
- Recursive self-improvement: evaluates provisional answers and chooses whether to accept, refine, or restart the research trajectory.
- Verification-guided research: converts unresolved answer constraints into focused follow-up searches.
- Autonomous context updates: retains verified findings, source identifiers, rejected candidates, open constraints, and the next research plan.
- Long-horizon tool use: supports multi-round search, browsing, evidence integration, and answer construction.
- Evidence-grounded answers: maintains supporting evidence and answer-level confidence throughout the research process.
Model Family
| Model | Backbone | Context | Positioning |
|---|---|---|---|
| AREX-Base | Qwen3.5-122B-A10B | 256K | Higher-capacity model with the strongest overall AREX results. |
| AREX-Turbo | Qwen3.5-4B | 256K | Compact model for lower-cost research and tool-use settings. |
Method
AREX organizes deep research as two interacting loops supported by autonomous context management.
- Inner research loop. The agent searches, reads, integrates evidence, tracks candidates, and produces a provisional answer with supporting evidence and an answer-level confidence score.
- Outer self-improvement loop. The agent checks the provisional answer against the original constraints. High-confidence answers are accepted. Recoverable trajectories are refined around unresolved claims, while uninformative trajectories can be restarted.
- Autonomous context update. The model invokes
update_contextto refresh its research state around verified findings, current and rejected candidates, unresolved constraints, source validity, and the next research plan.
This design preserves useful work across iterations and reduces repeated exploration of paths that have already been rejected.
Evaluation
AREX is evaluated through a unified long-horizon search-agent interface with search, visit, update_context, and finish tools. HLE with tools additionally provides a Python tool.
| Model | Total Params |
BrowseComp | GAIA | xbench- 2510 |
DeepSearch QA |
WideSearch- en |
HLE w/ tools |
|---|---|---|---|---|---|---|---|
| Frontier models | |||||||
| GPT-5.4 | - | 82.7 | - | - | 88.5 | 77.5 | 52.1* |
| Opus-4.6 | - | 83.7 | - | - | 91.3 | 77.5 | 53.0* |
| Gemini-3.1-Pro | - | 85.9 | 80.6 | 53.0 | 93.3 | 66.4 | 51.4* |
| Open-source models | |||||||
| GLM-5 | 744B | 75.9 | 70.0 | - | - | 69.8 | 50.4 |
| Kimi-K2.6 | 1T | 83.2 | 80.6 | 90.0 | 92.5 | 80.8 | 54.0* |
| DeepSeek-V4-Flash | 284B | 73.2 | - | 69.0 | 90.6 | 76.4 | 45.1 |
| DeepSeek-V4-Pro | 1.6T | 83.4 | - | 80.0 | 88.7 | 78.0 | 48.2 |
| Tongyi-DeepResearch | 30B | 43.4 | 70.9 | 55.0 | - | - | 32.9 |
| Qwen3.5-35B | 35B | 61.0 | 80.0 | 50.3 | 68.5 | 57.1 | 47.4 |
| Qwen3.5-122B | 122B | 63.8 | 81.6 | - | - | 60.5 | 47.5 |
| Qwen3.5-397B | 397B | 78.6 | 83.5 | 61.0 | 82.1 | 74.0 | 48.3 |
| MiroThinker-1.7-mini | 30B | 67.9 | 80.3 | 57.2 | 67.9 | - | 36.4 |
| MiroThinker-1.7 | 235B | 74.0 | 82.7 | 62.0 | 72.1 | - | 42.9 |
| MiroThinker-H1 | - | 88.2 | 88.5 | 72.0 | 80.6 | - | 47.7 |
| Quest-35B | 35B | 64.6 | 80.8 | - | - | 60.6 | 37.2 |
| AREX models | |||||||
| AREX-Turbo | 4B | 70.7 | 81.6 | 57.0 | 78.5 | 68.5 | 40.6 |
| AREX-Base | 122B | 82.5 | 85.4 | 71.0 | 89.9 | 82.0 | 52.4 |
Inference
See inference/README.md for OpenAI-compatible serving and generation examples. The folder also contains the complete, directly formattable system and user prompts used for BrowseComp.
Intended Use
AREX-Base is intended for research-agent applications that require long-horizon information seeking, evidence aggregation, multi-constraint verification, and tool-augmented reasoning. Its larger capacity is suited to settings where research quality is prioritized over serving cost.
License
AREX-Base is released under the Apache License 2.0.
- Downloads last month
- 570
4-bit
8-bit
16-bit
Model tree for Arx12/AREX-Base-GGUF
Base model
Qwen/Qwen3.5-122B-A10B