Instructions to use ikppramesh/irx-2-pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ikppramesh/irx-2-pro with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("ikppramesh/irx-2-pro") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use ikppramesh/irx-2-pro with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ikppramesh/irx-2-pro"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ikppramesh/irx-2-pro" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use ikppramesh/irx-2-pro with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "ikppramesh/irx-2-pro"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "ikppramesh/irx-2-pro" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ikppramesh/irx-2-pro", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use ikppramesh/irx-2-pro with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ikppramesh/irx-2-pro"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ikppramesh/irx-2-pro
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ikppramesh/irx-2-pro with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ikppramesh/irx-2-pro"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ikppramesh/irx-2-pro" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Model card: general description, IRx-2 Best Overall, use-case examples
Browse files
README.md
CHANGED
|
@@ -10,24 +10,46 @@ tags:
|
|
| 10 |
- on-device
|
| 11 |
---
|
| 12 |
|
| 13 |
-
# IRx-2
|
| 14 |
|
| 15 |
-
The
|
| 16 |
-
|
| 17 |
-
|
| 18 |
|
| 19 |
-
|
| 20 |
-
|---|---|---|
|
| 21 |
-
| **IRx-2 Gemma** | [ikppramesh/irx-2-gemma](https://huggingface.co/ikppramesh/irx-2-gemma) | [ikppramesh/irx-2-gemma-GGUF](https://huggingface.co/ikppramesh/irx-2-gemma-GGUF) |
|
| 22 |
-
| IRx-2 (4B) | [ikppramesh/irx-2](https://huggingface.co/ikppramesh/irx-2) | [ikppramesh/irx-2-GGUF](https://huggingface.co/ikppramesh/irx-2-GGUF) |
|
| 23 |
-
| IRx-1 (2B, fastest) | [ikppramesh/irx-1](https://huggingface.co/ikppramesh/irx-1) | [ikppramesh/irx-1-GGUF](https://huggingface.co/ikppramesh/irx-1-GGUF) |
|
| 24 |
|
| 25 |
-
|
| 26 |
-
it learned from nearly all long conversations in the dataset. Thinking mode is always
|
| 27 |
-
off (answers start immediately), identity is built in, and builds are only published
|
| 28 |
-
after an automated check for looping and repeated answers in multi-turn chats.
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
```bash
|
| 33 |
pip install mlx-lm
|
|
@@ -37,25 +59,41 @@ pip install mlx-lm
|
|
| 37 |
from mlx_lm import load, generate
|
| 38 |
from mlx_lm.sample_utils import make_sampler
|
| 39 |
|
| 40 |
-
model, tokenizer = load("ikppramesh/irx-2-
|
| 41 |
messages = [{"role": "user", "content": "How do I convert Celsius to Fahrenheit?"}]
|
| 42 |
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
|
| 43 |
print(generate(model, tokenizer, prompt=prompt, max_tokens=1024,
|
| 44 |
sampler=make_sampler(temp=0.7, top_p=0.95)))
|
| 45 |
```
|
| 46 |
|
| 47 |
-
No system prompt is required
|
| 48 |
-
is given.
|
|
|
|
|
|
|
| 49 |
|
| 50 |
## Limitations
|
| 51 |
|
| 52 |
-
- **Not a frontier-scale model** — won't match large hosted
|
| 53 |
-
reasoning, deep coding problems
|
| 54 |
-
- **Facts can be wrong**
|
| 55 |
-
|
| 56 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
## License
|
| 59 |
|
| 60 |
-
Apache 2.0. IRx-2
|
| 61 |
-
|
|
|
|
| 10 |
- on-device
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# IRx-2 Pro
|
| 14 |
|
| 15 |
+
The largest edition of the IRx family: a private, offline AI chat assistant for long,
|
| 16 |
+
detailed answers and extended conversations. Everything runs on your device — no
|
| 17 |
+
internet connection, no account, and nothing you type ever leaves it.
|
| 18 |
|
| 19 |
+
## The IRx family
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
+
All three run fully offline — nothing you type ever leaves your device.
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
+
| Model | Download | Best for | Phones & tablets (GGUF) | Mac (MLX) |
|
| 24 |
+
|---|---|---|---|---|
|
| 25 |
+
| **IRx-1** | ~1.2GB | The fastest. Quick everyday answers on almost any phone | [irx-1-GGUF](https://huggingface.co/ikppramesh/irx-1-GGUF) | [irx-1](https://huggingface.co/ikppramesh/irx-1) |
|
| 26 |
+
| **⭐ IRx-2 — Best Overall** | ~2.7GB | The best balance of answer quality and speed | [irx-2-GGUF](https://huggingface.co/ikppramesh/irx-2-GGUF) | [irx-2](https://huggingface.co/ikppramesh/irx-2) |
|
| 27 |
+
| **IRx-2 Pro** | ~5.3GB | The most detailed, long-form answers and long conversations | [irx-2-pro-GGUF](https://huggingface.co/ikppramesh/irx-2-pro-GGUF) | [irx-2-pro](https://huggingface.co/ikppramesh/irx-2-pro) |
|
| 28 |
+
|
| 29 |
+
**Not sure which to pick? Start with ⭐ IRx-2.** Choose IRx-1 for speed or an older /
|
| 30 |
+
smaller phone, and IRx-2 Pro for the richest answers on a device with 12GB+ RAM.
|
| 31 |
+
|
| 32 |
+
## What IRx-2 Pro does best
|
| 33 |
+
|
| 34 |
+
IRx-2 Pro is the largest edition. It was trained with the longest context window of
|
| 35 |
+
the family (so it learned from nearly all of the long conversations in the training
|
| 36 |
+
data), which makes it the best choice for long, detailed answers and for working
|
| 37 |
+
through a topic over many messages. It runs at about the same speed as IRx-2, but
|
| 38 |
+
needs more memory: use it on devices with 12GB+ RAM, or on a Mac.
|
| 39 |
+
|
| 40 |
+
| Who | Example things to ask |
|
| 41 |
+
|---|---|
|
| 42 |
+
| Software developers | "Help me design a small inventory app step by step — data model, screens and API." · "Walk me through refactoring this code over a few messages." |
|
| 43 |
+
| Farmers | "Help me write a full-season plan for my farm — sowing, watering, spraying and harvest — then let's refine it." · "Write a detailed proposal to sell my produce to a local supermarket." |
|
| 44 |
+
| Students & researchers | "Turn these notes into a structured report with headings and a summary." · "Explain this topic in depth, then quiz me on it." |
|
| 45 |
+
| Teachers | "Create a full week's unit on fractions: daily lessons, activities and a final test." |
|
| 46 |
+
| Business owners | "Draft a detailed marketing plan for my new bakery." · "Write a complete employee handbook outline." |
|
| 47 |
+
| Writers & creators | "Write a 1,500-word blog post on healthy habits." · "Help me develop a short story over several messages." |
|
| 48 |
+
| Everyday life | "Plan a 7-day family trip with a day-by-day schedule and budget." |
|
| 49 |
+
|
| 50 |
+
Measured on the same Mac CPU: IRx-2 Pro generates about 24 tokens/s, close to IRx-2's 26 — most of its extra size is lookup tables that cost little compute.
|
| 51 |
+
|
| 52 |
+
## Usage (Mac, MLX)
|
| 53 |
|
| 54 |
```bash
|
| 55 |
pip install mlx-lm
|
|
|
|
| 59 |
from mlx_lm import load, generate
|
| 60 |
from mlx_lm.sample_utils import make_sampler
|
| 61 |
|
| 62 |
+
model, tokenizer = load("ikppramesh/irx-2-pro")
|
| 63 |
messages = [{"role": "user", "content": "How do I convert Celsius to Fahrenheit?"}]
|
| 64 |
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
|
| 65 |
print(generate(model, tokenizer, prompt=prompt, max_tokens=1024,
|
| 66 |
sampler=make_sampler(temp=0.7, top_p=0.95)))
|
| 67 |
```
|
| 68 |
|
| 69 |
+
No system prompt is required: the built-in chat template supplies the IRx-2 Pro one when
|
| 70 |
+
none is given, and always keeps thinking mode off. Sample at a non-zero temperature
|
| 71 |
+
(e.g. `temp=0.7`). **On a phone or tablet**, use the
|
| 72 |
+
[GGUF build](https://huggingface.co/ikppramesh/irx-2-pro-GGUF).
|
| 73 |
|
| 74 |
## Limitations
|
| 75 |
|
| 76 |
+
- **Not a frontier-scale model** — it won't match large hosted AI services on very hard
|
| 77 |
+
multi-step reasoning, deep coding problems or breadth of world knowledge.
|
| 78 |
+
- **Facts can be wrong.** Like any small offline model it can state things confidently
|
| 79 |
+
that aren't true — double-check anything important, such as prices, medicines and
|
| 80 |
+
doses, laws, and local farming advice (seed varieties, chemical quantities, weather).
|
| 81 |
+
- **Not a replacement for professionals** — medical, legal and financial answers are
|
| 82 |
+
general information only.
|
| 83 |
+
- **Not current-events aware** — its knowledge is fixed at training time.
|
| 84 |
+
- **Don't enable native tool/function-calling in chat apps** — never trained; plain
|
| 85 |
+
chat is reliable.
|
| 86 |
+
|
| 87 |
+
## Changelog
|
| 88 |
+
|
| 89 |
+
- **2026-09-30** — First release (published earlier the same day under a different
|
| 90 |
+
repository name; old links redirect here). Trained with a 2048-token window, merged
|
| 91 |
+
into the full-precision base and quantized once with an importance matrix. Passed the
|
| 92 |
+
automated pre-publish check: repeated 8-turn conversations with the repeat penalty off
|
| 93 |
+
and the app's thinking request on — no loops, no copied answers, no hidden reasoning,
|
| 94 |
+
correct identity.
|
| 95 |
|
| 96 |
## License
|
| 97 |
|
| 98 |
+
Apache 2.0. IRx-2 Pro is a derivative fine-tuned model — full Apache 2.0 terms apply as with
|
| 99 |
+
any work under this license.
|