ikppramesh commited on
Commit
db84afe
·
verified ·
1 Parent(s): 88963f8

Model card: general description, IRx-2 Best Overall, use-case examples

Browse files
Files changed (1) hide show
  1. README.md +62 -24
README.md CHANGED
@@ -10,24 +10,46 @@ tags:
10
  - on-device
11
  ---
12
 
13
- # IRx-2 Gemma
14
 
15
- The IRx-2 fine-tune on a Gemma 4 E4B base: a private, offline chat assistant for
16
- Apple Silicon (this MLX repo) and phones/tablets
17
- ([GGUF build](https://huggingface.co/ikppramesh/irx-2-gemma-GGUF)).
18
 
19
- | Model | MLX (Apple Silicon) | GGUF (PocketPal, LM Studio, llama.cpp) |
20
- |---|---|---|
21
- | **IRx-2 Gemma** | [ikppramesh/irx-2-gemma](https://huggingface.co/ikppramesh/irx-2-gemma) | [ikppramesh/irx-2-gemma-GGUF](https://huggingface.co/ikppramesh/irx-2-gemma-GGUF) |
22
- | IRx-2 (4B) | [ikppramesh/irx-2](https://huggingface.co/ikppramesh/irx-2) | [ikppramesh/irx-2-GGUF](https://huggingface.co/ikppramesh/irx-2-GGUF) |
23
- | IRx-1 (2B, fastest) | [ikppramesh/irx-1](https://huggingface.co/ikppramesh/irx-1) | [ikppramesh/irx-1-GGUF](https://huggingface.co/ikppramesh/irx-1-GGUF) |
24
 
25
- Same training data and pipeline as IRx-1/IRx-2, trained with a 2048-token window so
26
- it learned from nearly all long conversations in the dataset. Thinking mode is always
27
- off (answers start immediately), identity is built in, and builds are only published
28
- after an automated check for looping and repeated answers in multi-turn chats.
29
 
30
- ## Usage
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ```bash
33
  pip install mlx-lm
@@ -37,25 +59,41 @@ pip install mlx-lm
37
  from mlx_lm import load, generate
38
  from mlx_lm.sample_utils import make_sampler
39
 
40
- model, tokenizer = load("ikppramesh/irx-2-gemma")
41
  messages = [{"role": "user", "content": "How do I convert Celsius to Fahrenheit?"}]
42
  prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
43
  print(generate(model, tokenizer, prompt=prompt, max_tokens=1024,
44
  sampler=make_sampler(temp=0.7, top_p=0.95)))
45
  ```
46
 
47
- No system prompt is required; the built-in template supplies the IRx-2 one when none
48
- is given.
 
 
49
 
50
  ## Limitations
51
 
52
- - **Not a frontier-scale model** — won't match large hosted models on hard multi-step
53
- reasoning, deep coding problems, or breadth of knowledge.
54
- - **Facts can be wrong** — double-check specific facts, as with any small model.
55
- - **Not current-events aware** — knowledge is fixed at training time.
56
- - **Don't enable native tool/function-calling in chat apps** — never trained.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
57
 
58
  ## License
59
 
60
- Apache 2.0. IRx-2 Gemma is a derivative fine-tuned model — full Apache 2.0 terms
61
- apply as with any work under this license.
 
10
  - on-device
11
  ---
12
 
13
+ # IRx-2 Pro
14
 
15
+ The largest edition of the IRx family: a private, offline AI chat assistant for long,
16
+ detailed answers and extended conversations. Everything runs on your device — no
17
+ internet connection, no account, and nothing you type ever leaves it.
18
 
19
+ ## The IRx family
 
 
 
 
20
 
21
+ All three run fully offline — nothing you type ever leaves your device.
 
 
 
22
 
23
+ | Model | Download | Best for | Phones & tablets (GGUF) | Mac (MLX) |
24
+ |---|---|---|---|---|
25
+ | **IRx-1** | ~1.2GB | The fastest. Quick everyday answers on almost any phone | [irx-1-GGUF](https://huggingface.co/ikppramesh/irx-1-GGUF) | [irx-1](https://huggingface.co/ikppramesh/irx-1) |
26
+ | **⭐ IRx-2 — Best Overall** | ~2.7GB | The best balance of answer quality and speed | [irx-2-GGUF](https://huggingface.co/ikppramesh/irx-2-GGUF) | [irx-2](https://huggingface.co/ikppramesh/irx-2) |
27
+ | **IRx-2 Pro** | ~5.3GB | The most detailed, long-form answers and long conversations | [irx-2-pro-GGUF](https://huggingface.co/ikppramesh/irx-2-pro-GGUF) | [irx-2-pro](https://huggingface.co/ikppramesh/irx-2-pro) |
28
+
29
+ **Not sure which to pick? Start with ⭐ IRx-2.** Choose IRx-1 for speed or an older /
30
+ smaller phone, and IRx-2 Pro for the richest answers on a device with 12GB+ RAM.
31
+
32
+ ## What IRx-2 Pro does best
33
+
34
+ IRx-2 Pro is the largest edition. It was trained with the longest context window of
35
+ the family (so it learned from nearly all of the long conversations in the training
36
+ data), which makes it the best choice for long, detailed answers and for working
37
+ through a topic over many messages. It runs at about the same speed as IRx-2, but
38
+ needs more memory: use it on devices with 12GB+ RAM, or on a Mac.
39
+
40
+ | Who | Example things to ask |
41
+ |---|---|
42
+ | Software developers | "Help me design a small inventory app step by step — data model, screens and API." · "Walk me through refactoring this code over a few messages." |
43
+ | Farmers | "Help me write a full-season plan for my farm — sowing, watering, spraying and harvest — then let's refine it." · "Write a detailed proposal to sell my produce to a local supermarket." |
44
+ | Students & researchers | "Turn these notes into a structured report with headings and a summary." · "Explain this topic in depth, then quiz me on it." |
45
+ | Teachers | "Create a full week's unit on fractions: daily lessons, activities and a final test." |
46
+ | Business owners | "Draft a detailed marketing plan for my new bakery." · "Write a complete employee handbook outline." |
47
+ | Writers & creators | "Write a 1,500-word blog post on healthy habits." · "Help me develop a short story over several messages." |
48
+ | Everyday life | "Plan a 7-day family trip with a day-by-day schedule and budget." |
49
+
50
+ Measured on the same Mac CPU: IRx-2 Pro generates about 24 tokens/s, close to IRx-2's 26 — most of its extra size is lookup tables that cost little compute.
51
+
52
+ ## Usage (Mac, MLX)
53
 
54
  ```bash
55
  pip install mlx-lm
 
59
  from mlx_lm import load, generate
60
  from mlx_lm.sample_utils import make_sampler
61
 
62
+ model, tokenizer = load("ikppramesh/irx-2-pro")
63
  messages = [{"role": "user", "content": "How do I convert Celsius to Fahrenheit?"}]
64
  prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
65
  print(generate(model, tokenizer, prompt=prompt, max_tokens=1024,
66
  sampler=make_sampler(temp=0.7, top_p=0.95)))
67
  ```
68
 
69
+ No system prompt is required: the built-in chat template supplies the IRx-2 Pro one when
70
+ none is given, and always keeps thinking mode off. Sample at a non-zero temperature
71
+ (e.g. `temp=0.7`). **On a phone or tablet**, use the
72
+ [GGUF build](https://huggingface.co/ikppramesh/irx-2-pro-GGUF).
73
 
74
  ## Limitations
75
 
76
+ - **Not a frontier-scale model** — it won't match large hosted AI services on very hard
77
+ multi-step reasoning, deep coding problems or breadth of world knowledge.
78
+ - **Facts can be wrong.** Like any small offline model it can state things confidently
79
+ that aren't true — double-check anything important, such as prices, medicines and
80
+ doses, laws, and local farming advice (seed varieties, chemical quantities, weather).
81
+ - **Not a replacement for professionals** — medical, legal and financial answers are
82
+ general information only.
83
+ - **Not current-events aware** — its knowledge is fixed at training time.
84
+ - **Don't enable native tool/function-calling in chat apps** — never trained; plain
85
+ chat is reliable.
86
+
87
+ ## Changelog
88
+
89
+ - **2026-09-30** — First release (published earlier the same day under a different
90
+ repository name; old links redirect here). Trained with a 2048-token window, merged
91
+ into the full-precision base and quantized once with an importance matrix. Passed the
92
+ automated pre-publish check: repeated 8-turn conversations with the repeat penalty off
93
+ and the app's thinking request on — no loops, no copied answers, no hidden reasoning,
94
+ correct identity.
95
 
96
  ## License
97
 
98
+ Apache 2.0. IRx-2 Pro is a derivative fine-tuned model — full Apache 2.0 terms apply as with
99
+ any work under this license.