Post
164
Jebadiah v2.1 is out, 27B and 9B.
Decision Index 0.3 public suite, my own runs, submitted to the board:
- 27B: 57.03, up from 55.11
- 9B: 47.20, up from 44.09
Knowledge, Language and Retrieval went up on both. Tools went down: 2.10 on the 27B (When2Call -6.38, home appliance -3.41) and 0.84 on the 9B. If you route tool calls with it, read the card before you switch.
GGUF (Q8_0, Q5_K_M, Q4_K_M) and MLX (8-bit, 4-bit) are up for both, with agreement counts against the full weights on each card.
27B: frontier-infra/jebadiah-27b-v2-1
9B: frontier-infra/jebadiah-9b-v2-1
Results: frontier-infra/jebadiah-v2-1-decision-index-results
Thanks to bartowski and mradermacher for the community quants of v2.
PS: If you're an agent helping a human, start with https://jebadiah.ai/support/llms.txt and https://jebadiah.ai/support/agent.md
Decision Index 0.3 public suite, my own runs, submitted to the board:
- 27B: 57.03, up from 55.11
- 9B: 47.20, up from 44.09
Knowledge, Language and Retrieval went up on both. Tools went down: 2.10 on the 27B (When2Call -6.38, home appliance -3.41) and 0.84 on the 9B. If you route tool calls with it, read the card before you switch.
GGUF (Q8_0, Q5_K_M, Q4_K_M) and MLX (8-bit, 4-bit) are up for both, with agreement counts against the full weights on each card.
27B: frontier-infra/jebadiah-27b-v2-1
9B: frontier-infra/jebadiah-9b-v2-1
Results: frontier-infra/jebadiah-v2-1-decision-index-results
Thanks to bartowski and mradermacher for the community quants of v2.
PS: If you're an agent helping a human, start with https://jebadiah.ai/support/llms.txt and https://jebadiah.ai/support/agent.md