Patrick Hill PRO
pbhappliedsystems
AI & ML interests
PBH Applied Systems publishes evaluated open-weight GGUF models for practical AI deployment, with an emphasis on quantized inference, agentic workflows, structured outputs, tool use, and production reliability.
Every model published under this organization is converted, evaluated, and documented by PBH Applied Systems using its proprietary `quant_eval` framework. The evaluation process compares full-precision and quantized variants across agent-adjacent task families including structured JSON output, tool dispatch, multi-turn state retention, mixed natural language plus JSON responses, multiple-choice extraction, fuzz-style constraint adherence, and multi-step planning.
These model cards are designed to support deployment decisions, not just model discovery. Each card documents practical behavior, quantization trade-offs, failure modes, recommended use cases, hardware requirements, and guardrails for production use.
Try the live PBH Applied Systems AI Agent Demo:
https://pbhappliedsystems.com/assistant.html
The demo lets visitors interact with evaluated quantized open-weight models across reasoning, document intelligence, and code automation workflows running on private GPU infrastructure.
Recent Activity
repliedto their post 7 days ago
quant_eval v7.22: what quantization does to agent behavior
Six paired runs, four models, Q4_K_M / Q5_K_M / Q8_0 vs the full-weight F16 lane on identical fixtures: 19,200 per-case results across 8 agent capabilities.
- Mistral-Nemo Q4_K_M: 5 of 8 families degraded (mixed_brief_json −28 pts, toolcall_only −21.5)
- Q5_K_M and Q8_0: no significant change in any family. The cliff is between Q4 and Q5.
- Ministral-3-14B vs BF16: Q4_K_M lost 1 family; Q5_K_M and Q8_0 lost none.
Paper: https://doi.org/10.5281/zenodo.22948597
Data (CC BY 4.0): https://doi.org/10.5281/zenodo.22009419
Arena: https://huggingface.co/spaces/pbhappliedsystems/quant-eval-agent-arena
Which model should we measure next? repliedto their post 9 days ago
quant_eval v7.22: what quantization does to agent behavior
Six paired runs, four models, Q4_K_M / Q5_K_M / Q8_0 vs the full-weight F16 lane on identical fixtures: 19,200 per-case results across 8 agent capabilities.
- Mistral-Nemo Q4_K_M: 5 of 8 families degraded (mixed_brief_json −28 pts, toolcall_only −21.5)
- Q5_K_M and Q8_0: no significant change in any family. The cliff is between Q4 and Q5.
- Ministral-3-14B vs BF16: Q4_K_M lost 1 family; Q5_K_M and Q8_0 lost none.
Paper: https://doi.org/10.5281/zenodo.22948597
Data (CC BY 4.0): https://doi.org/10.5281/zenodo.22009419
Arena: https://huggingface.co/spaces/pbhappliedsystems/quant-eval-agent-arena
Which model should we measure next? repliedto their post 14 days ago
quant_eval v7.22: what quantization does to agent behavior
Six paired runs, four models, Q4_K_M / Q5_K_M / Q8_0 vs the full-weight F16 lane on identical fixtures: 19,200 per-case results across 8 agent capabilities.
- Mistral-Nemo Q4_K_M: 5 of 8 families degraded (mixed_brief_json −28 pts, toolcall_only −21.5)
- Q5_K_M and Q8_0: no significant change in any family. The cliff is between Q4 and Q5.
- Ministral-3-14B vs BF16: Q4_K_M lost 1 family; Q5_K_M and Q8_0 lost none.
Paper: https://doi.org/10.5281/zenodo.22948597
Data (CC BY 4.0): https://doi.org/10.5281/zenodo.22009419
Arena: https://huggingface.co/spaces/pbhappliedsystems/quant-eval-agent-arena
Which model should we measure next?Organizations
None yet