120-125B MoE Vision for 48-96 GB GPUs Collection Large MoE in EXL3 for 48-96 GB: Qwen3.8 Flash-Next (125B-A6B, MTP) and NVIDIA Nemotron-3.5-Super-VL (120B-A12B, vision, 1M ctx). vLLM Blackwell. • 4 items • Updated about 7 hours ago
JRamirez-UAB/Nemotron-3.5-Super-VL-120B-A12B-EXL3-2.25bpw-VL-48-96GB Image-Text-to-Text • 19B • Updated about 5 hours ago
JRamirez-UAB/Nemotron-3.5-Super-VL-120B-A12B-EXL3-2.25bpw-VL-48-96GB Image-Text-to-Text • 19B • Updated about 5 hours ago
JRamirez-UAB/Swift-1.5-Qwen3.8-27B-EXL3-3.85bpw-24GB Image-Text-to-Text • 8B • Updated 2 days ago • 384 • 2
JRamirez-UAB/Swift-1.5-Qwen3.8-Flash-Next-EXL3-3.75bpw-96GB Image-Text-to-Text • 32B • Updated 3 days ago • 107
JRamirez-UAB/Qwen3.8-Flash-Next-EXL3-2.25bpw-48GB Image-Text-to-Text • 20B • Updated 3 days ago • 137
JRamirez-UAB/Swift-1.5-Qwen3.8-Flash-Next-EXL3-2.25bpw-48GB Image-Text-to-Text • 20B • Updated 3 days ago • 151
JRamirez-UAB/Ornith-1.5-35B-A3B-EXL3-4.00bpw-24GB Image-Text-to-Text • 10B • Updated 3 days ago • 224
JRamirez-UAB/Qwopus3.6-35B-A3B-Coder-EXL3-4.00bpw-24GB Image-Text-to-Text • 10B • Updated 3 days ago • 213
JRamirez-UAB/Qwopus3.8-27B-Flash-V2-EXL3-3.85bpw-24GB Image-Text-to-Text • 8B • Updated 3 days ago • 213
Helpers: decision and triage Collection Models that help the agent but do not chat: risk of a command before running it, log triage. • 1 item • Updated 5 days ago
Speculative-decoding drafts Collection Draft models that speed up our models with speculative decoding. The output is the same as the target model's. • 1 item • Updated 4 days ago
27B Dense MTP Vision for 24 GB GPUs Collection Qwen3.8-27B family quantized for one 24 GB GPU, with vision and MTP. Tested as a Spanish-language Linux sysadmin agent (opencode + vLLM). • 11 items • Updated 5 days ago