GreenBitAI for Apple Silicon
Collection
Expert-paged for Apple Silicon: a machine runs a model larger than it can hold. One signed binary, OpenAI + Codex + Claude Code on one port. • 6 items • Updated • 1
Haojin Yang
yanghaojin
AI & ML interests
None yet
Recent Activity
repliedto their post 1 day ago
Dear all,
we are happy to share that gbx v0.8.0, our local inference engine for Apple Silicon, runs the 105 GB Qwen3.8-Flash-Next on a 48 GB MacBook Pro by streaming MoE experts from the SSD. When the model fits in memory, it decodes up to 50% faster than omlx, Ollama and mlx-lm on the same Mac, with output identical token for token.
Full write-up: https://medium.com/@semamediadata/running-a-105-gb-qwen-on-a-48-gb-macbook-pro-f116fe493a49
Download gbx: https://github.com/GreenBitAI/gbx-lm/releases
Models: https://huggingface.co/collections/GreenBitAI/greenbitai-for-apple-silicon
upvoted a collection 1 day ago
GreenBitAI for Apple Silicon updated a model 2 days ago
GreenBitAI/Qwen3.8-Flash-Next-4bit-pagedOrganizations
upvoted a collection 1 day ago
upvoted an article about 1 year ago
Article
4× Smaller, 2× Faster, 100% Smarts - GreenBitAI's 4-bit Models Redefine AI Efficiency
yanghaojin
• • 3 upvoted an article over 2 years ago
Article
GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing
NicoNico
• • 11