edwixx/s2s-ckpts
329 GB
š¤ Open to Collab
Anurag
edwixx
AI & ML interests
ASR, TTS, Speech and Audio
Recent Activity
updated a dataset 2 days ago
edwixx/s2s-blog-assets liked a dataset 2 days ago
hiraki/candor-turntaking-annotations reacted to SeaWolf-AI's post with š„ 3 days ago
š± POCKET ā a 35-billion-parameter model that runs on your iPhone, and on your PC with no GPU
We're releasing POCKET, VIDRAFT's flagship Darwin-36B-Opus compressed for on-device use. No fork, no CUDA, no cloud ā it runs on stock llama.cpp. It's a sparse Mixture-of-Experts model (256 experts, only 8 active per token), so the file can be large while the work per token stays small. That's what lets a 35B model run on a phone, and generate fast on a CPU with no graphics card.
Measured (POCKET-35B IQ1_M vs Bonsai-27B Q1_0):
ā¢ CPU generate (Xeon, 16 threads): 27.0 vs 10.1 tok/s ā 2.69Ć faster
ā¢ GPU generate (H100): 197 vs 89 tok/s ā 2.22Ć faster
ā¢ GPU prompt processing (H100): 753 vs 1816 ā 0.41Ć (Bonsai wins this one ā MoE prefill wakes every expert, so sparsity stops helping there. We say so.)
ā¢ Quality (HellaSwag, 400 q): 61.0% vs 60.0% ā a tie (confidence intervals overlap)
On a real consumer laptop ā MacBook M3 Pro (18 GB) ā POCKET wins every axis, prompt processing included:
ā¢ Metal generate: 25.4 vs 12.8 ā 1.99Ć
ā¢ CPU generate: 13.8 vs 4.4 ā 3.13Ć
ā¢ Metal prompt: 240.7 vs 73.4 ā 3.28Ć
One more quiet fact: the same-size, quality-oriented rival Ternary-Bonsai-27B (7.2 GB) fails to load in upstream llama.cpp at all ā it needs the PrismML fork. POCKET runs on the tools you already have: LM Studio, Ollama, PocketPal, MLX.
š Full story (tech, measurements, recipes): https://huggingface.co/blog/FINAL-Bench/pocket
Models:
š¦ POCKET-35B-GGUF (PC / server, no GPU): https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF
š°š· POCKET-KR-GGUF (Android): https://huggingface.co/FINAL-Bench/POCKET-KR-GGUF
š POCKET-KR-MLX (iPhone / Mac): https://huggingface.co/FINAL-Bench/POCKET-KR-MLX
š POCKET-EN-GGUF (English phone / PC): https://huggingface.co/FINAL-Bench/POCKET-EN-GGUF
š„ļø Live demo (answering on a CPU, no GPU): https://huggingface.co/spaces/FINAL-Bench/POCKET-35B-CPU
š Collection: https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6
Organizations
models 13
edwixx/qwen3-8b-triton
Text Generation ā¢ 8B ā¢ Updated ā¢ 364
edwixx/diffusiongemma-26B-A4B-it-HERETIC-Uncensored
Text Generation ā¢ 26B ā¢ Updated ā¢ 1.5k ā¢ 25
edwixx/karaoke_songs_long
Audio-to-Audio ā¢ Updated
edwixx/international-multilingual
Updated
edwixx/omnivoice-brpt-v15
Text-to-Speech ā¢ 0.6B ā¢ Updated ā¢ 31 ā¢ 1
edwixx/OmniVoice
Text-to-Speech ā¢ 0.6B ā¢ Updated ā¢ 12 ā¢ 1
edwixx/Flux2Klein9B_SNOFS
Updated
edwixx/fish-s1-dac-min
Updated ā¢ 3
edwixx/echo-tts-weights
Text-to-Speech ā¢ Updated
edwixx/whisper-large-hebrew-finetune
Updated ā¢ 3 ā¢ 1
datasets 14
edwixx/s2s-blog-assets
Viewer ā¢ Updated ā¢ 1 ā¢ 425
edwixx/aesthetic-image-captions-10k
Updated ā¢ 236 ā¢ 7
edwixx/brazilian-portuguese-TTS
Updated ā¢ 15 ā¢ 8
edwixx/NsFW-Dataset
Updated ā¢ 24 ā¢ 9
edwixx/aesthetic-images
Viewer ā¢ Updated ā¢ 7.97k ā¢ 9 ā¢ 3
edwixx/phonk-dataset
Viewer ā¢ Updated ā¢ 11 ā¢ 29
edwixx/nano-speech
Updated ā¢ 13
edwixx/hindi-female-tts
Updated ā¢ 11
edwixx/karaoke_songs_long
Viewer ā¢ Updated ā¢ 589 ā¢ 126
edwixx/international-multilingual
Updated ā¢ 7