lq-preview (lq-preview)

posted an update 2 days ago

Post

4,672

Qwen3.8-Flash-Next GGUFs now run faster with less thinking and less token use.

Unsloth Dynamic V3.1 GGUFs bring thinking & token use to match 95% of full precision Qwen3.8-Flash.

Results: 50% fewer tokens + 15% higher accuracy vs same size quants.

GGUF: unsloth/Qwen3.8-Flash-Next-GGUF
Analysis/Guide: https://unsloth.ai/docs/models/qwen3.8-next

2 replies

·

danielhanchen

posted an update 5 days ago

Post

7,210

We’re releasing new Qwen3.8-Flash-Next GGUFs with 15% higher accuracy.

Unsloth Dynamic V3.1 outperforms others by >15% on Terminal Bench, DeepSWE & more benchmarks (256K context).

Run on 32GB+ RAM setups.

GGUF: unsloth/Qwen3.8-Flash-Next-GGUF
Blog: https://unsloth.ai/docs/models/qwen3.8-next

sergiopaniego

posted an update 6 days ago

Post

4,614

TRL now supports MOPD (Multi-Teacher On-Policy Distillation) natively❗️

Many frontier open models use it. labs train one RL expert per domain and then distill them all into one model

Blog with what it is, who uses it and an experiment you can run on HF Jobs with one command

https://huggingface.co/blog/sergiopaniego/mopd-trl

sergiopaniego

posted an update 10 days ago

Post

1,166

if you want to deep dive into how the new @MistralAI Large 4 was built, we sat down with the team to learn straight from them!

scaling, specialization, evals, cyber, sandboxing and why open weights matter

a really detailed look at what it takes to build and release an open frontier model, super recommended

https://www.youtube.com/watch?v=FczbSauVvjw

danielhanchen

posted an update 10 days ago

Post

808

We’re releasing new DeepSeek-V4.1-Flash-1017 GGUFs, ranking highest across benchmarks. 🐋

Dynamic V3.1 leads across nearly all benchmarks: GPQA Diamond, AIME25, LiveCodeBench v6, MMLU-Pro, Aider & more.

Run on 64GB+ RAM.

GGUF: unsloth/DeepSeek-V4.1-Flash-1017-GGUF
Blog: https://unsloth.ai/docs/models/deepseek-v4.1-flash

1 reply

·

sergiopaniego

posted an update 11 days ago

Post

3,095

Mistral Large 4 (Le Chonk 🐈) is now live on the Hub and you can post-train it with TRL today!

SFT + LoRA example ready, runs on a single 8xB300 node

> model: mistralai/Mistral-Large-4-1T-A52B
> TRL example: https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
> blog: https://huggingface.co/blog/mistral-large4

danielhanchen

posted an update 12 days ago

Post

2,510

Your local LLM can now take control of a browser and complete tasks autonomously via Unsloth!

Qwen3.8-27B successfully controlled the browser to complete tasks like chess, painting, with no human intervention.

GitHub: https://github.com/unslothai/unsloth
Guide: https://unsloth.ai/docs/basics/browser-use

1 reply

·

sergiopaniego

posted an update 12 days ago

Post

3,054

how do you post-train an agent?

we laid it out as a 5-step curriculum, from SFT to RL through a real harness, with livestreams, code and docs for each step

https://huggingface.co/blog/huggingface/train-agents

2 replies

·

sergiopaniego

posted an update 13 days ago

Post

170

Last week we closed the Training Agents series IRL at the GitHub offices in SF

4 talks, a panel and audience Q&A. almost 2h on post-training agents with open models

> Learnings from enterprise RL (Govind Kamtamneni Microsoft)
> Environments and benchmarks in industry (Victor Barres Mercor)
> How to train your agents with Miles (Tao Lin RadixArk)
> Why we built OpenEnv Arena (Xiangyi Li BenchFlow)

Full recording + Slides

https://www.youtube.com/watch?v=CKFUx7COIwQ

danielhanchen

posted an update 21 days ago

Post

5,064

Run DeepSeek V4.1-Flash-1017 locally! 🐳

We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).

Run on a 128GB+ RAM device. V4.1 Flash 1017 is the strongest open model to date

Guide: https://unsloth.ai/docs/models/deepseek-v4.1-flash
GGUF: unsloth/DeepSeek-V4.1-Flash-1017-GGUF

nathanrchn

authored a paper 26 days ago

Apertus 1.5: From Open Text Models to Open Multimodal Reasoners

Paper • 2610.15542 • Published 30 days ago • 41

MaziyarPanahi

posted an update 26 days ago

Post

764

Used nvidia/NV-Reason-CT by Nvidia and Hugging Face Jobs to make this cool demo! Let me know if you think we should add more features to it: 🔥

https://www.linkedin.com/feed/update/urn:li:activity:7515789448077398016

danielhanchen

posted an update about 1 month ago

Post

5,180

You can now train your own Decision model like Jev locally!

We increased Qwen3.5 0.8B’s aggregate accuracy from 20.7% to 74.3% across 3 decision benchmarks - on just 4GB VRAM.

Turn any LLM like Qwen3.8, Gemma 4 into decision models with our open-source Unsloth repo.

GitHub: https://github.com/unslothai/unsloth
Guide: https://unsloth.ai/docs/basics/train-your-own-decision-model-with-unsloth

5 replies

·

sergiopaniego

posted an update about 1 month ago

Post

3,653

sharing the slides from my talk at Kernel Panic in Madrid

It's basically "The ultimate guide to multi-harness RL" turned slides and condensed into a 20 min talk

FineEnvs/multi-harness-rl-slides

congrats to @Helmcode for the organization!

blog: FineEnvs/multi-harness-rl

danielhanchen

posted an update about 1 month ago

Post

4,157

Google releases EmbeddingGemma 2, a new open embedding model that runs locally on 0.5GB RAM.

The 740M parameter Apache 2.0 model combines a 270M text model with vision (170M) + audio (300M).

Run & train the model via Unsloth.

GGUF: unsloth/embeddinggemma-2-GGUF
Guide: https://unsloth.ai/docs/models/embeddinggemma-2

sergiopaniego

posted an update about 1 month ago

Post

334

Repo2RLEnv just shipped TaskSmith + 50 high quality RL envs generated from HF repos 🔨

TaskSmith is a specialized harness that turns a merged PR into a verified RL env

the envs come from HF repos (Transformers, TRL, PEFT, Accelerate, Diffusers), shipped as Harbor tasks you can eval or train on

> code: github.com/huggingface/Repo2RLEnv
> dataset: huggingface.co/datasets/FineEnvs/HF_ML_Tasksmith

sergiopaniego

posted an update about 1 month ago

Post

3,849

ThinkingBox from @microsoft is now available as an OpenEnv env (cc @tuhink 🤗 )!

> ThinkingBox is a sandbox for testing agents on business workflows. it simulates a customer, gives the agent MCP tools over a real database, and at the end checks what changed in that database instead of trusting the agent's last message

> ThinkingBox-Bench is the benchmark built on it: 507 tasks across retail, insurance, travel, banking and consulting

> the OpenEnv env runs each task as an episode in its own isolated backend and returns a pass/fail reward from those checks

https://huggingface.co/blog/microsoft/thinkingbox

sergiopaniego

posted an update about 1 month ago

Post

321

FineEnvs/multi-harness-rl

1 reply

·

danielhanchen

posted an update about 2 months ago

Post

9,206

Unsloth has surpassed 500M model downloads on Hugging Face! 🦥🤗

Qwen3.8-27B GGUF is already Unsloth’s #1 most-downloaded model ever.

Thanks for all your support! Follow us:

unsloth

1 reply

·

danielhanchen

posted an update about 2 months ago

Post

3,778

Qwen-Image-2.1 can now run locally on 12GB VRAM with Unsloth GGUFs! 🖼️

The 7B model performs on par with Nano Banana 2.0.

For higher quality, you can also run Dynamic FP8 on just 6GB of VRAM via offloading.

GGUF: unsloth/Qwen-Image-2.1-GGUF
Guide: https://unsloth.ai/docs/models/qwen-image-2.1

lq-preview

AI & ML interests

Recent Activity

Apertus 1.5: From Open Text Models to Open Multimodal Reasoners

AI & ML interests

Recent Activity

Team members 50

lq-preview's activity