Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
147.4
TFLOPS
Scombat
PRO
scombat
Follow
webbrain-one-164100's profile picture
webbrain-one-788531's profile picture
2 followers
·
1 following
scombat
AI & ML interests
None yet
Recent Activity
posted
an
update
3 days ago
We published an open, replayable bench for prompt-complexity classifiers: three local LLM judges (Gemma 4 31B, Qwen3.8 27B, gpt-oss-20b), 360 prompts in en/fr/ru/zh, a length baseline, bootstrap intervals, a 2 σ rule before any "better than". s1d1-router (mmBERT-base, Apache-2.0, 25–310 MB int8) agrees with the judges' median at QWK 0.807; the judges agree with each other at 0.774; prompt length gets 0.543. Caveat first: Gemma 4 labelled the training data and is one of the judges (0.785 without it). Article: https://huggingface.co/blog/scombat/measuring-a-prompt-complexity-router-against-local · bench: https://github.com/scombat/s1d1-bench · try it in the browser: https://huggingface.co/spaces/scombat/s1d1-router-demo
published
an
article
3 days ago
Measuring a prompt-complexity router against local LLM judges: an open, replayable bench
updated
a model
16 days ago
scombat/s1d1-router-6src-tiny-onnx-int8
View all activity
Organizations
None yet
scombat
's Spaces
1
Sort: Recently updated
Running
s1d1-router demo
🧭
Complexity, task and tool need of a prompt, in-browser