Hugging Face's logo
Kevin Paul's picture

Kevin Paul

thepaul
2
webbrain-one-48291's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to onekq's post with 👍 13 days ago
My takes on Jev 1. Very likely a small model. You can certainly pretrain, but I would grab an existing base model, say Qwen 3 class 2. The new RL method is a breakthrough, classification doesn't need to align with human preferences 3. The new output is an overstatement. It's just a new LM head. Of course autoregressive decoding can be used for classification: it takes just a few tokens to express the output. Think twice: are you sure classification doesn't need few-shot, CoT, or reasoning? All of these depend on auto-regressiveness 4. It carves out a market already existing, which is now served by oversized LLMs (hence overpaid), e.g. LLM as judge, labeling 5. Jevons effect will kick in, promoting more modeling efforts for small budget teams. It might even accelerate RSI
repliedto onekq's post 13 days ago
My takes on Jev 1. Very likely a small model. You can certainly pretrain, but I would grab an existing base model, say Qwen 3 class 2. The new RL method is a breakthrough, classification doesn't need to align with human preferences 3. The new output is an overstatement. It's just a new LM head. Of course autoregressive decoding can be used for classification: it takes just a few tokens to express the output. Think twice: are you sure classification doesn't need few-shot, CoT, or reasoning? All of these depend on auto-regressiveness 4. It carves out a market already existing, which is now served by oversized LLMs (hence overpaid), e.g. LLM as judge, labeling 5. Jevons effect will kick in, promoting more modeling efforts for small budget teams. It might even accelerate RSI
liked a model 14 days ago
convaiinnovations/laya
View all activity

Organizations

None yet