Article
Decoding Strategies in Large Language Models
mlabonne
ā¢ ā¢ 115
Aryan Rahman
aryan3212
Ā·
AI & ML interests
None yet
Recent Activity
upvoted an article 2 days ago
Decoding Strategies in Large Language Models updated a model 19 days ago
aryan3212/clae-bengali-encoder new activity 28 days ago
MIT-SLS/USAD2-Small:Issues when running USAD2 for some evalsOrganizations
None yet
upvoted an article 2 days ago
updated a
model 19 days ago
Issues when running USAD2 for some evals
2
#1 opened 28 days ago
by aryan3212
updated a
Space 28 days ago
reacted to pankajpandey-dev's post with šš„ about 2 months ago
Post
7844
š®š³ New in my Hindi LLM Series: Gemma-4 E4B, fine-tuned for Hindi ā and it runs on your laptop's CPU.
I fine-tuned Google's new Gemma-4 E4B on ~10k Hindi instruction pairs (AI4Bharat: anudesh + dolly) using Unsloth + LoRA, on a single L4 GPU.
Then I ran an honest side-by-side eval: base Gemma-4 vs my fine-tune, across 25 Hindi prompts. The results were interesting š
ā My fine-tune is more concise ā ask for "3 tips" and it gives exactly 3. Base writes a 1,200-character essay.
ā Pure native Hindi ā base keeps slipping into English ("ą¤øą¤ą¤¤ą„ą¤²ą¤æą¤¤ ą¤ą¤¹ą¤¾ą¤° (Eat a Balanced Diet)", "ą¤¤ą¤¾ą¤°ą¤¾ (Star)"). My fine-tune stays in clean Hindi.
ā Tighter instruction-following ā ask for a "short message" and it gives one, not a menu of options.
āļø And to be honest: base Gemma-4 is more detailed and comprehensive. I didn't build a "smarter" model ā I built a focused, Hindi-native, edge-friendly one that runs as a 5GB GGUF (Q4) on CPU.
š Try it:
Live demo (CPU): pankajpandey-dev/gemma-4-e4b-hindi-demo
GGUF (Ollama/llama.cpp): pankajpandey-dev/gemma-4-e4b-hindi-instruct-GGUF
16-bit model: pankajpandey-dev/gemma-4-e4b-hindi-instruct
Built with @unsloth Ā· Data by @ai4bharat š
#Hindi #LLM #Gemma #Unsloth #IndicNLP #GGUF
I fine-tuned Google's new Gemma-4 E4B on ~10k Hindi instruction pairs (AI4Bharat: anudesh + dolly) using Unsloth + LoRA, on a single L4 GPU.
Then I ran an honest side-by-side eval: base Gemma-4 vs my fine-tune, across 25 Hindi prompts. The results were interesting š
ā My fine-tune is more concise ā ask for "3 tips" and it gives exactly 3. Base writes a 1,200-character essay.
ā Pure native Hindi ā base keeps slipping into English ("ą¤øą¤ą¤¤ą„ą¤²ą¤æą¤¤ ą¤ą¤¹ą¤¾ą¤° (Eat a Balanced Diet)", "ą¤¤ą¤¾ą¤°ą¤¾ (Star)"). My fine-tune stays in clean Hindi.
ā Tighter instruction-following ā ask for a "short message" and it gives one, not a menu of options.
āļø And to be honest: base Gemma-4 is more detailed and comprehensive. I didn't build a "smarter" model ā I built a focused, Hindi-native, edge-friendly one that runs as a 5GB GGUF (Q4) on CPU.
š Try it:
Live demo (CPU): pankajpandey-dev/gemma-4-e4b-hindi-demo
GGUF (Ollama/llama.cpp): pankajpandey-dev/gemma-4-e4b-hindi-instruct-GGUF
16-bit model: pankajpandey-dev/gemma-4-e4b-hindi-instruct
Built with @unsloth Ā· Data by @ai4bharat š
#Hindi #LLM #Gemma #Unsloth #IndicNLP #GGUF
- 12 replies
published a
Space about 2 months ago
published a
model about 2 months ago
updated a
model 2 months ago
published a
model 2 months ago
liked a
Space 7 months ago
upvoted 2
articles 8 months ago
Article
Ettin Suite: SoTA Paired Encoders and Decoders
- +4
orionweller, kdricci, mmarone, NohTow, dlawrie, vandurme
ā¢ ā¢ 81 Article
AudioLDM 2, but faster ā”ļø
sanchit-gandhi
ā¢ ā¢ 17 liked a
model 8 months ago
upvoted 3
papers 9 months ago
Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and AST
Paper ā¢ 2509.14128 ā¢ Published ā¢ 3
Granite-speech: open-source speech-aware LLMs with strong English ASR capabilities
Paper ā¢ 2505.08699 ā¢ Published ā¢ 4
Moshi: a speech-text foundation model for real-time dialogue
Paper ā¢ 2410.00037 ā¢ Published ā¢ 18
commented a
paper 9 months ago
liked a
Space 9 months ago