Article
Fine-tuning Gemma 4 for Hindi on a Free GPU โ and shipping it to run on a CPU
pankajpandey-dev
โข โข 1
๐๏ธ Building on HF
Pankaj Pandey
pankajpandey-dev
AI & ML interests
Natural Language Processing, Text Generation, Large Language Models, Quantization, Fine-Tuning, RLHF, Model Merging.
Recent Activity
repliedto their post 22 days ago
๐ฎ๐ณ Qwen3.5-9B Hindi Instruct โ it stops thinking in English
Ask base Qwen3.5-9B a question in Hindi and it burns hundreds of tokens thinking in English inside its think block before a single Devanagari word appears โ then code-switches in the answer. I fine-tuned it to close the think block instantly and reply in pure, native Hindi.
โ
Model (16-bit): https://huggingface.co/pankajpandey-dev/qwen3.5-9b-hindi-instruct
โ
GGUF (Q4/Q5/Q8): https://huggingface.co/pankajpandey-dev/qwen3.5-9b-hindi-instruct-GGUF
โ
Try it in the browser: https://huggingface.co/spaces/pankajpandey-dev/qwen3.5-9b-hindi-demo
Recipe: Unsloth + LoRA (r=16, response-only loss) on 12.9k Hindi pairs โ AI4Bharat anudesh + dolly-hi + wikiHow-hi + Aya Hindi (human-written). The Q4_K_M is 5.4 GB and runs on a plain laptop CPU.
New in this run vs my earlier models: mixed in long-form native sources (wikiHow) after my last eval showed the fine-tune traded detail for conciseness โ this one keeps answers detailed and native.
Part of my weekly ๐ฎ๐ณ Hindi LLM Series. Feedback welcome ๐
#Hindi #IndicNLP #Qwen #GGUF #LocalLLM #Unsloth repliedto their post 22 days ago
๐ฎ๐ณ Qwen3.5-9B Hindi Instruct โ it stops thinking in English
Ask base Qwen3.5-9B a question in Hindi and it burns hundreds of tokens thinking in English inside its think block before a single Devanagari word appears โ then code-switches in the answer. I fine-tuned it to close the think block instantly and reply in pure, native Hindi.
โ
Model (16-bit): https://huggingface.co/pankajpandey-dev/qwen3.5-9b-hindi-instruct
โ
GGUF (Q4/Q5/Q8): https://huggingface.co/pankajpandey-dev/qwen3.5-9b-hindi-instruct-GGUF
โ
Try it in the browser: https://huggingface.co/spaces/pankajpandey-dev/qwen3.5-9b-hindi-demo
Recipe: Unsloth + LoRA (r=16, response-only loss) on 12.9k Hindi pairs โ AI4Bharat anudesh + dolly-hi + wikiHow-hi + Aya Hindi (human-written). The Q4_K_M is 5.4 GB and runs on a plain laptop CPU.
New in this run vs my earlier models: mixed in long-form native sources (wikiHow) after my last eval showed the fine-tune traded detail for conciseness โ this one keeps answers detailed and native.
Part of my weekly ๐ฎ๐ณ Hindi LLM Series. Feedback welcome ๐
#Hindi #IndicNLP #Qwen #GGUF #LocalLLM #Unsloth updated a model 24 days ago
pankajpandey-dev/qwen3.5-9b-hindi-instructOrganizations
published an article about 1 month ago