Instructions to use santosh1101/janmitra-gemma-2b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use santosh1101/janmitra-gemma-2b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf santosh1101/janmitra-gemma-2b # Run inference directly in the terminal: llama cli -hf santosh1101/janmitra-gemma-2b
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf santosh1101/janmitra-gemma-2b # Run inference directly in the terminal: llama cli -hf santosh1101/janmitra-gemma-2b
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf santosh1101/janmitra-gemma-2b # Run inference directly in the terminal: ./build/bin/llama cli -hf santosh1101/janmitra-gemma-2b
Use Docker
docker model run hf.co/santosh1101/janmitra-gemma-2b
- Llama new
- LM Studio
- Jan
- Ollama
How to use santosh1101/janmitra-gemma-2b with Ollama:
ollama run hf.co/santosh1101/janmitra-gemma-2b
- Unsloth Desktop
- Docker Model Runner
How to use santosh1101/janmitra-gemma-2b with Docker Model Runner:
docker model run hf.co/santosh1101/janmitra-gemma-2b
- Lemonade
How to use santosh1101/janmitra-gemma-2b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull santosh1101/janmitra-gemma-2b
Run and chat with the model
lemonade run user.janmitra-gemma-2b-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
JanMitra - Government Schemes Assistant
A fine-tuned Gemma 2B model specialized in Indian government schemes for citizens of Andhra Pradesh, Telangana, and India.
Model Description
JanMitra is fine-tuned on 5000 examples covering government schemes for various citizen personas including farmers, students, pregnant women, senior citizens, weavers, fishermen, and more.
Training Details
| Parameter | Value |
|---|---|
| Base Model | google/gemma-2b-it |
| Training Examples | 5000 |
| Training Steps | 60 |
| LoRA Rank | 16 |
| Learning Rate | 2e-4 |
| Hardware | NVIDIA A40 |
Covered Schemes
- Farmers: YSR Rythu Bharosa, PM-KISAN, crop loan subsidy
- Students: Post Matric Scholarship, NMMS, National Scholarship Portal
- Women: PMMVY, Janani Suraksha Yojana, Stand-Up India
- Business: Mudra Loan, Startup India, Stand-Up India
- Senior Citizens: Old Age Pension, Atal Pension Yojana
- Weavers: Chenetha Mithra Scheme
- Fishermen: Matsyakara Bharosa
Example Output
Input: I am a farmer in Telangana, what schemes are available? Output: Namaste! As a farmer in Telangana, you can benefit from YSR Rythu Bharosa, PM-KISAN.
Developed By
Built for JanMitra - a government schemes assistant helping Indian citizens discover benefits they are entitled to.
- Downloads last month
- 19