Instructions to use Bedirhn77/Mithra-2B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Bedirhn77/Mithra-2B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Bedirhn77/Mithra-2B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Bedirhn77/Mithra-2B") model = AutoModelForCausalLM.from_pretrained("Bedirhn77/Mithra-2B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - PEFT
How to use Bedirhn77/Mithra-2B with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Bedirhn77/Mithra-2B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Bedirhn77/Mithra-2B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Bedirhn77/Mithra-2B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Bedirhn77/Mithra-2B
- SGLang
How to use Bedirhn77/Mithra-2B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Bedirhn77/Mithra-2B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Bedirhn77/Mithra-2B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Bedirhn77/Mithra-2B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Bedirhn77/Mithra-2B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Bedirhn77/Mithra-2B with Docker Model Runner:
docker model run hf.co/Bedirhn77/Mithra-2B
Mithra-2B
Mithra-2B, FTC ve FRC robotlarฤฑ iรงin kod yazmaya, CAD tasarฤฑmlarฤฑ iรงin betik รผretmeye ve yazฤฑlฤฑm sorunlarฤฑnฤฑ รงรถzmeye odaklanan kรผรงรผk bir kodlama ve robotik asistanฤฑdฤฑr. Diyarbakฤฑr merkezli FTC Team 24501 "ERROR" (ftcerror.com) tarafฤฑndan geliลtirilmiลtir.
Mithra-2B is a small coding and robotics assistant for FTC/FRC teams, built by FTC Team 24501 "ERROR" from Diyarbakฤฑr, Tรผrkiye.
Model Details
Model Description
Mithra-2B, Qwen2.5-Coder-1.5B-Instruct modelinin LoRA yรถntemiyle ince ayarlanฤฑp (fine-tuning) temel modelle birleลtirilmesiyle elde edilmiลtir. Model; FTC/FRC robot yazฤฑlฤฑmฤฑ, otonom gรถrev kodlarฤฑ ve 3D model/CAD betikleri alanlarฤฑnda yardฤฑmcฤฑ olmak รผzere tasarlanmฤฑลtฤฑr. Kendini "mithra" olarak tanฤฑtฤฑr ve ERROR takฤฑmฤฑ tarafฤฑndan Diyarbakฤฑr'da geliลtirildiฤini sรถyler.
- Developed by: Bedirhan, FTC Team 24501 "ERROR" (Diyarbakฤฑr, Tรผrkiye)
- Funded by: TED Diyarbakฤฑr
- Model type: Causal language model (LoRA ile ince ayarlanฤฑp birleลtirilmiล)
- Language(s) (NLP): Tรผrkรงe, ฤฐngilizce (kod: Python, Java, C++, JavaScript, HTML, CSS, OpenSCAD)
- License: MIT
- Finetuned from model: Qwen/Qwen2.5-Coder-1.5B-Instruct
Model Sources
- Repository: https://huggingface.co/KULLANICI_ADI/Mithra-2B
- Team website: https://ftcerror.com
Uses
Direct Use
- FTC ve FRC robotlarฤฑ iรงin Java ve C++ kodu yazmak (OpMode, sรผrรผล sistemi, sensรถr ve encoder kontrolรผ vb.)
- Otonom (autonomous) gรถrev kodlarฤฑ iรงin taslak hazฤฑrlamak
- 3D model ve CAD tasarฤฑmlarฤฑ iรงin Python / OpenSCAD betikleri รผretmek
- Genel yazฤฑlฤฑm hatalarฤฑnฤฑ aรงฤฑklamak ve รงรถzรผm รถnermek
Downstream Use
Takฤฑmlarฤฑn kendi robot kรผtรผphaneleri ve FTC SDK / WPILib รถrnekleriyle daha fazla ince ayar yaparak รถzelleลtirebileceฤi bir baลlangฤฑรง modeli olarak kullanฤฑlabilir.
Out-of-Scope Use
Model kรผรงรผktรผr. รretilen kod mutlaka okunmalฤฑ ve test edilmelidir. Gerรงek robot รผzerinde, รถzellikle gรผvenlik aรงฤฑsฤฑndan kritik durumlarda, doฤrulanmamฤฑล kodu doฤrudan รงalฤฑลtฤฑrmayฤฑn. Model tฤฑbbi, hukuki veya finansal tavsiye iรงin tasarlanmamฤฑลtฤฑr.
Bias, Risks, and Limitations
- "2B" bir sรผrรผm/seri adฤฑdฤฑr. Modelin gerรงek boyutu, temel model Qwen2.5-Coder-1.5B-Instruct'a baฤlฤฑ olarak yaklaลฤฑk 1.5 milyar parametredir.
- Eฤitim verisi kรผรงรผk bir รถrneklemdir (1200 รถrnek) ve FTC/FRC'ye รถzgรผ kรผtรผphaneleri (FTC SDK, WPILib vb.) derinlemesine kapsamaz. Model bu API'lerde hata yapabilir veya olmayan fonksiyonlar uydurabilir.
- Tรผrkรงe anlama ve yanฤฑt kalitesi ฤฐngilizceye gรถre daha sฤฑnฤฑrlฤฑ olabilir.
- Kimlik bilgisi (mithra, ERROR takฤฑmฤฑ, Diyarbakฤฑr) eฤitimde system prompt ile verilmiลtir. Bu prompt olmadan model bazen temel modelin kimliฤiyle yanฤฑt verebilir.
- Bรผyรผk modellere kฤฑyasla uzun ve karmaลฤฑk projelerde tutarlฤฑlฤฑฤฤฑ sฤฑnฤฑrlฤฑdฤฑr.
Recommendations
Kullanฤฑcฤฑlar modelin sฤฑnฤฑrlฤฑlฤฑklarฤฑnฤฑn farkฤฑnda olmalฤฑ, รผrettiฤi kodu gรถzden geรงirip simรผlasyonda veya gรผvenli ortamda test ettikten sonra kullanmalฤฑdฤฑr.
How to Get Started with the Model
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
REPO = "KULLANICI_ADI/Mithra-2B"
SYSTEM_PROMPT = (
"Senin adฤฑn mithra. Tรผrkiye, Diyarbakฤฑr merkezli FTC Team 24501 'ERROR' (ftcerror.com) "
"tarafฤฑndan geliลtirilmiล bir yapay zeka kodlama ve robotik asistanฤฑsฤฑn. Gรถrevin FTC ve FRC "
"robotlarฤฑ iรงin Java ve C++ kodlarฤฑ yazmak, CAD tasarฤฑmlarฤฑ iรงin Python/OpenSCAD betikleri "
"รผretmek ve yazฤฑlฤฑm sorunlarฤฑnฤฑ รงรถzmektir. Kendinden bahsederken sadece mithra olduฤunu ve "
"ERROR takฤฑmฤฑ tarafฤฑndan Diyarbakฤฑr'da oluลturulduฤunu sรถylemelisin."
)
tok = AutoTokenizer.from_pretrained(REPO)
model = AutoModelForCausalLM.from_pretrained(REPO, torch_dtype=torch.float16, device_map="auto")
prompt = (
f"<|im_start|>system\n{SYSTEM_PROMPT}<|im_end|>\n"
"<|im_start|>user\nFTC iรงin encoder ile motoru hedef konuma gรถtรผren bir OpMode yaz.<|im_end|>\n"
"<|im_start|>assistant\n"
)
inputs = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(
**inputs,
max_new_tokens=400,
do_sample=True,
temperature=0.4,
top_p=0.9,
eos_token_id=tok.convert_tokens_to_ids("<|im_end|>"),
)
print(tok.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
Training Details
Training Data
iamtarun/code_instructions_120k_alpaca verisetinin ilk 1200 satฤฑrฤฑ kullanฤฑlmฤฑลtฤฑr. Veri Python, HTML, CSS, Java, JavaScript ve C++ gibi dillerde talimat-รงฤฑktฤฑ รงiftleri iรงerir.
Training Procedure
Preprocessing
Her รถrnek ChatML formatฤฑna รงevrilmiล (<|im_start|>system ... <|im_end|>) ve baลฤฑna mithra kimlik metni (system prompt) eklenmiลtir.
Training Hyperparameters
- Method: LoRA (PEFT),
r=16,lora_alpha=32,lora_dropout=0.05, hedef modรผller:q_proj,v_proj - Trainer: TRL
SFTTrainer - Training regime: fp16 mixed precision
- Epochs: 2
- Effective batch size: 16 (batch 2 ร gradient accumulation 8)
- Learning rate: 2e-4 (cosine schedule)
- Max sequence length: 768
- Eฤitim sonrasฤฑnda LoRA aฤฤฑrlฤฑklarฤฑ temel modelle birleลtirilmiลtir (
merge_and_unload).
Speeds, Sizes, Times
รcretsiz Colab T4 GPU รผzerinde yaklaลฤฑk 20-40 dakika. Birleลtirilmiล model fp16'da yaklaลฤฑk 3 GB.
Evaluation
Resmi bir benchmark deฤerlendirmesi yapฤฑlmamฤฑลtฤฑr. Model yalnฤฑzca elle hazฤฑrlanan FTC/FRC รถrnek istemleriyle ve kimlik sorularฤฑ ("Sen kimsin?") ile sฤฑnanmฤฑลtฤฑr.
Environmental Impact
- Hardware Type: NVIDIA T4 GPU
- Hours used: < 1 saat
- Cloud Provider: Google Colab
- Compute Region: Belirtilmedi
Technical Specifications
Model Architecture and Objective
Qwen2.5 tabanlฤฑ, yalnฤฑzca-decoder (decoder-only) Transformer mimarisi. Amaรง: talimat takibi ve kod รผretimi (causal language modeling).
Compute Infrastructure
- Hardware: Google Colab, NVIDIA T4 GPU (รผcretsiz sรผrรผm)
- Software: PyTorch, transformers, peft, trl, accelerate, datasets
Citation
Bu modeli kullanฤฑrsanฤฑz lรผtfen ลu ลekilde atฤฑf yapฤฑn:
@misc{mithra2b,
title = {Mithra-2B: FTC/FRC Coding and Robotics Assistant},
author = {Bedirhan and FTC Team 24501 ERROR},
year = {2026},
url = {https://huggingface.co/KULLANICI_ADI/Mithra-2B}
}
Acknowledgements
- Temel model: Alibaba Qwen ekibi (Qwen2.5-Coder)
- Veriseti: iamtarun/code_instructions_120k_alpaca
- Destek: TED Diyarbakฤฑr
Model Card Authors
Bedirhan, FTC Team 24501 "ERROR"
Model Card Contact
- Downloads last month
- 858
Model tree for Bedirhn77/Mithra-2B
Base model
Qwen/Qwen2.5-1.5B