| Component | Technology | | ------------ | ------------------------- | | Base Model | Qwen2.5-3B-Instruct | | Fine-Tuning | LoRA | | Framework | Hugging Face Transformers | | PEFT | PEFT | | Training | PyTorch | | Dataset | JSONL | | Conversion | llama.cpp | | Quantization | Q4_K_M | | Runtime | Ollama | | Container | Docker | | Automation | n8n | | API | FastAPI | | RAG | Vector Database | | Embeddings | nomic-embed-text | | OS | CentOS 7 | | CPU | AMD EPYC 7543 | | GPU | None |