Instructions to use ckacor/my-lora-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ckacor/my-lora-model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ckacor/my-lora-model")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ckacor/my-lora-model", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ckacor/my-lora-model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ckacor/my-lora-model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ckacor/my-lora-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ckacor/my-lora-model
- SGLang
How to use ckacor/my-lora-model with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ckacor/my-lora-model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ckacor/my-lora-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ckacor/my-lora-model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ckacor/my-lora-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ckacor/my-lora-model with Docker Model Runner:
docker model run hf.co/ckacor/my-lora-model
- license: apache-2.0
base_model: Qwen/Qwen2.5-1.5B-Instruct
tags:
- lora
- qwen2.5
- fine-tuned
- function-calling
- tool-use
- system-administration
- gguf
- ollama
pipeline_tag: text-generation
language:
- ru
- en
library_name: transformers
- Technical architecture & capabilities
- Instant deployment with Ollama
- Files and versions
- Recommended runtime settings
- Training details
- Roadmap
- Limitations
- Safety notes
- About ckacor
- License
- Citation
license: apache-2.0 base_model: Qwen/Qwen2.5-1.5B-Instruct tags: - lora - qwen2.5 - fine-tuned - function-calling - tool-use - system-administration - gguf - ollama pipeline_tag: text-generation language: - ru - en library_name: transformers
Zero-latency SysAdmin assistant. Optimized for instant Linux tool chaining via JSON function calling. No hallucinations, just operations.
$ ollama run ckacor/hawk-1.5b \
> "Get GPU temp and check system uptime"
Technical architecture & capabilities
Hawk-1.5B by ckacor is a specialized agent model built on Qwen2.5-1.5B-Instruct and fine-tuned using the QLoRA methodology.
Its purpose is to parse natural-language requests (EN/RU) and convert them into structured, executable JSON function calls for system administration tasks. It does not produce conversational text — it produces operational data.
Out-of-the-box toolchain
| Tool function | Description | Typical use case |
|---|---|---|
get_gpu_status |
Returns GPU metrics: VRAM, load, temperature | Inference node monitoring |
execute_terminal_command |
Runs an arbitrary Bash command | DevOps automation, daemon management |
read_file |
Reads the contents of a specified file path | Config inspection, log parsing |
Example prompts it handles
| Prompt | Model output |
|---|---|
| 🇬🇧 "Check GPU utilization" | {"tool": "get_gpu_status", "arguments": {}} |
| 🇬🇧 "Uptime?" | {"tool": "execute_terminal_command", "arguments": {"command": "uptime"}} |
| 🇷🇺 "Проверь дисковое пространство" | {"tool": "execute_terminal_command", "arguments": {"command": "df -h"}} |
| 🇷🇺 "Покажи конфиг config.json" | {"tool": "read_file", "arguments": {"filepath": "config.json"}} |
No formal latency/accuracy benchmarks have been measured yet — numbers will be added here once evaluated, rather than estimated.
Instant deployment with Ollama
- Download the GGUF from the Files and versions tab.
- Create a Modelfile:
FROM ./hawk-1.5b-q8_0.gguf
PARAMETER temperature 0.1
PARAMETER top_p 0.95
PARAMETER repeat_penalty 1.1
SYSTEM """
You are HAWK-1.5B,
a Linux automation AI agent developed by ckacor.
Your task is to transform user requests
into accurate function calls.
"""
- Build and run:
ollama create hawk-1.5b -f Modelfile
ollama run hawk-1.5b
> Check GPU temperature
{
"tool": "get_gpu_status",
"arguments": {}
}
Via Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("ckacor/my-lora-model")
tokenizer = AutoTokenizer.from_pretrained("ckacor/my-lora-model")
Files and versions
Only
q8_0is available right now. Additional quantizations will be added once generated.
| File | Description |
|---|---|
hawk-1.5b-q8_0.gguf |
Maximum precision (available) |
hawk-1.5b-q5_k_m.gguf |
Higher quality, smaller size — coming soon |
hawk-1.5b-q4_k_m.gguf |
Recommended for most users — coming soon |
Recommended runtime settings
| Parameter | Value |
|---|---|
| Temperature | 0.1 – 0.3 |
| Top P | 0.9 – 0.95 |
| Context | depends on hardware |
| Quantization | Q4_K_M recommended once available |
| Mode | deterministic generation |
Training details
| Base model | Qwen2.5-1.5B-Instruct |
| Method | QLoRA |
| Data | Custom dataset of tool-calling examples for system administration tasks |
| Languages | Russian, English |
Roadmap
| Model | Focus | Status |
|---|---|---|
| Hawk-1.5B | General tool-use / sysadmin | ✅ released (this repo) |
| Hawk-1.5B-Instruct | Broader instruction following | 🔜 planned |
| Hawk-1.5B-Reasoning | Multi-step reasoning | 🔜 planned |
| Hawk-1.5B-Code | Code generation | 🔜 planned |
| Hawk-1.5B-Vision | Image understanding | 🔜 planned |
Limitations
- Not designed for long creative writing
- Not a replacement for large general-purpose LLMs
- Tool execution requires an external agent layer — this model only outputs the JSON, it does not execute commands itself
- Performance depends on fine-tuning data quality
- May occasionally switch languages mid-response
- No formal benchmark numbers have been published yet
Safety notes
HAWK-1.5B only generates commands and actions — it does not execute them. The execution layer should always:
- validate commands before running them
- restrict permissions to the minimum necessary
- use sandboxing where possible
- require confirmation for destructive operations
About ckacor
ckacor develops lightweight AI systems focused on:
- local artificial intelligence
- machine learning experiments
- Linux automation
- efficient models for limited hardware
ckacor AI
|
▼
HAWK Family
|
├── Hawk-1.5B
|
└── Future Models
License
This model follows the license specified in the model repository (Apache 2.0). Please check the license before commercial deployment.
Citation
@misc{ckacor2026hawk,
title = {Hawk-1.5B: a LoRA fine-tune of Qwen2.5-1.5B for sysadmin tool-use},
author = {ckacor},
year = {2026},
url = {https://huggingface.co/ckacor/my-lora-model}
}