Hugging Face's logo

t3nchu
/
mikrotik-expert

GGUF
conversational
Model card Files
xet
 Community

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

MikroTik RouterOS Expert - Ollama Model

A fine-tuned DeepSeek-R1-Distill-Llama-8B model specialized in MikroTik RouterOS 7.x configuration, troubleshooting, and command reference.

Requirements

  • Ollama installed
  • RAM/VRAM per the tier you choose (see below)

Available Tiers

Tier File Size Min RAM Best for
Premium mikrotik-expert-q8_0.gguf 8.0 GB 12 GB Best quality, 16GB+ VRAM GPUs
Standard mikrotik-expert-q4_k_m.gguf 4.6 GB 6 GB Recommended default, any modern GPU or CPU
Lite mikrotik-expert-q3_k_m.gguf 3.8 GB 4 GB Low-end laptops, Raspberry Pi, minimal setups

Not sure which to pick? Go with Standard (Q4_K_M) — it runs on almost anything and the quality loss vs Q8_0 is minimal for RouterOS tasks.

Install

  1. Download your chosen .gguf file and its matching Modelfile.<tier> into the same folder
  2. Rename the Modelfile:
# Example for Standard tier:
cp Modelfile.q4_k_m Modelfile
  1. Import into Ollama:
ollama create mikrotik-expert -f Modelfile
  1. Start chatting:
ollama run mikrotik-expert

Model Details

Property Value
Base model DeepSeek-R1-Distill-Llama-8B
Fine-tune method LoRA (rank 64, alpha 128)
Training data ~9,200 MikroTik RouterOS instruction pairs
Data sources MikroTik wiki, forums, GitHub repos, HuggingFace datasets, synthetic Q&A
Context length 2048 tokens

What it knows

  • RouterOS 7.x CLI commands and syntax
  • Firewall rules, NAT, mangle
  • OSPF, BGP, MPLS routing
  • Wireless (WiFi, CAPsMAN)
  • VPN (WireGuard, IPsec, L2TP, SSTP)
  • QoS, queues, traffic shaping
  • Scripting and scheduling
  • Bridge, VLAN, bonding
  • DHCP, DNS, certificates
  • Troubleshooting common issues

Example 

>>> How do I set up a basic firewall on RouterOS 7?

<think>
The user wants a basic firewall setup for RouterOS 7...
</think>

/ip firewall filter
add chain=input connection-state=established,related action=accept
add chain=input connection-state=invalid action=drop
add chain=input protocol=icmp action=accept
add chain=input src-address=192.168.88.0/24 action=accept
add chain=input action=drop

License

Private - Raiden Tech FZ LLC.

Downloads last month
2
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support