Mtrini-SVL-1.1 / README.md
CompiwerAI's picture
Update README.md
b36412c verified
|
Raw History Blame Contribute Delete
2.13 kB
---
language:
- en
- ar
- fr
- ary
license: apache-2.0
library_name: transformers
base_model: Qwen/Qwen3-VL-8B-Instruct
tags:
- mtrini
- compiwer-ai
- qwen3-vl
- lora
- peft
- reasoning
- coding
- mathematics
- darija
- moroccan-arabic
---
# ๐Ÿช Mtrini-SVL-1.1
> **Small lab. Big ambitions.**
Mtrini-SVL-1.1 is an 8B model adaptation developed by **Compiwer AI**, built on **Qwen3-VL-8B-Instruct** and trained with a focus on reasoning, coding, mathematics, and Moroccan Darija.
## ๐Ÿง  SVL โ€” Self-Verifying Loop
**SVL = Self-Verifying Loop**
The idea:
**Think โ†’ Verify โ†’ Improve โ†’ Repeat**
SVL is Compiwer AI's approach to encouraging models to check and refine their responses instead of immediately stopping at the first answer.
## ๐Ÿ“š Training Data
The final dataset contained approximately **58.6K unique examples**:
- ๐Ÿ‡ฒ๐Ÿ‡ฆ Moroccan Darija QA + Reasoning โ€” 2,170
- ๐Ÿ’ป OpenCodeReasoning-2 โ€” 30,000
- ๐Ÿงฎ OpenMathInstruct-2 โ€” 30,000
## โš™๏ธ Model Details
| Property | Value |
|---|---|
| Model | Mtrini-SVL-1.1 |
| Base | Qwen3-VL-8B-Instruct |
| Parameters | ~8B |
| Architecture | Qwen3-VL |
| Training | LoRA / PEFT |
| Precision | BF16 |
| Training Context | 4096 |
| Developer | Compiwer AI |
| Origin | ๐Ÿ‡ฒ๐Ÿ‡ฆ Salรฉ, Morocco |
## ๐Ÿงช Training
- 3,661 training steps
- 1 epoch
- Training loss: **0.5855**
- Mean token accuracy: **83.55%**
These are training metrics and are not standardized benchmark results.
## ๐Ÿ“ฆ Repository
This repository contains the **LoRA adapter** for Mtrini-SVL-1.1.
For the merged model:
**CompiwerAI/Mtrini-SVL-1.1-Merged**
For local GGUF inference:
**CompiwerAI/Mtrini-SVL-1.1-GGUF**
## โš ๏ธ Limitations
Mtrini-SVL-1.1 is an experimental model and can still hallucinate, make coding mistakes, misunderstand Darija, or produce incorrect mathematical answers.
Always verify important outputs.
## ๐Ÿ‡ฒ๐Ÿ‡ฆ Built by Compiwer AI
Mtrini is part of Compiwer AI's effort to build open AI systems focused on:
**Reasoning โ€ข Coding โ€ข Mathematics โ€ข Moroccan Darija โ€ข Open AI**
> **Building AI For Everyone.**