CompiwerAI's picture
Create README.md
b4fe4dd verified
|
Raw History Blame Contribute Delete
2.43 kB
---
language:
- en
- ar
- fr
- ary
license: apache-2.0
library_name: transformers
base_model: Qwen/Qwen3-VL-8B-Instruct
pipeline_tag: text-generation
tags:
- mtrini
- compiwer-ai
- qwen3-vl
- reasoning
- coding
- mathematics
- darija
- moroccan-arabic
- self-verifying-loop
---
# ๐Ÿช Mtrini-SVL-1.1
## The model is out of the lab.
Mtrini-SVL-1.1 is an open-weight ~8B model developed by **Compiwer AI**, based on **Qwen3-VL-8B-Instruct**.
It was trained with a focus on:
- ๐Ÿง  Reasoning
- ๐Ÿ’ป Coding
- ๐Ÿงฎ Mathematics
- ๐Ÿ‡ฒ๐Ÿ‡ฆ Moroccan Darija
- ๐ŸŒ Multilingual tasks
And yes...
**It's a Mtrini. ๐Ÿช**
## ๐Ÿ”„ Self-Verifying Loop
**SVL = Self-Verifying Loop**
Our development concept:
```text
THINK
โ†“
CHECK
โ†“
IMPROVE
โ†“
REPEAT ๐Ÿ”„
The goal is to encourage the model to verify and refine its responses.
SVL is an ongoing research direction at Compiwer AI.
๐Ÿ“š Training
The final dataset contained 58,574 unique examples.
Dataset Examples
๐Ÿ‡ฒ๐Ÿ‡ฆ Moroccan Darija QA + Reasoning 2,170
๐Ÿ’ป OpenCodeReasoning-2 30,000
๐Ÿงฎ OpenMathInstruct-2 30,000
โšก Model Specs
Property Value
Model Mtrini-SVL-1.1
Base Qwen3-VL-8B-Instruct
Parameters ~8B
Architecture Qwen3-VL
Training LoRA / PEFT
Precision BF16
Training Context 4096 tokens
Dataset 58,574 unique examples
Developer Compiwer AI
Origin ๐Ÿ‡ฒ๐Ÿ‡ฆ Salรฉ, Morocco
๐Ÿ“Š Training Run
Steps: 3,661
Epochs: 1
Training Loss: 0.5855
Mean Token Accuracy: 83.55%
These metrics describe the training run and should not be treated as standardized benchmark scores.
๐Ÿš€ Usage
from transformers import Qwen3VLForConditionalGeneration, AutoTokenizer
model_id = "CompiwerAI/Mtrini-SVL-1.1-Merged"
tokenizer = AutoTokenizer.from_pretrained(
model_id,
trust_remote_code=True
)
model = Qwen3VLForConditionalGeneration.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
trust_remote_code=True
)
โš ๏ธ Limitations
Mtrini is an experimental open model.
It can hallucinate, generate incorrect code, misunderstand prompts, or produce incorrect mathematical answers.
Verify important outputs.
๐ŸŒ Why Mtrini?
AI shouldn't only be built by the biggest companies on Earth.
Mtrini is Compiwer AI's experiment in building open AI with a focus on:
๐Ÿ‡ฒ๐Ÿ‡ฆ Moroccan language
๐Ÿง  Reasoning
๐Ÿ’ป Coding
๐Ÿงฎ Mathematics
๐Ÿค Open AI
Building AI For Everyone.
Built in Salรฉ, Morocco ๐Ÿ‡ฒ๐Ÿ‡ฆ