Magnus-SYMB β SYNAXIM Text Inference
β‘ v0.1.x β Text-only. Optimized for fast text generation through SYNAXIM's O(1) Symbiotic State Engine. Multimodal (vision, audio) planned for v0.2.x.
Quick Start
pip install git+https://github.com/GRRN-MAKER/SYNAXIM.git
huggingface-cli download GRRNMAKE/Magnus-SYMB --local-dir ./magnus-symb
from grrn_inference import GRRNModel
model = GRRNModel.from_pretrained("./magnus-symb", device="cuda")
result = model.generate("Hello, I am Magnus.", max_tokens=50, temperature=0.7)
print(result.text)
Model Details
| Property | Value |
|---|---|
| Name | Magnus |
| Source | GRRNMAKE/Magnus |
| Base | Mistral-7B-Instruct-v0.3 |
| Modality | Text-only (v0.1.x) |
| Parameters | ~7.24B |
| Layers | 32, D=4096, 32Q/8KV |
| Format | .symb INT4 (3.85 GB) |
| Adapter | 32-layer Symbiotic Gate (trained via knowledge distillation) |
Backends
| Backend | Device | Speed |
|---|---|---|
| Triton GPU | device="cuda" |
π₯ Fastest |
| Numba CPU | device="cpu" |
β‘ Fast |
| NumPy | device="cpu-numpy" |
Baseline |
Engine: GRRN-MAKER/SYNAXIM | Author: GRRNMAKER
Model tree for GRRNMAKE/Magnus-SYMB
Base model
mistralai/Mistral-7B-v0.3 Finetuned
mistralai/Mistral-7B-Instruct-v0.3 Finetuned
GRRNMAKE/Magnus