Magnus-SYMB β€” SYNAXIM Text Inference

⚑ v0.1.x β€” Text-only. Optimized for fast text generation through SYNAXIM's O(1) Symbiotic State Engine. Multimodal (vision, audio) planned for v0.2.x.

Quick Start

pip install git+https://github.com/GRRN-MAKER/SYNAXIM.git
huggingface-cli download GRRNMAKE/Magnus-SYMB --local-dir ./magnus-symb
from grrn_inference import GRRNModel

model = GRRNModel.from_pretrained("./magnus-symb", device="cuda")
result = model.generate("Hello, I am Magnus.", max_tokens=50, temperature=0.7)
print(result.text)

Model Details

Property Value
Name Magnus
Source GRRNMAKE/Magnus
Base Mistral-7B-Instruct-v0.3
Modality Text-only (v0.1.x)
Parameters ~7.24B
Layers 32, D=4096, 32Q/8KV
Format .symb INT4 (3.85 GB)
Adapter 32-layer Symbiotic Gate (trained via knowledge distillation)

Backends

Backend Device Speed
Triton GPU device="cuda" πŸ”₯ Fastest
Numba CPU device="cpu" ⚑ Fast
NumPy device="cpu-numpy" Baseline

Engine: GRRN-MAKER/SYNAXIM | Author: GRRNMAKER

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for GRRNMAKE/Magnus-SYMB

Finetuned
GRRNMAKE/Magnus
Finetuned
(1)
this model