--- title: Treevik-2 2.5B Instruct emoji: 🌳 colorFrom: indigo colorTo: blue sdk: gradio sdk_version: 5.12.0 python_version: 3.12.0 app_file: app.py pinned: true license: apache-2.0 --- # 🌳 Treevik-2 2.5B Instruct The second language model in the **Treevik** family by **PlusB Intelligence Lab**, fine-tuned for conversation. - **Parameters:** 2.5B (8-bit quantized) - **Architecture:** GPT-style with RoPE, GQA, ReLU², Value Embeddings - **Training:** SFT on OpenHermes 2.5 (1M conversations) + identity data - **Quantization:** 8-bit weight quantization for efficient inference - **Creator:** Sayan Chowdhury, PlusB Intelligence Lab ## Model Details | Config | Value | |--------|-------| | Layers | 26 | | Heads | 13 | | KV Heads | 13 | | Embedding Dim | 1664 | | Sequence Length | 2048 | | Vocab Size | 65536 | | Window Pattern | L (full context) |