treevik2-chat / README.md
PlusBIntelligenceLab's picture
Chat- for treevik-2
8800113 verified
|
Raw History Blame Contribute Delete
897 Bytes

A newer version of the Gradio SDK is available: 6.32.0

Upgrade
metadata
title: Treevik-2 2.5B Instruct
emoji: 🌳
colorFrom: indigo
colorTo: blue
sdk: gradio
sdk_version: 5.12.0
python_version: 3.12.0
app_file: app.py
pinned: true
license: apache-2.0

🌳 Treevik-2 2.5B Instruct

The second language model in the Treevik family by PlusB Intelligence Lab, fine-tuned for conversation.

  • Parameters: 2.5B (8-bit quantized)
  • Architecture: GPT-style with RoPE, GQA, ReLU², Value Embeddings
  • Training: SFT on OpenHermes 2.5 (1M conversations) + identity data
  • Quantization: 8-bit weight quantization for efficient inference
  • Creator: Sayan Chowdhury, PlusB Intelligence Lab

Model Details

Config Value
Layers 26
Heads 13
KV Heads 13
Embedding Dim 1664
Sequence Length 2048
Vocab Size 65536
Window Pattern L (full context)