File size: 1,053 Bytes
ab52edb 6f6aff6 c7b15d3 6f6aff6 c7b15d3 ab52edb c7b15d3 ab52edb 6f6aff6 c7b15d3 ab52edb 6f6aff6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
title: Mistral Nemo Alpaca Finetune Demo
emoji: 🚀
colorFrom: purple
colorTo: purple
sdk: gradio
sdk_version: 6.26.0
app_file: app.py
pinned: false
hardware: t4-medium
license: apache-2.0
---
# Mistral Nemo Alpaca Finetune Demo
This Space provides an interactive chat demo for the [TensorVizion/mistral-nemo-alpaca-finetune](https://huggingface.co/TensorVizion/mistral-nemo-alpaca-finetune) model.
## Model Details
- **Base Model:** Mistral Nemo (12B)
- **Finetuned by:** TensorVizion
- **Training:** Fine-tuned 2x faster with Unsloth and Hugging Face's TRL library on Alpaca-style instructions.
- **Precision:** Loaded in 4-bit quantization (NF4) for efficient inference on consumer-grade GPUs.
## Hardware Requirements
This Space is configured to run on a `t4-medium` GPU (16GB VRAM). The 4-bit quantization ensures the 12B parameter model fits comfortably within this memory limit (~8GB VRAM usage). If you experience out-of-memory errors or want faster generation, consider upgrading to an `a10g-small` hardware tier in the Space settings. |