Commit History
-
Update README.md
Verified signature223b979 -
Update README.md
Verified signature947b904
-
Update README.md
Verified signature233e70c -
Update README.md
Verified signature55e81ad -
Update README.md
Verified signaturee2d4828 -
Update README.md
Verified signatureb6114f8 -
Update README.md
Verified signature# TinyLlama MentalChat LoRA This repository contains a **LoRA adapter** fine-tuned on the [ShenLab/MentalChat16K](https://huggingface.co/datasets/ShenLab/MentalChat16K) dataset for **mental health–related supportive dialogue**. ⚠️ This is **not a full model**. It is a lightweight LoRA adapter that must be used together with the base model. --- ## 🔍 Model Overview - **Base Model**: TinyLlama/TinyLlama-1.1B-Chat-v1.0 - **Fine-tuning Method**: LoRA (PEFT) - **Domain**: Mental health supportive conversations - **Language**: English - **Parameter Size (Adapter)**: ~50MB --- ## 📚 Training Data The model was fine-tuned using the **MentalChat16K** dataset, which consists of mental health–related conversations between users and assistants. - Dataset: `ShenLab/MentalChat16K` - Language: English - Task: Supportive, empathetic responses in mental health contexts --- ## 🚀 Usage ### Load Base Model + LoRA Adapter from unsloth import FastLanguageModel from peft import PeftModel impor…51e5764 -
Update README.md
Verified signature54fc316 -
Update README.md
Verified signature2220b96 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster8fe4182 -
initial commit
Verified signaturedac56a1