Spaces:
Runtime error
Runtime error
|
Download README.md from limitless235/llm-pushback: direct link, hf CLI and curl.
- Browser
- Download file 1.34 kB
-
https://huggingface.co/spaces/limitless235/llm-pushback/resolve/main/README.md
- Command line
-
hf download hf://spaces/limitless235/llm-pushback/README.md
-
curl -L -o README.md https://huggingface.co/spaces/limitless235/llm-pushback/resolve/main/README.md
1.34 kB
| title: LLM Pushback | |
| emoji: 🧠 | |
| colorFrom: blue | |
| colorTo: indigo | |
| sdk: streamlit | |
| sdk_version: 1.35.0 | |
| python_version: 3.11 | |
| app_file: chat_gui.py | |
| pinned: false | |
| # Ministral Alignment Lab: BullshitBench Evaluation | |
| A specialized research project focused on aligning small language models (**Ministral-3B** and **Qwen-4B**) to identify and push back against nonsensical logical premises using **Direct Preference Optimization (DPO)** and **Supervised Fine-Tuning (SFT)** on Apple Silicon (MLX). | |
| ## 🚀 Key Results | |
| * **Ministral-3B**: Improved from **4.0%** (Baseline) to **74.2%** (SFT V3) Green Rate. | |
| * **Qwen-4B**: Jumped from **35.0%** (Baseline) to **79.0%** (SFT V1) Green Rate with 100% accuracy in Physics. | |
| ## 📦 Project Structure | |
| - `chat_gui.py`: Interactive Streamlit dashboard with real-time reasoning visualization. | |
| - `finetune.py` / `post_eval.py`: Core pipeline for LoRA fine-tuning and evaluation. | |
| - `data/`: Curated dataset of reasoning pairs used for alignment. | |
| - `deepseek_evaluation_report.md`: Full technical audit of model performance. | |
| ## 🛠️ Setup | |
| 1. **Requirements**: `pip install -r requirements.txt` | |
| 2. **Run GUI**: `streamlit run chat_gui.py` | |
| ## 📊 Deployment | |
| For sharing within your network, see the [Deployment Guide](deployment_guide.md). | |
| --- | |
| *Evaluated using DeepSeek R1 14B as the judge.* | |