File size: 1,014 Bytes
7acb3f9 91ff59c dd3565d 410411f 7acb3f9 91ff59c 9c9f0c4 0bc69ed 9c9f0c4 efcdba3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | ---
license: apache-2.0
datasets:
- aiuser3993/Definitive-Data
base_model:
- openbmb/MiniCPM5-2B-Base
pipeline_tag: text-generation
tags:
- definitive
---
# DefCPM-2B aims to be a lightweight truth-seeking sycophancy-free LLM assistant.
After experimenting with several LLMs (some of which I have shared on this account), I came to the conclusion that many Instruction-Tuned models would rather sacrifice accuracy that to dissatisfy the user (a phenomenon known as sycophancy).
Therefore, I created [this dataset](https://huggingface.co/datasets/aiuser3993/Definitive-Data) to tackle with this exact problem, to encourage LLMs to give precise answers, teaching them to directly contest false user premises.
## This model was fine-tuned (3 epochs, 0,00001 learning rate) with said dataset as an application of the concept. It adopted the expected behavior surprisingly well.
I generally recommend a Q4_K_M or an IQ4_XS quantization for deployment on edge devices.
Enjoy!
_DefCPM stands for 'Definitive CPM'._ |