relapse / README.md
itssaharsh's picture
Problem -> fix: side-by-side of default and CircuitKIT layers in the 4-bit file
6639322 verified
|
Raw History Blame Contribute Delete
838 Bytes
---
title: Relapse
emoji: ⬛
colorFrom: red
colorTo: green
sdk: static
pinned: false
license: mit
short_description: Forget the hazard, keep the rest, even in the 4-bit file
---
# Relapse: forget the hazard, keep the rest, even in the 4-bit file
Cohere's Tiny Aya Global, made to forget hazardous biology (WMDP-bio) with Lexsi Labs' SafeTune, measured in the files people download (fp16, bf16, Q8_0, Q6_K, Q4_K_M, Q4_0, NF4) and in Hindi, Arabic, Spanish and Swahili. At SafeTune's default layers the forgetting holds but costs more general knowledge in the 4-bit file; at the layers CircuitKIT found it holds and costs nothing measurable there.
Everything on the page is read from `data/results.json`, rebuilt from the raw runs by `scripts/build_results.py` in [github.com/itssaharsh/relapse](https://github.com/itssaharsh/relapse).