README.md

metadata

title: Relapse
emoji: ⬛
colorFrom: red
colorTo: green
sdk: static
pinned: false
license: mit
short_description: Forget the hazard, keep the rest, even in the 4-bit file

Relapse: forget the hazard, keep the rest, even in the 4-bit file

Cohere's Tiny Aya Global, made to forget hazardous biology (WMDP-bio) with Lexsi Labs' SafeTune, measured in the files people download (fp16, bf16, Q8_0, Q6_K, Q4_K_M, Q4_0, NF4) and in Hindi, Arabic, Spanish and Swahili. At SafeTune's default layers the forgetting holds but costs more general knowledge in the 4-bit file; at the layers CircuitKIT found it holds and costs nothing measurable there.

Everything on the page is read from data/results.json, rebuilt from the raw runs by scripts/build_results.py in github.com/itssaharsh/relapse.