File size: 1,061 Bytes
bc4e445 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
license: apache-2.0
base_model:
- Sparset/Thinklite-27B
- ConceptCountry/qwen-concept-27b
tags:
- weight-editing
- thinklite
---
# Thinklite-27B + Concept edit (experimental, unevaluated)
[Sparset/Thinklite-27B](https://huggingface.co/Sparset/Thinklite-27B) with the additive weight edit from
[ConceptCountry/qwen-concept-27b](https://huggingface.co/ConceptCountry/qwen-concept-27b) transplanted onto it.
The edit was extracted as `concept(bf16) - Qwen/Qwen3.8-27B` (only the nine `mlp.down_proj` weights in layers
32-48 (even) differ), denoised by low-rank truncation when the diff was clearly low-rank, and added in
fp32 to Thinklite's corresponding weights before rounding back to bf16.
Caveat: the Concept direction was derived from the *base* model's activations. Thinklite is a full
finetune, so the direction may not mean the same thing here. Nothing has been benchmarked.
Files: `concept_delta.safetensors` (fp32 deltas actually applied), `TRANSPLANT_REPORT.json`
(per-tensor norms / singular values), `CONCEPT_EDIT_SPEC.json` (upstream spec).
|