Hugging Face's logo

ManPla
/
angular-separation-vit-checkpoints

Model card Files
xet
 Community
angular-separation-vit-checkpoints
File size: 2,618 Bytes
f354559
 
 
 
 
 
 
 
 
 
 
 
 
 
34dbe71
d318006
 
 
 
f354559
 
 
 
 
 
 
 
 
 
 
 
 
 
a35e5fb
 
 
 
 
 
 
 
 
 
 
 
 
f354559
e9dd62a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f354559
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
---
license: apache-2.0
---

# angular-separation-vit — reproduction checkpoints

Final (`_last.pt`) checkpoints backing *"Dos modelos idénticos, dos
podas distintas: la dirección dominante de $W_O$ bajo intervención
libre, suave y dura"* ("Same function, different pruning: the
dominant direction of $W_O$ under free, soft, and hard intervention").
These are verification artifacts for reproducing the paper's tables —
not meant as general-purpose pretrained weights.

Code: <https://github.com/mmunozpl/angular-separation-vit>
CSV results derived from these checkpoints: <https://huggingface.co/datasets/ManPla/angular-separation-vit-results>
Paper (both languages): [`paper/angular_separation_paper.pdf`](paper/angular_separation_paper.pdf)
(English, canonical for citation) /
[`paper/separacion_angular_paper.pdf`](paper/separacion_angular_paper.pdf)
(Spanish original).

## Layout

```
vitb_clean/attnA_{base,blanda,dura}_seed{42..46}_last.pt   # ancla, n=5
vitl_clean/attnA_{base,blanda,dura}_seed{42..44}_last.pt   # n=3
dinov2_clean/attnA_base_seed42_last.pt                     # frozen, n=1
```

`base` = fine-tuned ViT with no angular regularizer. `blanda` = soft
angular probe (`R_div`, eq. 5). `dura` = hard variant, reprojected to
the spherical code after every optimizer step. DINOv2 is analyzed
frozen (no fine-tuning), hence a single realization.

All backbones derive from `timm` pretrained weights, fine-tuned on
ImageNet-100 for the two supervised columns. Upstream pretraining
license, checked against `timm`'s own `PretrainedCfg` metadata (not
assumed):

| Backbone | Upstream checkpoint | License |
|---|---|---|
| ViT-B/16 | `timm/vit_base_patch16_224.augreg2_in21k_ft_in1k` | Apache-2.0 |
| ViT-L/16 | `timm/vit_large_patch16_224.augreg_in21k_ft_in1k` (Google AugReg) | Apache-2.0 |
| DINOv2-L | `timm/vit_large_patch14_dinov2.lvd142m` (Meta) | Apache-2.0 |

All three are Apache-2.0 at the source, consistent with this
repository's license — no upstream restriction carries over.

## How to cite

Cite the code repository (this repo's own DOI,
[10.57967/hf/9742](https://doi.org/10.57967/hf/9742), identifies
these specific checkpoints if you need to reference them directly):

```bibtex
@software{munozpla2026samefunctiondifferentpruning,
  author  = {Muñoz Plá, Manuel},
  title   = {Same function, different pruning: the dominant direction
             of W_O under free, soft, and hard intervention},
  year    = {2026},
  version = {2.0.0},
  doi     = {10.5281/zenodo.21630535},
  url     = {https://github.com/mmunozpl/angular-separation-vit}
}
```

## License

Apache-2.0.