Commit History
-
Update README.md
Verified signature6fbcbc6 -
Create README.md
Verified signaturec99f794 -
Create README.md
Verified signature--- license: mit library_name: sae-lens tags: - mechanistic-interpretability - sparse-autoencoders - structural-biology - protein-language-models - alphafold3 - boltz-1 datasets: - custom metrics: - f1 - precision - recall --- # 📄 Model Card for Boltz-1 Diffusion & Trunk SAEs (`TopK`) This repository contains the trained **TopK Sparse Autoencoders (SAEs)** evaluated in the preprint *“Where a folding model keeps biology: probing and sparse-autoencoder analysis of the Boltz-1 trunk and diffusion module”*. These dictionaries map the dense activation spaces of Boltz-1's representation trunk (**Pairformer**) and generative coordinate decoder (**Diffusion Module**) into an interpretable, sparse latent basis. --- ## Model Details * **Developed by:** * **Affiliations:** * **Base Architecture:** Boltz-1 (Open-source AlphaFold3-class structure predictor) * **SAE Type:** TopK Sparse Autoencoder ($k=256$, total latents $N=2048$) * **Regularization:** $L_2$ weight regularization ($3 \tim…0be9e69
-
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/stats.jsonl with huggingface_hub
Verified signature5d455f8 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/mean_vector.npy with huggingface_hub
Verified signatureb02e3f3 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/eval_step_500000.json with huggingface_hub
Verified signature6a14beb -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/config.json with huggingface_hub
Verified signature499ac98 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/checkpoint_step_500000.pt with huggingface_hub
Verified signature7b55b69 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/stats.jsonl with huggingface_hub
Verified signature403775e -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/mean_vector.npy with huggingface_hub
Verified signature6ab5d29 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/eval_step_500000.json with huggingface_hub
Verified signature87ec4ac -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/config.json with huggingface_hub
Verified signaturebac23b0 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/checkpoint_step_500000.pt with huggingface_hub
Verified signatureabdc900 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/stats.jsonl with huggingface_hub
Verified signature51e67a2 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/mean_vector.npy with huggingface_hub
Verified signature79f3691 -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/eval_step_500000.json with huggingface_hub
Verified signature77e58ae -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/config.json with huggingface_hub
Verified signatureffb4a3e -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/checkpoint_step_500000.pt with huggingface_hub
Verified signature2eb5b3b -
Upload /rec50/layer22/diffusion22_topk256_lat2048_demean_longtrain500000_l2_3e-3_alive_cross_seed.json with huggingface_hub
Verified signature25445bd -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/stats.jsonl with huggingface_hub
Verified signature9ac1c00 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/mean_vector.npy with huggingface_hub
Verified signature9cf1455 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/eval_step_500000.json with huggingface_hub
Verified signature47b8f6a -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/config.json with huggingface_hub
Verified signaturea607fa3 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/checkpoint_step_500000.pt with huggingface_hub
Verified signature5e2d892 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/stats.jsonl with huggingface_hub
Verified signature8e923ff -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/mean_vector.npy with huggingface_hub
Verified signaturee200364 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/eval_step_500000.json with huggingface_hub
Verified signature543898f -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/config.json with huggingface_hub
Verified signature1205ea9 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/checkpoint_step_500000.pt with huggingface_hub
Verified signature73e748e -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/stats.jsonl with huggingface_hub
Verified signature6f466a1 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/mean_vector.npy with huggingface_hub
Verified signaturec7f578a -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/eval_step_500000.json with huggingface_hub
Verified signaturedb03592 -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/config.json with huggingface_hub
Verified signaturedb88cce -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/checkpoint_step_500000.pt with huggingface_hub
Verified signature4a5826c -
Upload /rec50/layer18/diffusion18_topk256_lat2048_demean_longtrain500000_l2_3e-3_alive_cross_seed.json with huggingface_hub
Verified signature5bdd1f9 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/stats.jsonl with huggingface_hub
Verified signature875223e -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/mean_vector.npy with huggingface_hub
Verified signature02f1c16 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/eval_step_500000.json with huggingface_hub
Verified signature77de5ba -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/config.json with huggingface_hub
Verified signaturee0672e7 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed3/checkpoint_step_500000.pt with huggingface_hub
Verified signature85e7c17 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/stats.jsonl with huggingface_hub
Verified signatureb429aeb -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/mean_vector.npy with huggingface_hub
Verified signature84e0077 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/eval_step_500000.json with huggingface_hub
Verified signature56ccbce -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/config.json with huggingface_hub
Verified signature50f8b2c -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed2/checkpoint_step_500000.pt with huggingface_hub
Verified signaturef2a0945 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/stats.jsonl with huggingface_hub
Verified signatureb1b3cba -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/mean_vector.npy with huggingface_hub
Verified signaturefe87746 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/eval_step_500000.json with huggingface_hub
Verified signaturec16c490 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/config.json with huggingface_hub
Verified signature591c5a7 -
Upload /rec50/layer14/diffusion14_topk256_lat2048_demean_longtrain500000_l2_3e-3_seed1/checkpoint_step_500000.pt with huggingface_hub
Verified signatureec63481