Instructions to use google/gemma-scope-2-12b-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- SAELens
How to use google/gemma-scope-2-12b-it with SAELens:
# pip install sae-lens from sae_lens import SAE sae, cfg_dict, sparsity = SAE.from_pretrained( release = "RELEASE_ID", # e.g., "gpt2-small-res-jb". See other options in https://github.com/jbloomAus/SAELens/blob/main/sae_lens/pretrained_saes.yaml sae_id = "SAE_ID", # e.g., "blocks.8.hook_resid_pre". Won't always be a hook point ) - Notebooks
- Google Colab
- Kaggle
Add files using upload-large-folder tool
Browse files- resid_post_all/layer_13_width_16k_l0_big/examples.safetensors +3 -0
- resid_post_all/layer_13_width_16k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_15_width_262k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_16_width_16k_l0_big/examples.safetensors +3 -0
- resid_post_all/layer_22_width_16k_l0_small/examples.safetensors +3 -0
- resid_post_all/layer_22_width_16k_l0_small/params.safetensors +1 -1
- resid_post_all/layer_22_width_262k_l0_big/examples.safetensors +3 -0
- resid_post_all/layer_22_width_262k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_24_width_262k_l0_small/params.safetensors +1 -1
- resid_post_all/layer_25_width_16k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_29_width_262k_l0_small/params.safetensors +1 -1
- resid_post_all/layer_31_width_16k_l0_small/examples.safetensors +3 -0
- resid_post_all/layer_31_width_262k_l0_small/examples.safetensors +3 -0
- resid_post_all/layer_36_width_262k_l0_small/examples.safetensors +3 -0
- resid_post_all/layer_3_width_262k_l0_big/examples.safetensors +3 -0
- resid_post_all/layer_40_width_262k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_42_width_262k_l0_small/params.safetensors +1 -1
- resid_post_all/layer_5_width_262k_l0_big/params.safetensors +1 -1
- resid_post_all/layer_7_width_16k_l0_big/examples.safetensors +3 -0
- resid_post_all/layer_7_width_16k_l0_big/params.safetensors +1 -1
resid_post_all/layer_13_width_16k_l0_big/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee0a0f38af8983bd76375272a4728e32598528bc158d151216b99f627dedbe0f
|
| 3 |
+
size 749173520
|
resid_post_all/layer_13_width_16k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 503463296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:13ce0a760a71473ed570e65a3b0bd37c84c67370b025e76eedc72592253889c9
|
| 3 |
size 503463296
|
resid_post_all/layer_15_width_262k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:86c503de9d669f849dabe3a08a747e9cce46a36dd7a439db4c61a2d0c3ce5691
|
| 3 |
size 8055176584
|
resid_post_all/layer_16_width_16k_l0_big/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6544d9608e24a017660c2f46c77e0676ff68675f00ba2e493fab08062bae128f
|
| 3 |
+
size 749173520
|
resid_post_all/layer_22_width_16k_l0_small/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3e6c0a631715948abc7241fc27fece2d74098febae37dd4ad8d47926d3b69dfe
|
| 3 |
+
size 749173520
|
resid_post_all/layer_22_width_16k_l0_small/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 503463296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0bd4832b82f5257700debb509c245ab0a11575b7bd8276dda6a0a0082c538863
|
| 3 |
size 503463296
|
resid_post_all/layer_22_width_262k_l0_big/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a29c497c3de4eac3ad1a33266c81cad0376280d9dc5af6b59cfaa7ce8ace1f6b
|
| 3 |
+
size 4713005864
|
resid_post_all/layer_22_width_262k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30371c04bd47434d44ee9faba61042e0f39d74caa0a25e31cc29b88ce5d8ed9f
|
| 3 |
size 8055176584
|
resid_post_all/layer_24_width_262k_l0_small/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9d994d39b8f946b27b36aaee2abc3c514ebbdcadf6d93ab11e4c3967ab8d5dc
|
| 3 |
size 8055176584
|
resid_post_all/layer_25_width_16k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 503463296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f66b8a7523433ef395728add7a8095cbc0cd23165fe0516be350c529e3d9dc6d
|
| 3 |
size 503463296
|
resid_post_all/layer_29_width_262k_l0_small/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bca37bd20933b603d70c07294faff6948b7639f90496a345d9d80545d617bbf4
|
| 3 |
size 8055176584
|
resid_post_all/layer_31_width_16k_l0_small/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0f9deab9ac8c17cb1af79576bc6e33596e35e9e6c4490cef4820899f36a4dd26
|
| 3 |
+
size 749173520
|
resid_post_all/layer_31_width_262k_l0_small/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30517c26a624db2bb6056c3d7efae34f2e310dfd642468d4db51e0b84c5c7ac5
|
| 3 |
+
size 4713005864
|
resid_post_all/layer_36_width_262k_l0_small/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9cc77865a1abc2cda4aae97aefd6850a9c9264af5c081e2086f4a827dfd33878
|
| 3 |
+
size 4713005864
|
resid_post_all/layer_3_width_262k_l0_big/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:68e9043484aa87197a998aa57e73c30d15cd2934f174fe32c914b7dd2bcde9e8
|
| 3 |
+
size 4713005864
|
resid_post_all/layer_40_width_262k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:726337e60bc862a75a50c8bb361d81d68712ca9dc1af1733069272c307cf7377
|
| 3 |
size 8055176584
|
resid_post_all/layer_42_width_262k_l0_small/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f685c5aed0ee9d4e85530514294f53ceef64f825c6011c406cba75fd2af81215
|
| 3 |
size 8055176584
|
resid_post_all/layer_5_width_262k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 8055176584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3ec36226b70cfd55d21a98e4f79be6f2d0aa78fd1484c5d79dc84ec79d71cfc1
|
| 3 |
size 8055176584
|
resid_post_all/layer_7_width_16k_l0_big/examples.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0625059752c18af564560b27f1597bea6fbbd247506752df07e970657f174541
|
| 3 |
+
size 749173520
|
resid_post_all/layer_7_width_16k_l0_big/params.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 503463296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae4134ca691ee000db45666a1b25c07e24163b3a3407dcae5a47976957482aab
|
| 3 |
size 503463296
|