entropy commited on
Commit
d467bdb
·
verified ·
1 Parent(s): 4b0d98f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -36,6 +36,11 @@ embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqu
36
  There is also a [decoder model](https://huggingface.co/entropy/roberta_zinc_decoder) trained to reconstruct
37
  inputs from embeddings
38
 
 
 
 
 
 
39
  ---
40
  license: mit
41
  ---
 
36
  There is also a [decoder model](https://huggingface.co/entropy/roberta_zinc_decoder) trained to reconstruct
37
  inputs from embeddings
38
 
39
+ ## Compression Head
40
+
41
+ There is a [compression head model](https://huggingface.co/entropy/roberta_zinc_compression_head) trained to
42
+ compress embeddings generated by this model from the native size of 768 to smaller sizes (512, 256, 128, 64, 32).
43
+
44
  ---
45
  license: mit
46
  ---