Darayut commited on
Commit
d42ac97
·
verified ·
1 Parent(s): f370090

Redraw the architecture figure

Browse files

The figure is redrawn in the Netra Lab house style with the layers opened up; the alt text describes it.

Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +1 -1
  3. assets/pruning.png +0 -0
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  assets/tradeoff.png filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  assets/tradeoff.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/pruning.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -42,7 +42,7 @@ Test sets; greedy CTC decoding, no language model. CER for Khmer, WER for Englis
42
 
43
  ## Architecture
44
 
45
- <p align="center"><img src="https://huggingface.co/Darayut/sota-large/resolve/main/assets/pruning.png" width="100%" alt="The encoder before and after pruning: CNN kept, attention heads and FFN units removed"></p>
46
 
47
  *What is pruned*, shown for sota-large: whole attention heads (MHA) and FFN units are removed from every transformer layer, and the CNN front end is kept. Each cell is a quarter of a layer's heads or units.
48
 
 
42
 
43
  ## Architecture
44
 
45
+ <p align="center"><img src="https://huggingface.co/Darayut/sota-large/resolve/main/assets/pruning.png" width="100%" alt="Sota's architecture with one transformer layer opened up, beside the fine-tuned omniASR CTC-1B before and sota-large after structured pruning"></p>
46
 
47
  *What is pruned*, shown for sota-large: whole attention heads (MHA) and FFN units are removed from every transformer layer, and the CNN front end is kept. Each cell is a quarter of a layer's heads or units.
48
 
assets/pruning.png CHANGED

Git LFS Details

  • SHA256: df965173ab43e8552775f8c48931d7e44d2112b22cb77d7b5f2596f9683ced61
  • Pointer size: 131 Bytes
  • Size of remote file: 229 kB