Redraw the architecture figure
Browse filesThe figure is redrawn in the Netra Lab house style with the layers opened up; the alt text describes it.
- .gitattributes +1 -0
- README.md +1 -1
- assets/pruning.png +0 -0
.gitattributes
CHANGED
|
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
assets/tradeoff.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
assets/tradeoff.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
assets/pruning.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -42,7 +42,7 @@ Test sets; greedy CTC decoding, no language model. CER for Khmer, WER for Englis
|
|
| 42 |
|
| 43 |
## Architecture
|
| 44 |
|
| 45 |
-
<p align="center"><img src="https://huggingface.co/Darayut/sota-base/resolve/main/assets/pruning.png" width="100%" alt="
|
| 46 |
|
| 47 |
*What is pruned*, shown for sota-large: whole attention heads (MHA) and FFN units are removed from every transformer layer, and the CNN front end is kept. Each cell is a quarter of a layer's heads or units.
|
| 48 |
|
|
|
|
| 42 |
|
| 43 |
## Architecture
|
| 44 |
|
| 45 |
+
<p align="center"><img src="https://huggingface.co/Darayut/sota-base/resolve/main/assets/pruning.png" width="100%" alt="Sota's architecture with one transformer layer opened up, beside the fine-tuned omniASR CTC-1B before and sota-large after structured pruning"></p>
|
| 46 |
|
| 47 |
*What is pruned*, shown for sota-large: whole attention heads (MHA) and FFN units are removed from every transformer layer, and the CNN front end is kept. Each cell is a quarter of a layer's heads or units.
|
| 48 |
|
assets/pruning.png
CHANGED
|
|
Git LFS Details
|