Darayut commited on
Commit
96fccd8
·
verified ·
1 Parent(s): be3ccdb

Card: Figure 2 as teacher vs SOTA bars

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. assets/tradeoff.png +2 -2
README.md CHANGED
@@ -36,9 +36,9 @@ Test sets; greedy CTC decoding, no language model. CER for Khmer, WER for Englis
36
  - **English:** it keeps much less of its teacher's accuracy, with about 1.5–2× the teacher's WER.
37
  - **In-domain test sets:** FLEURS-km and FLEURS-en train are in the training mix, so their test sets are in-domain.
38
 
39
- <p align="center"><img src="https://huggingface.co/Darayut/sota-base/resolve/main/assets/tradeoff.png" width="100%" alt="Error rate against speed-up for each fine-tuned teacher and its 80%-sparse model"></p>
40
 
41
- *Speed against error.* Each arrow runs from a fine-tuned teacher to its pruned model (solid: large, dashed: base). Marker area is the parameter count, and each label gives the error and its change against the teacher. Speed is relative to the fine-tuned 1B (real-time factor).
42
 
43
  ## Architecture
44
 
 
36
  - **English:** it keeps much less of its teacher's accuracy, with about 1.5–2× the teacher's WER.
37
  - **In-domain test sets:** FLEURS-km and FLEURS-en train are in the training mix, so their test sets are in-domain.
38
 
39
+ <p align="center"><img src="https://huggingface.co/Darayut/sota-base/resolve/main/assets/tradeoff.png" width="100%" alt="Parameters, speed and test error of each 80%-sparse SOTA model next to its fine-tuned teacher"></p>
40
 
41
+ *What 80% sparsity buys and costs.* Each SOTA model (orange) next to its fine-tuned teacher (blue); percentages are the change against the teacher, and speed is the measured real-time factor relative to the teacher.
42
 
43
  ## Architecture
44
 
assets/tradeoff.png CHANGED

Git LFS Details

  • SHA256: 40c91bdcc8ea969ddae70c790cb36314472f7a72e087d048689a769b20cc2e83
  • Pointer size: 131 Bytes
  • Size of remote file: 251 kB

Git LFS Details

  • SHA256: 710ff0dcf1c8b6f512c70538cb7b2c11e112220ccb2a89b075f781076586899b
  • Pointer size: 131 Bytes
  • Size of remote file: 151 kB