Add ASVD LLaMA-2-13B base results (zero-shot, BoolQ, three-corpus perplexity)
Browse files
README.md
CHANGED
|
@@ -76,7 +76,7 @@ Perplexity is **token-level** over fixed non-overlapping 2048-token windows, fol
|
|
| 76 |
| | TR-3 (ours) | 4.023 | 7.28 | 9.58 |
|
| 77 |
| | SVD-LLM | 4.022 | 10.17 | -- |
|
| 78 |
| | SVD-LLM V2 ‡ | 4.023 | 9.73 | -- |
|
| 79 |
-
| | ASVD | 4.023 | 10.04 |
|
| 80 |
| **LLaMA-2-13B (base)** | *dense FP16* | 13.016 | 4.88 | 6.74 |
|
| 81 |
| | SVD-LLM | 7.738 | 9.14 | -- |
|
| 82 |
| | SVD-LLM V2 ‡ | 7.740 | 8.74 | -- |
|
|
|
|
| 76 |
| | TR-3 (ours) | 4.023 | 7.28 | 9.58 |
|
| 77 |
| | SVD-LLM | 4.022 | 10.17 | -- |
|
| 78 |
| | SVD-LLM V2 ‡ | 4.023 | 9.73 | -- |
|
| 79 |
+
| | ASVD | 4.023 | 10.04 | 12.48 |
|
| 80 |
| **LLaMA-2-13B (base)** | *dense FP16* | 13.016 | 4.88 | 6.74 |
|
| 81 |
| | SVD-LLM | 7.738 | 9.14 | -- |
|
| 82 |
| | SVD-LLM V2 ‡ | 7.740 | 8.74 | -- |
|