Update README.md
Browse files
README.md
CHANGED
|
@@ -149,6 +149,8 @@ there without thinking.
|
|
| 149 |
There are some developments to make this less of a pain, and I will revisit this issue from time to time to see if it has
|
| 150 |
become feasible.
|
| 151 |
|
|
|
|
|
|
|
| 152 |
## Why are there so many imatrix quants where llama.cpp crashes?
|
| 153 |
|
| 154 |
Because llama.cpp developers see imatrix quants as a useless gimmick, are not very interested in fixing bugs,
|
|
|
|
| 149 |
There are some developments to make this less of a pain, and I will revisit this issue from time to time to see if it has
|
| 150 |
become feasible.
|
| 151 |
|
| 152 |
+
Update 2024-07: llama.cpp probably has most of the features needed to make this reality, but I haven't found time to test and implement it yet.
|
| 153 |
+
|
| 154 |
## Why are there so many imatrix quants where llama.cpp crashes?
|
| 155 |
|
| 156 |
Because llama.cpp developers see imatrix quants as a useless gimmick, are not very interested in fixing bugs,
|