| model | size | params | backend | threads | n_batch | n_ubatch | fa | lm | test | t/s | | ------------------------------ | ---------: | ---------: | ---------- | ------: | ------: | -------: | --: | ---------: | --------------: | -------------------: | | flint ?B Q4_K - Medium | 23.33 GiB | 39.79 B | CPU | 16 | 1024 | 1024 | 1 | mlock | pp2048 | 309.71 ± 0.00 | [GGML_PROF] total_us=13581874 [GGML_PROF] GET_ROWS f32