Quantized Models (GGUF, IQ, Imatrix)
Collection
Various GGUF quantizations of small models. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 97 items • Updated • 73
James Wells
warguppy
·
AI & ML interests
Local LLMs, Image Gen
Recent Activity
liked a model about 1 month ago
PocketDoc/Dans-PersonalityEngine-V1.3.0-24b liked a model about 1 month ago
sophosympatheia/Midnight-Miqu-70B-v1.5 liked a model about 1 month ago
mradermacher/Forgotten-Safeword-24B-3.6-i1-GGUFOrganizations
None yet
upvoted a collection over 1 year ago