Local Inference - a dejongj Collection

dejongj 's Collections

Local Inference

Local Inference

updated Aug 27, 2025

Collection to be used for local inference.

bartowski/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 43.9k • 51
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 366k • 429
bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 251k • 85
bartowski/gemma-2-9b-it-GGUF

Text Generation • 9B • Updated Jul 15, 2024 • 27k • 237