LLMs < 1B - a gaunernst Collection

gaunernst 's Collections

Gemma 3 QAT INT4 (from GGUF)

Gemma 3 QAT INT4 (from Flax)

Mini BERT models

Face Recognition Models

Smallish LLM pre-training datasets

Llama2-compatible

Llama3-compatible

LLMs < 1B

updated Sep 29, 2024

Qwen/Qwen2-0.5B

Text Generation • 0.5B • Updated Oct 22, 2024 • 215k • • 179
Qwen/Qwen2-0.5B-Instruct

Text Generation • 0.5B • Updated Aug 21, 2024 • 250k • • 212
HuggingFaceTB/SmolLM-135M

Text Generation • 0.1B • Updated Aug 1, 2024 • 79.7k • 276
HuggingFaceTB/SmolLM-135M-Instruct

Text Generation • 0.1B • Updated Sep 4, 2024 • 26.8k • 147
HuggingFaceTB/SmolLM-360M

Text Generation • 0.4B • Updated Aug 1, 2024 • 13.1k • 74
HuggingFaceTB/SmolLM-360M-Instruct

Text Generation • 0.4B • Updated Aug 18, 2024 • 8.45k • 89
apple/OpenELM-270M

Text Generation • 0.3B • Updated Feb 28, 2025 • 3.8k • 78
apple/OpenELM-270M-Instruct

Text Generation • 0.3B • Updated Feb 28, 2025 • 1.15k • 146
apple/OpenELM-450M

Text Generation • 0.5B • Updated Feb 28, 2025 • 1.28k • 27
apple/OpenELM-450M-Instruct

Text Generation • 0.5B • Updated Feb 28, 2025 • 1.34k • 52
facebook/opt-125m

Text Generation • Updated Sep 15, 2023 • 5.45M • 332
facebook/opt-350m

Text Generation • Updated Sep 15, 2023 • 185k • 157
amd/AMD-Llama-135m

Text Generation • 0.1B • Updated Oct 9, 2024 • 8.62k • 120