Foundation Text-Generation Models Below 360M Parameters - a Felladrin Collection

Felladrin 's Collections

Trained Models 🏋️

Frequently Used Spaces

Foundation Text-Generation Models Below 360M Parameters

Foundation Text-Generation Models Below 360M Parameters

updated Sep 14

Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.

HuggingFaceTB/SmolLM2-360M

Text Generation • 0.4B • Updated Feb 6, 2025 • 129k • 143

Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base

Text Generation • 0.4B • Updated Nov 10, 2025 • 280 • 14

Note License: fair-noncommercial-research Context Length: 4k
LiquidAI/LFM2.5-350M-Base

Text Generation • 0.4B • Updated Mar 31 • 4.99k • 38

Note License: lfm1.0 Context Length: 32k
PleIAs/Pleias-350m-Preview

0.4B • Updated Feb 14, 2025 • 746 • 27

Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M

Text Generation • 0.3B • Updated Aug 24, 2024 • 1.93k • 9

Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama

Text Generation • 0.3B • Updated Aug 11, 2025 • 1.4k • 53

Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m

Text Generation • 0.3B • Updated Aug 14, 2025 • 93.4k • 1.14k

Note License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M

0.3B • Updated Jul 15 • 7 • 3

Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k

Text Generation • 0.2B • Updated Feb 7, 2024 • 1.33k • 12

Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3

Text Generation • 0.2B • Updated Oct 20, 2024 • 130 • 8

Note License: apache-2.0 Context Length: 2k
LiquidAI/LFM2.5-230M-Base

Text Generation • 0.2B • Updated Jun 16 • 275k • 25

Note License: lfm1.0 Context Length: 32k
MiniLLM/MiniPLM-llama3.1-212M

Text Generation • 0.2B • Updated Mar 25, 2025 • 23 • 6

Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M

Text Generation • 0.2B • Updated Oct 27, 2024 • 1.37k • 10

Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base

Text Generation • 0.2B • Updated Feb 23 • 101 • 30

Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m

Text Generation • Updated Dec 4, 2023 • 96 • 4

Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m

Text Generation • 0.2B • Updated Jan 4, 2024 • 41.1k • 37

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M

Text Generation • 0.2B • Updated Aug 8, 2025 • 102 • 7

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m

Text Generation • 0.2B • Updated Jul 9, 2023 • 3.4M • 66

Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Pro-Preview

Text Generation • 0.2B • Updated Aug 17 • 150 • 23

Note License: other (bananamind-community-license-1.0) Context Length: 3k
Harikrish2727/BetterGPT-150M

Text Generation • 0.2B • Updated Jul 29 • 136 • 2

Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-150m

Fill-Mask • Updated Jul 16, 2025 • 2.33k • 6

Note License: mit Context Length: 8k
StentorLabs/Portimbria-150M

Text Generation • 0.2B • Updated Apr 24 • 146 • 11

Note License: apache-2.0 Context Length: 4k
AuroraAI-Research/Aurora1.0-150M

Text Generation • 0.1B • Updated 7 days ago • 824 • 15

Note License: apache-2.0 Context Length: 1k
facebook/MobileLLM-R1-140M-base

Text Generation • 0.1B • Updated Nov 10, 2025 • 91 • 23

Note License: fair-noncommercial-research Context Length: 4k
joelhenwang/OdinNext-138M-Base

Text Generation • 0.1B • Updated Jun 9 • 45 • 3

Note License: apache-2.0 Context Length: 2k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 30.8M • 3.92k

Note License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M

Text Generation • 0.1B • Updated Feb 6, 2025 • 2.48M • 267

Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m

Text Generation • 0.1B • Updated Oct 9, 2024 • 7.68k • 120

Note License: apache-2.0 Context Length: 2k
AxiomicLabs/GPT-X2.5-135M

Text Generation • 0.1B • Updated 26 days ago • 1.26k • 67

Note License: apache-2.0 Context Length: 8k
MaliosDark/Nexus-Erebus-135M

Text Generation • 0.1B • Updated Jul 21 • 36 • 10

Note License: other Context Length: 1k
MiniLLM/MiniPLM-Mamba-130M

Text Generation • 0.1B • Updated Mar 25, 2025 • 101 • 4

Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base

Text Generation • 0.1B • Updated Sep 4, 2025 • 90 • 18

Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m

Text Generation • 0.2B • Updated Jan 31, 2024 • 465k • 231

Note License: mit Context Length: 2k
opencerebral/Boris-1.3-125M

Text Generation • 0.1B • Updated 21 days ago • 686 • 4

Note License: apache-2.0 Context Length: 1k
TobiasLogic/Museko-125M

Text Generation • 0.1B • Updated Jul 23 • 51 • 9

Note License: apache-2.0 Context Length: 2k
facebook/opt-125m

Text Generation • Updated Sep 15, 2023 • 4.68M • 333

Note License: other (OPT-175B License Agreement, non-commercial research only) Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA

Text Generation • 0.1B • Updated Dec 29, 2025 • 1.45k • 33

Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M

0.1B • Updated Jul 15 • 7 • 2

Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra2-100M-Base

Text Generation • 0.1B • Updated Sep 29 • 2.33k • 31

Note License: apache-2.0 Context Length: 1k
raincandy-u/Rain-100M

Text Generation • 97.2M • Updated Jan 24 • 540 • 23

Note License: apache-2.0 Context Length: 4k
FlameF0X/TinyMoE-100m-2x8-retrained

Text Generation • 99.8M • Updated Jul 5 • 643 • 3

Note License: mit Context Length: 1k
Sandroeth/cali-0.1B

Text Generation • 0.1B • Updated Jul 28 • 202 • 5

Note License: apache-2.0 Context Length: 1k
HuggingFaceTB/nanowhale-100m-base

Text Generation • 0.1B • Updated May 4 • 1.35k • 25

Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-2-96M

Text Generation • 96M • Updated Apr 5, 2025 • 235 • 7

Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-3-95M-Base

Text Generation • 94.7M • Updated Aug 22 • 97 • 3

Note License: apache-2.0 Context Length: 8k
finnianx/Gros-Michel-90m-Base-v2

94.9M • Updated Jul 10 • 39 • 6

Note License: not specified Context Length: 1k
appvoid/palmer-006

Text Generation • 91.1M • Updated Aug 9 • 582 • 10

Note License: other (appvoid-noncommercial-model-license-1.0) Context Length: 256k
distilbert/distilgpt2

Text Generation • 88.2M • Updated Feb 19, 2024 • 1.47M • 667

Note License: apache-2.0 Context Length: 1k
Quazim0t0/Escarda-86M-Base

Text Generation • 97.3M • Updated Sep 20 • 406 • 6

Note License: apache-2.0 Context Length: 4k
Quazim0t0/Byrne-86M-Base

Text Generation • 96.9M • Updated Sep 20 • 211 • 5

Note License: apache-2.0 Context Length: 4k
weiser/82M-0.4

Text Generation • 82.1M • Updated Nov 12, 2024 • 7

Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied

Text Generation • 81.3M • Updated Dec 29, 2025 • 302 • 10

Note License: apache-2.0 Context Length: 1k
opencerebral/Boris-1.3-75M

Text Generation • 77.4M • Updated 21 days ago • 813 • 1

Note License: apache-2.0 Context Length: 1k
MinimaLabs/KeyLM-75M

Text Generation • 75.3M • Updated May 29 • 114 • 18

Note License: apache-2.0 Context Length: 2k
GODELEV/Archaea-74M-V1.1

Text Generation • 74M • Updated Jun 23 • 52 • 4

Note License: mit Context Length: 1k
EleutherAI/pythia-70m

95.6M • Updated Nov 21, 2023 • 227k • 88

Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m

Text Generation • Updated Jun 5 • 76.5k • 38

Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-68m

Fill-Mask • Updated Jul 16, 2025 • 788 • 2

Note License: mit Context Length: 8k
OuteAI/Lite-Oute-1-65M

Text Generation • 65M • Updated Aug 25, 2024 • 275 • 12

Note License: apache-2.0 Context Length: 2k
WhirlwindAI/MetaNova-1-60M

Text Generation • 62.7M • Updated Sep 29 • 113 • 8

Note License: apache-2.0 Context Length: 3k
SmallDoge/Doge-60M

Text Generation • 54.6M • Updated Aug 8, 2025 • 100 • 5

Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Medium

Text Generation • 55.9M • Updated Jul 21 • 728 • 17

Note License: apache-2.0 Context Length: 3k
MaliosDark/Nexus-Erebus-50M

Text Generation • 54.1M • Updated Jul 9 • 42 • 8

Note License: apache-2.0 Context Length: 1k
MaliosDark/Isabel-50M

Text Generation • 54.1M • Updated Jun 22 • 43 • 11

Note License: apache-2.0 Context Length: 1k
SupraLabs/Supra-50M-Base

Text Generation • 51.8M • Updated May 27 • 831 • 48

Note License: apache-2.0 Context Length: 1k
veyra-ai/Veyra2-Apricot-50M-Base

Text Generation • 49.3M • Updated Sep 30 • 439 • 17

Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-50M

Text Generation • 49.4M • Updated May 19 • 94 • 7

Note License: apache-2.0 Context Length: 4k
GODELEV/Rose-Mini

Text Generation • 49.4M • Updated Aug 1 • 152 • 16

Note License: apache-2.0 Context Length: 1k
harrrshall/BarunLM-35M

Text Generation • 35.1M • Updated Jul 31 • 55

Note License: apache-2.0 Context Length: 2k
sabari2005/cyberslm-33m-base

Text Generation • 33.5M • Updated Jul 15 • 13 • 1

Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-32M-Base

Text Generation • 32.8M • Updated Apr 6, 2025 • 1.4k • 19

Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m

Text Generation • Updated Mar 30, 2023 • 316 • 2

Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-32m

Text Generation • Updated Jul 18, 2025 • 1.06k

Note License: mit Context Length: 8k
fromziro/Er-Large-30M

31.9M • Updated Jun 17 • 36 • 4

Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-31m-deduped

Text Generation • 55.7M • Updated Feb 12 • 1.72k • 5

Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Mini

Text Generation • 28.3M • Updated Jul 21 • 117 • 14

Note License: apache-2.0 Context Length: 4k
BananaMind/BananaMind-2-MoE

Text Generation • 26.1M • Updated Jul 16 • 1.27k • 10

Note License: apache-2.0 Context Length: 4k
SmallDoge/Doge-20M

Text Generation • 13.1M • Updated Jun 25, 2025 • 1.16k • 13

Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-20M

Text Generation • 20.3M • Updated May 20 • 57 • 6

Note License: apache-2.0 Context Length: 4k
jhu-clsp/ettin-decoder-17m

Fill-Mask • Updated Jul 16, 2025 • 1.29k • 2

Note License: mit Context Length: 8k
MultivexAI/Plyx-15M

Text Generation • 16.1M • Updated Jun 16 • 34 • 6

Note License: apache-2.0 Context Length: 512
EleutherAI/pythia-14m-deduped

Text Generation • 39.2M • Updated Feb 12 • 5.1k • 32

Note License: apache-2.0 Context Length: 2k
fromziro/Er-Medium-12.5M

12.5M • Updated Jul 10 • 85 • 11

Note License: apache-2.0 Context Length: 384
BananaMind/BananaMind-2-Nano

Text Generation • 12.1M • Updated Jul 21 • 165 • 13

Note License: apache-2.0 Context Length: 4k
liodon-ai/slm-10m

Text Generation • 12.1M • Updated Jul 13 • 70 • 13

Note License: apache-2.0 Context Length: 1k
Dream-W/ObsidianSmall-Base

Text Generation • 9.77M • Updated Aug 8 • 30 • 4

Note License: not specified Context Length: 1k
User01110/CMA-8M

Text Generation • 9.08M • Updated Jul 31 • 180 • 22

Note License: apache-2.0 Context Length: 1k
DedeProGames/DynamicMind-Mini

8.88M • Updated Aug 2 • 125 • 5

Note License: apache-2.0 Context Length: 1k
Harley-ml/Tenete-8M

Text Generation • 8.29M • Updated May 25 • 59 • 8

Note License: mit Context Length: 1k
AtomixLabs/AtomixS2-5M-v1.0

Text Generation • 5.98M • Updated Aug 28 • 159 • 3

Note License: apache-2.0 Context Length: 512
LH-Tech-AI/Spark-5M-Base-v4

Text Generation • 4.98M • Updated May 2 • 21 • 3

Note License: not specified Context Length: 512
MaliosDark/Nexus-Erebus-3M

Text Generation • 3M • Updated Jul 11 • 19 • 3

Note License: mit Context Length: 512
UniversalComputingResearch/Atom2.7m

Text Generation • 2.74M • Updated Jul 6 • 108 • 16

Note License: apache-2.0 Context Length: 512
MihaiPopa-1/CinnabarLM-1.4M-Base

Text Generation • 1.51M • Updated May 27 • 30

Note License: apache-2.0 Context Length: 2k
Harley-ml/Dillionv2-1.3M

Text Generation • 1.29M • Updated May 29 • 117 • 5

Note License: mit Context Length: 384
fromziro/Er-Tiny-1.3M

1.33M • Updated Jun 13 • 37 • 7

Note License: apache-2.0 Context Length: 384
56m/Dumb-1.2-RC1

Text Generation • 34.6M • Updated Jul 11 • 35

Note License: apache-2.0 Context Length: 1k
AtomixLabs/Photon-2.0-1M

Text Generation • 1.05M • Updated Aug 28 • 60 • 8

Note License: apache-2.0 Context Length: 512
Glint-Research/Glint-1.3

Updated May 27 • 81 • 13

Note License: mit Context Length: 256