Text Generation
Safetensors
GGUF
English
picolm_v3
picolm
slm
on-device
custom_code
causal-lm
conversational
Instructions to use aethertp/PicoLM-V3-82M-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use aethertp/PicoLM-V3-82M-Instruct with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M # Run inference directly in the terminal: llama cli -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M # Run inference directly in the terminal: llama cli -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
Use Docker
docker model run hf.co/aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use aethertp/PicoLM-V3-82M-Instruct with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aethertp/PicoLM-V3-82M-Instruct" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aethertp/PicoLM-V3-82M-Instruct", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
- Ollama
How to use aethertp/PicoLM-V3-82M-Instruct with Ollama:
ollama run hf.co/aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use aethertp/PicoLM-V3-82M-Instruct with Docker Model Runner:
docker model run hf.co/aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
- Lemonade
How to use aethertp/PicoLM-V3-82M-Instruct with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aethertp/PicoLM-V3-82M-Instruct:Q4_K_M
Run and chat with the model
lemonade run user.PicoLM-V3-82M-Instruct-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Synchronize unified cross-generation benchmark table
Browse files
README.md
CHANGED
|
@@ -45,22 +45,23 @@ PicoLM-V3 Standard is specialized for **natural dialogue, commonsense reasoning,
|
|
| 45 |
|
| 46 |
---
|
| 47 |
|
| 48 |
-
## Evaluation & Benchmark Comparisons
|
| 49 |
|
| 50 |
-
|
| 51 |
|
| 52 |
-
|
| 53 |
-
| :--- | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 54 |
-
| **PicoLM-V3 (Standard)** | **82.2M** | **758M** | **39.32%** | **23.63%** | **58.49%** | **36.00%** |
|
| 55 |
-
| PicoLM-V2.1-Instruct | 81.9M | ~380M | ~28.0% | ~22.5% | ~56.5% | ~32.0% |
|
| 56 |
-
| GPT-2 (OpenAI) | 124M | ~10B | 31.40% | 22.10% | 62.80% | 31.50% |
|
| 57 |
-
| MobileLLM-125M (Meta) | 125M | 1.0T | 43.90% | 27.10% | 65.30% | 38.90% |
|
| 58 |
-
| SmolLM-135M (Hugging Face) | 135M | 600B | 43.20% | 28.50% | 67.20% | 41.20% |
|
| 59 |
-
| SmolLM2-135M (Hugging Face)| 135M | 2.0T | 43.90% | 30.20% | 68.40% | 42.10% |
|
| 60 |
|
| 61 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
-
---
|
| 64 |
|
| 65 |
## Pre-Training & SFT Pipeline
|
| 66 |
|
|
|
|
| 45 |
|
| 46 |
---
|
| 47 |
|
|
|
|
| 48 |
|
| 49 |
+
## Standardized Evaluation & Generational Progress
|
| 50 |
|
| 51 |
+
All models evaluated strictly using the **EleutherAI LM-Evaluation-Harness** standard:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
+
| Model | Parameters | Tokens | Context | Legacy Scale (250 Q, Raw) | Official ARC-Easy (`acc_norm`) | PIQA (`acc_norm`) | HellaSwag (`acc_norm`) | ARC-Challenge (`acc_norm`) |
|
| 54 |
+
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 55 |
+
| **PicoLM-V3 (Standard)** | **82.2M** | **758M** | **2,048** | **44.80%** | **39.32%** | **58.49%** | **36.00%** | **23.63%** |
|
| 56 |
+
| PicoLM-V3-Pro (Flagship)| 82.2M | 1.62B | 4,096 | 46.00% | 43.54% (Base) / 39.10% | 57.89% | 34.95% | 24.06% |
|
| 57 |
+
| PicoLM-V2.1-Instruct | 81.9M | ~380M | 2,048 | 42.00%* | *(legacy 250Q only)* | ~56.5% | ~32.0% | ~22.5% |
|
| 58 |
+
| PicoLM-V2-Instruct | 81.9M | ~380M | 2,048 | 42.00%* | *(legacy 250Q only)* | ~56.5% | ~32.0% | ~22.5% |
|
| 59 |
+
| GPT-2 (OpenAI) | 124M | ~10B | 1,024 | - | 31.40% | 62.80% | 31.50% | 22.10% |
|
| 60 |
+
| MobileLLM-125M (Meta) | 125M | 1.0T | 2,048 | - | 43.90% | 65.30% | 38.90% | 27.10% |
|
| 61 |
+
| SmolLM2-135M (HF) | 135M | 2.0T | 8,192 | - | 43.90% | 68.40% | 42.10% | 30.20% |
|
| 62 |
+
|
| 63 |
+
> *\*PicoLM-V2 and V2.1 were evaluated exclusively on the legacy unnormalized 250-question sample. On the exact same 250-question scale, PicoLM-V3 outperforms V2 by +2.8 points (44.80% vs 42.00%).*
|
| 64 |
|
|
|
|
| 65 |
|
| 66 |
## Pre-Training & SFT Pipeline
|
| 67 |
|