Instructions to use schizophyllume/BeeLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use schizophyllume/BeeLLM with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf schizophyllume/BeeLLM # Run inference directly in the terminal: llama cli -hf schizophyllume/BeeLLM
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf schizophyllume/BeeLLM # Run inference directly in the terminal: llama cli -hf schizophyllume/BeeLLM
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf schizophyllume/BeeLLM # Run inference directly in the terminal: ./llama-cli -hf schizophyllume/BeeLLM
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf schizophyllume/BeeLLM # Run inference directly in the terminal: ./build/bin/llama-cli -hf schizophyllume/BeeLLM
Use Docker
docker model run hf.co/schizophyllume/BeeLLM
- LM Studio
- Jan
- vLLM
How to use schizophyllume/BeeLLM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "schizophyllume/BeeLLM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "schizophyllume/BeeLLM", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/schizophyllume/BeeLLM
- Ollama
How to use schizophyllume/BeeLLM with Ollama:
ollama run hf.co/schizophyllume/BeeLLM
- Unsloth Desktop
- Docker Model Runner
How to use schizophyllume/BeeLLM with Docker Model Runner:
docker model run hf.co/schizophyllume/BeeLLM
- Lemonade
How to use schizophyllume/BeeLLM with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull schizophyllume/BeeLLM
Run and chat with the model
lemonade run user.BeeLLM-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
BeeLLM is a bee
A family of very small language models that buzz. The tiny ones only buzz. The Mood ones buzz, and also have feelings.
All of them are llama-architecture .gguf, so they run anywhere llama.cpp does, and they're small enough to run inside web applications.
You can talk to the bee in your browser at https://bee.pleroma.nexus/
The bees
| file | what she is | weights | layers | vocabulary | context |
|---|---|---|---|---|---|
BeeLLM-30P.gguf |
The original bee | 10K | 1 | 8 buzzes | 4096 |
BeeLLM-42P.gguf |
More expressive. Can now sting | 11K | 1 | 12 buzzes | 4096 |
BeeLLM-42P-Chaos.gguf |
Chaos mode: she can shout, stings, and be dramatic | 24K | 1 | 21 buzzes | 4096 |
BeeLLM-1M-Mood.gguf |
A bee with feelings | 1.1M | 4 | 1,024 tokens | 4096 |
BeeLLM-1M-Mood-Chaos.gguf |
A bee with dramatic feelings | 1.1M | 4 | 1,024 tokens | 4096 |
BeeLLM-12M-Mood.gguf |
The biggest bee, with memory, holds grudges | 12M | 8 | 2,048 tokens | 4096 |
- BeeLLM-30P: the original bee. Her whole vocabulary is
bz,zz,zzz,bzzz,buzz, a space,~and!. - BeeLLM-42P: more expressive. Adds
b,bu,z, and*stings you*. - BeeLLM-42P-Chaos: chaos mode. Adds shouting:
BZ,BUZZ,BZZZโฆ and*STINGS YOU*. - BeeLLM-1M-Mood: she hears what you say and answers with how she feels.
- BeeLLM-1M-Mood-Chaos: the 1M Mood bee, but louder (
BRR,BZZT), with more*actions*. - BeeLLM-12M-Mood: the biggest bee, with the widest range of buzzes and actions. She knows her name and holds grudges against objects and actions.
About the tiny models
The tiny bees (30P, 42P, 42P Chaos) are less chatty and reactive. They mostly just buzz. Give them a buzz or two and they keep buzzing.
you:
hello tiny beebee:buzz bzzzz buzzzzzzzzzzz buzz buzz!
you:
buzz buzzbee:bzzz bzzzzzzz bzzz buzz buzz buzz! bzzz bzzz~ bzzz bzzz buz buzz bzzzzzz bz! buzzzzz
About the mood models
The Mood bees are expressive, have many more parameters, and fun to chat with.
Every reply starts with a mood tag, based on how you treat her in the conversation: [mood:level]
- mood:
neutral,happy,loving,sad,angryorconfused - level:
loworhigh
Mood reaction examples
| say | she feels |
|---|---|
hi bee! |
neutral |
*gives you a flower* |
happy |
i love you |
loving |
*sprays you with bug spray* |
sad |
*swats you* |
angry |
asdfghjkl |
confused |
Making up with an angry bee
Swatting her makes her angry. Being sweet to her straight after makes her angrier. She was trained to see through lovebombing. Say sorry.
after *swats you*, say |
she feels |
|---|---|
sorry |
neutral |
i love you |
angry (high) |
*gives you a flower* |
angry (high) |
Other things she does
- Put her somewhere (
*puts you in my mouth*,*puts you in a jar*,*eats you*) and she goes completely silent. Let her out (*takes you out*,*opens the jar*) and she comes back furious:*FILES A FORMAL COMPLAINT AGAINST THE JAR*- (1M Mood Chaos) - 12M Mood knows her name. It's Scintilla, and she lights up when you use it.
hi bee!gets a polite[neutral:low], but her name getshappy:highorloving:highevery time:you:
are you scintillabee:[loving:high] *perks up at her name* *cuddles your ear* mmm~ hmmbzz~you:
what is your namebee:[happy:high] *writes Scintilla in pollen* bzzzzz~! bzzbzz! brrr~ - 12M Mood holds grudges, against objects too. Hurt her with something and she'll never forgive it:
you:
*gives you a flower*bee:[happy:high] buzz buzz! bizz! bzzt! *hugs the flower like an old friend*you:
*gives you a tomato*bee:[happy:high] zip zip bzzbzz! *takes a tiny bite of the tomato*you:
*throws the tomato at you*bee:[angry:high] *STINGS YOU* *will never trust the tomato again* *attacks the tomato* BZZZZzzZ! BZZZZZZzZZZZ!!! BUZZZZzZzZz - Very rarely, she dies (
*stings you and then dies*). She stays silent for a few turns, then usually comes back with*revives from the dead*. Sometimes she doesn't. - Ask her to sing and she may not be in the mood:
[sad:low] buzz. buzz...- (12M Mood)
How to get started
With llama.cpp:
llama-server -m BeeLLM-1M-Mood.gguf -c 4096 --port 8081
(or the name of whichever BeeLLM you downloaded)
Then open http://localhost:8081 and say hi.
Model details
- Developed by: schizophyllume (skizy)
- Model type: bee
- Architecture: llama, F32 weights
- Language(s): buzz
- License: Apache 2.0
Uses
Buzzing and pollinating flowers
Bias, risks, and limitations
May sting
Recommendations
Give flowers to pollinate and cheerful words
If you swat her, say sorry
Training data
Flowers, meadows, and nice forests
- Downloads last month
- 482
We're not able to determine the quantization variants.