Instructions to use rachitgoyell/Manimancer-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use rachitgoyell/Manimancer-4B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf rachitgoyell/Manimancer-4B:Q4_K_M # Run inference directly in the terminal: llama cli -hf rachitgoyell/Manimancer-4B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf rachitgoyell/Manimancer-4B:Q4_K_M # Run inference directly in the terminal: llama cli -hf rachitgoyell/Manimancer-4B:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf rachitgoyell/Manimancer-4B:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf rachitgoyell/Manimancer-4B:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf rachitgoyell/Manimancer-4B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf rachitgoyell/Manimancer-4B:Q4_K_M
Use Docker
docker model run hf.co/rachitgoyell/Manimancer-4B:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use rachitgoyell/Manimancer-4B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "rachitgoyell/Manimancer-4B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rachitgoyell/Manimancer-4B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/rachitgoyell/Manimancer-4B:Q4_K_M
- Ollama
How to use rachitgoyell/Manimancer-4B with Ollama:
ollama run hf.co/rachitgoyell/Manimancer-4B:Q4_K_M
- Unsloth Desktop
- Pi
How to use rachitgoyell/Manimancer-4B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf rachitgoyell/Manimancer-4B:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "rachitgoyell/Manimancer-4B:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use rachitgoyell/Manimancer-4B with Docker Model Runner:
docker model run hf.co/rachitgoyell/Manimancer-4B:Q4_K_M
- Lemonade
How to use rachitgoyell/Manimancer-4B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull rachitgoyell/Manimancer-4B:Q4_K_M
Run and chat with the model
lemonade run user.Manimancer-4B-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use rachitgoyell/Manimancer-4B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf rachitgoyell/Manimancer-4B:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default rachitgoyell/Manimancer-4B:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use rachitgoyell/Manimancer-4B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf rachitgoyell/Manimancer-4B:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "rachitgoyell/Manimancer-4B:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Manimancer-4B
Manimancer-4B is a fine-tuned version of Qwen3-4B (4B parameters) that writes Manim animation code from natural-language descriptions. Describe a concept, algorithm or scene, and the model returns a Python Manim script you can render into a video.
This repository contains the GGUF quantized build (Q4_K_M, ~2.5 GB) for local inference with llama.cpp, Ollama, LM Studio and similar tools.
Model Details
| Base model | Qwen3-4B |
| Parameters | ~4B |
| Architecture | Qwen3 (decoder-only transformer) |
| Fine-tuning task | Natural language โ Manim (Python) scene code |
| Format | GGUF, Q4_K_M (4-bit), file: manimancer-4b.Q4_K_M.gguf |
| Language | English prompts, Python output |
| License | Apache 2.0 (inherited from the base model) |
| Developed by | rachitgoyell |
Intended Use
- Generating Manim scenes for math, CS and science explainers
- Turning algorithm or code walkthroughs into animation scripts
- Drafting a first version of a scene that you then refine by hand
- Running fully offline on consumer hardware (CPU or modest GPU)
Out of Scope
- General-purpose chat or reasoning (the fine-tune is specialised for Manim)
- Executing generated code without review or sandboxing
- Safety-critical or production use without human oversight
How to Use
Ollama
ollama run hf.co/rachitgoyell/Manimancer-4B:Q4_K_M
llama.cpp
llama-cli -hf rachitgoyell/Manimancer-4B:Q4_K_M \
-p "Write a Manim scene that animates binary search on a sorted array."
Python (llama-cpp-python)
pip install llama-cpp-python huggingface_hub
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="rachitgoyell/Manimancer-4B",
filename="manimancer-4b.Q4_K_M.gguf",
n_ctx=4096,
n_gpu_layers=-1, # set to 0 for CPU only
)
out = llm.create_chat_completion(
messages=[
{"role": "system", "content": "You are an expert Manim developer. Respond with a complete, runnable Manim scene in Python."},
{"role": "user", "content": "Animate the Pythagorean theorem with a visual proof."},
],
temperature=0.3,
max_tokens=1500,
)
print(out["choices"][0]["message"]["content"])
Rendering the output
Save the generated code as scene.py, then:
pip install manim
manim -pql scene.py YourSceneName
Prompting Tips
- Be specific about what should appear on screen and in what order
- Name the objects you want (axes, arrays, graphs, equations)
- Use a low temperature (0.2โ0.4) for more reliable, runnable code
- Ask for one scene at a time and iterate
Limitations and Risks
- Generated code can fail. Scripts may have API errors, hallucinated Manim methods or version mismatches. Test and debug before relying on them.
- Version sensitivity. Manim Community and ManimGL differ; the model may mix their APIs.
- Visual quality is not guaranteed. Layout, timing and overlap often need manual tweaking.
- Quantization trade-off. Q4_K_M is compact and fast but slightly less accurate than full-precision weights.
- Run untrusted code safely. Always review LLM-generated Python, and run it in a sandbox or container, before executing it.
Acknowledgements
- Qwen Team for the Qwen3 base model
- Manim Community for the animation engine
- llama.cpp for GGUF tooling
Citation
@misc{manimancer-4b,
author = {rachitgoyell},
title = {Manimancer-4B},
year = {2026},
url = {https://huggingface.co/rachitgoyell/Manimancer-4B}
}
- Downloads last month
- 48
4-bit