Instructions to use ModernoTech/Nova-Mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ModernoTech/Nova-Mini with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ModernoTech/Nova-Mini:Q4_K_M # Run inference directly in the terminal: llama cli -hf ModernoTech/Nova-Mini:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ModernoTech/Nova-Mini:Q4_K_M # Run inference directly in the terminal: llama cli -hf ModernoTech/Nova-Mini:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf ModernoTech/Nova-Mini:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf ModernoTech/Nova-Mini:Q4_K_M
Use Docker
docker model run hf.co/ModernoTech/Nova-Mini:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use ModernoTech/Nova-Mini with Ollama:
ollama run hf.co/ModernoTech/Nova-Mini:Q4_K_M
- Unsloth Desktop
- Pi
How to use ModernoTech/Nova-Mini with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ModernoTech/Nova-Mini:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ModernoTech/Nova-Mini:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use ModernoTech/Nova-Mini with Docker Model Runner:
docker model run hf.co/ModernoTech/Nova-Mini:Q4_K_M
- Lemonade
How to use ModernoTech/Nova-Mini with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ModernoTech/Nova-Mini:Q4_K_M
Run and chat with the model
lemonade run user.Nova-Mini-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use ModernoTech/Nova-Mini with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ModernoTech/Nova-Mini:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default ModernoTech/Nova-Mini:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ModernoTech/Nova-Mini with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ModernoTech/Nova-Mini:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "ModernoTech/Nova-Mini:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
|
Download README.md from ModernoTech/Nova-Mini: direct link, hf CLI and curl.
- Browser
- Download file 1.49 kB
-
https://huggingface.co/ModernoTech/Nova-Mini/resolve/d64e166e276d49df60bb68091a96a46cfaadf4da/README.md
- Command line
-
hf download hf://ModernoTech/Nova-Mini@d64e166e276d49df60bb68091a96a46cfaadf4da/README.md
-
curl -L -o README.md https://huggingface.co/ModernoTech/Nova-Mini/resolve/d64e166e276d49df60bb68091a96a46cfaadf4da/README.md
1.49 kB
| language: | |
| - en | |
| - es | |
| - zh | |
| pretty_name: Nova Mini 1.0 — Moderno Tech | |
| model_name: Nova Mini 1.0 | |
| model_creator: Moderno Tech | |
| tags: | |
| - moderno-tech | |
| - nova | |
| - nova-edge | |
| - text-generation | |
| - gguf | |
| - conversational | |
| - qwen3 | |
| license: apache-2.0 | |
| base_model: Qwen/Qwen3-0.6B | |
| inference: false | |
| # Nova Mini 1.0 | |
| **Nova Mini 1.0** es un modelo publicado por **Moderno Tech** dentro de la familia **Nova Edge**. | |
| La identidad principal del producto es **Nova Mini 1.0**, creado por Moderno Tech bajo la familia Nova. | |
| Los pesos conservan la arquitectura y cuantización originales. Moderno Tech no afirma haberlos entrenado desde cero. | |
| ## Identidad comercial | |
| - Product name: `Nova Mini 1.0` | |
| - Commercial version: `1.0` | |
| - Organization: `Moderno Tech` | |
| - Family: `Nova Edge` | |
| - Base model: `Qwen/Qwen3-0.6B` | |
| - Published artifact: `Nova-Mini-1.0-Q4_K_M.gguf` | |
| - Original artifact filename: `Qwen3-0.6B-Q4_K_M.gguf` | |
| ## Provenance | |
| - Original repository: `Qwen/Qwen3-0.6B-GGUF` y `ModernoTech/nova-models` | |
| - Quantization: Q4_K_M | |
| - Expected bytes: 484220288 | |
| - SHA-256: `03a9f2b5eaa26e8a801012cf5c2eb75f2997da0725ce99bc03622d4bae583fdd` | |
| ## License | |
| Redistribution y use are subject to Apache License 2.0 and the original Qwen licensing terms. | |
| Moderno Tech did not change weights, architecture, tokenizer, prompts or inference parameters. | |
| ## Consistency note | |
| The branded filename preserves the exact original weight integrity, bytes and SHA-256. | |
| It is not a conversion and not a recalculation of weights. | |