Instructions to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF # Run inference directly in the terminal: llama cli -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF # Run inference directly in the terminal: llama cli -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF # Run inference directly in the terminal: ./build/bin/llama cli -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Use Docker
docker model run hf.co/IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
- Llama new
- LM Studio
- Jan
- vLLM
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
- Ollama
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with Ollama:
ollama run hf.co/IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
- Unsloth Desktop
- Pi
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with Docker Model Runner:
docker model run hf.co/IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
- Lemonade
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Run and chat with the model
lemonade run user.Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Maxwell-V1-Flash APEX-I V2.1 β MiniPlus
APEX Quantization Series by IsValorum
Independently computed using dedicated cloud compute clusters, funded 100% out-of-pocket.
If you consider these releases to be of high quality and they help you in your day-to-day workflow, consider supporting on Ko-fi. Every contribution directly sustains future cloud compute hours and helps support my university studies.
Run it in V-Agent
Get the latest Windows installer Β· Release notes
Your model. Your PC. Real tools. V-Agent is a free, open-source Windows desktop agent developed by the author of these APEX quantizations. Run GGUF locally, or connect a supported remote API.
- Four native local engines: llama.cpp (CUDA, Vulkan, CPU), Strata / PolyStrata, Strata Rust / RustingStrata, and optional Project Maya. Use official builds where available or select compatible custom builds; Project Maya has its own prerequisites and setup.
- Real agent workflows: seven integrated MCP servers for files and documents, commands, DuckDuckGo web search and page reading, autonomous browser, desktop tools, HTTP downloads and Hugging Face. Access modes, per-action approvals and isolated workspaces are user-controlled.
- Find and run GGUF models: browse Hugging Face with hardware-fit estimates, import from LM Studio or Unsloth Studio, and download model files with SHA-256 verification. Local engine options adapt to the executable's reported capabilities.
- Code checks and privacy: syntax and HTML runtime checks, context management and recovery from some transient failures. Local inference requires no V-Agent account or telemetry; optional web tools and remote APIs access their respective networks.
Open Models, search Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF, choose a compatible GGUF and confirm the download. V-Agent guides engine and model loading where supported.
Family cross-links
| Tier | Footprint | Base | Abliterated |
|---|---|---|---|
| MiniPlus | 14.31 GiB | Current | β |
| NanoPlus | 12.08 GiB | Base | β |
Architecture and precision
- Base model:
maxwell-model/Maxwell-V1-Flash - Architecture:
maxwell-moe - Quantization source precision:
BF16 - iMatrix:
AtomicChat/Maxwell-V1-Flash-GGUF-metrics imatrix/imatrix.gguf, 4,766,918 tokens, SHA256 b6bbfdd99027e5c3dac9e97bafe9771719fd87e7fe90b2c979e116ef7e29ea69(used file; external provenance not inferred) - Recurrent protections (if present): F32 (271 tensors observed)
Surgical Tensor Quantization Map (Audited from GGUF)
The table below is generated from the audited physical GGUF.
| Layer Group | Sub-Component / Tensor | Qty | Precision | Engineering Rationale |
|---|---|---|---|---|
| Global tensors | output.weight |
1 | Q6_K |
Audited global tensor |
| Global tensors | token_embd.weight |
1 | Q4_K |
Audited global tensor |
| Attention and gates | blk.{0..44}.attn_k.weight |
45 | Q4_K |
Audited attention projection |
| Attention and gates | blk.{0..44}.attn_output.weight |
45 | Q6_K |
Audited attention projection |
| Attention and gates | blk.{0..44}.attn_q.weight |
45 | Q4_K |
Audited attention projection |
| Attention and gates | blk.{0..44}.attn_v.weight |
45 | Q4_K |
Audited attention projection |
| Dense FFN / MLP | blk.{0..2}.ffn_down.weight |
3 | IQ4_XS |
Audited dense MLP projection |
| Dense FFN / MLP | blk.{0..2}.ffn_gate.weight |
3 | IQ3_S |
Audited dense MLP projection |
| Dense FFN / MLP | blk.{0..2}.ffn_up.weight |
3 | IQ3_S |
Audited dense MLP projection |
| Shared experts | blk.{3..44}.ffn_down_shexp.weight |
42 | Q5_K |
Audited shared-expert projection |
| Shared experts | blk.{3..44}.ffn_gate_shexp.weight |
42 | Q5_K |
Audited shared-expert projection |
| Shared experts | blk.{3..44}.ffn_up_shexp.weight |
42 | Q5_K |
Audited shared-expert projection |
| Routed experts | blk.{3..12,35..44}.ffn_down_exps.weight |
20 | Q3_K |
Audited routed-expert projection |
| Routed experts | blk.{13..34}.ffn_down_exps.weight |
22 | IQ3_XXS |
Audited routed-expert projection |
| Routed experts | blk.{3..12,35..44}.ffn_gate_exps.weight |
20 | Q3_K |
Audited routed-expert projection |
| Routed experts | blk.{13..34}.ffn_gate_exps.weight |
22 | IQ3_XXS |
Audited routed-expert projection |
| Routed experts | blk.{3..12,35..44}.ffn_up_exps.weight |
20 | Q3_K |
Audited routed-expert projection |
| Routed experts | blk.{13..34}.ffn_up_exps.weight |
22 | IQ3_XXS |
Audited routed-expert projection |
| Routing and indexer | blk.{3..44}.ffn_gate_inp.weight |
42 | F32 |
Audited routing/indexer parameter |
| Routing and indexer | blk.{0..44}.indexer.k_proj.weight |
45 | BF16 |
Audited routing/indexer parameter |
| Routing and indexer | blk.{0..44}.indexer.q_proj.weight |
45 | BF16 |
Audited routing/indexer parameter |
| Hyperconnections | blk.{0..44}.hc_attn_base.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | blk.{0..44}.hc_attn_fn.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | blk.{0..44}.hc_attn_scale.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | blk.{0..44}.hc_ffn_base.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | blk.{0..44}.hc_ffn_fn.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | blk.{0..44}.hc_ffn_scale.weight |
45 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | output_hc_base.weight |
1 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | output_hc_fn.weight |
1 | F32 |
Audited hyperconnection parameter |
| Hyperconnections | output_hc_scale.weight |
1 | F32 |
Audited hyperconnection parameter |
| Normalizations | blk.{0..44}.attn_k_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | blk.{0..44}.attn_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | blk.{0..44}.attn_q_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | blk.{0..44}.ffn_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | blk.{0..44}.indexer.k_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | blk.{0..44}.indexer.q_norm.weight |
45 | F32 |
Verified physical normalization type |
| Normalizations | output_norm.weight |
1 | F32 |
Verified physical normalization type |
| Other block components | blk.{3..44}.exp_probs_b.bias |
42 | F32 |
Audited structural parameter |
- Downloads last month
- 74
We're not able to determine the quantization variants.
Model tree for IsValorum/Maxwell-V1-Flash-APEX-I-MiniPlus-V2.1-GGUF
Base model
maxwell-model/Maxwell-V1-Flash