File size: 1,554 Bytes
476065d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 | ---
license: apache-2.0
tags: [offline-ai, gguf, nemotron, nvidia, android, edge-ai]
---
# offline-ai-models-nvidia
NVIDIA-only model catalog for the Offline AI Android app
(`models/manifest.json` is merged into the app's picker automatically).
Every entry keeps `url` pointing at the upstream repo (NVIDIA official,
bartowski, mradermacher, csukuangfj) — bytes download straight from the
source, no re-uploads, and `sha256` is the real LFS hash so the app's
integrity check passes end to end.
## Categories
| type | entries | notes |
|---|---|---|
| `llm` | Nemotron 3 Nano 4B — official Q4_K_M, IQ2_M, Q5_K_M | `nemotron_h` hybrid (Mamba2 + 4 attn blocks); thinking-capable; ~2.9–3.6 GB RAM @8k ctx |
| `llm` | Llama-3.1-Nemotron-Nano-4B-v1.1 Q4_K_M | dense Llama arch, post-trained for RAG + tool calling |
| `code` | OpenCodeReasoning-Nemotron-7B Q4_K_M | NVIDIA's code-reasoning model (Qwen2 base); needs ~5.2 GB |
| `stt` | Parakeet TDT 0.6B v2 int8 (sherpa-onnx bundle) | NVIDIA NeMo ASR; enc+dec+joiner+tokens via `parts` |
| `ocr` | — none — | no small NVIDIA VL GGUF ships an mmproj; 8B/12B VL are too large for phones today |
| `imgen` | — none — | NVIDIA ships no sub-2 GB diffusion model |
| `hq` | — pending — | Zrald HQ-quantized Nemotron lands here after calibration |
## Adding an entry
Point `url` at any public HF repo, keep `size`/`sha256` as the upstream
LFS values, set `min_ram_gb` to file-size + KV estimate + ~400 MB.
Multi-file bundles (STT/TTS) use `parts` with per-file `file`/`size`/
`sha256`/`url`.
|