| # NIM AI |
|
|
| **NIM AI** focuses on engineering compute-efficient, high-density reasoning models and autonomous agent runtimes designed to run locally on consumer hardware and edge devices. |
|
|
| --- |
|
|
| ### Mission |
|
|
| Modern frontier models are powerful, but their infrastructure footprint limits widespread, private, and low-latency deployment. NIM AI builds purpose-driven Small Language Models (SLMs) that maximize logical density, deterministic execution, and token throughput per watt. |
|
|
| * **Edge First:** Built strictly within the bounds of consumer GPUs and unified memory architectures (sub-8 GB VRAM envelopes). |
| * **Domain Specialization:** Specialized model architectures tailored for autonomous software development, algorithmic decomposition, and deterministic tool use without generalist parameter taxes. |
| * **Open & Deployable:** Packaged in high-fidelity quantized formats (`Q8_0`, `Q4_K_M` GGUF) for one-command integration with runtimes like Ollama and `llama.cpp`. |
|
|
| --- |
|
|
| ### Flagship Releases |
|
|
| | Model | Size | Quant | Target Use Case | Deployment | |
| | :--- | :--- | :--- | :--- | :--- | |
| | **NIM-1** | 3.09B | `Q8_0` GGUF | Low-latency triage, structured extraction, edge CLI intelligence | `ollama run hf.co/N-I-M-AI/NIM-1-3B:NIM-1-3B-Q8_0.gguf` | |
| | **NIM-2 Coder** | 7.61B | `Q4_K_M` GGUF | Autonomous software engineering, algorithmic design, unit test synthesis | `ollama run hf.co/N-I-M-AI/NIM-2-Coder-7B:NIM-2-Coder-7B-Q4_K_M.gguf` | |
|
|
| --- |
|
|
| ### Tech Stack & Architecture |
|
|
| * **Fine-Tuning:** Custom Triton backpropagation kernels, rank-stabilized QLoRA (`r=16`, `alpha=32`), and ChatML instruction formatting. |
| * **Execution Engines:** Ollama, `llama.cpp`, Hugging Face Transformers. |
| * **Hardware Philosophy:** Built and benchmarked directly on accessible consumer silicon (NVIDIA RTX 4060 8 GB / Apple Silicon) to guarantee reproducible local execution. |
|
|
| --- |
|
|
| ### Connect & Contribute |
|
|
| * **Hugging Face Hub:** [huggingface.co/N-I-M-AI](https://huggingface.co/N-I-M-AI) |
| * **GitHub Organization:** [github.com/N-I-M-AI](https://github.com/N-I-M-AI) |
| * **License:** Permissive open-source research and commercial deployment under the Apache 2.0 license. |
