| --- |
| language: |
| - en |
| library_name: peft |
| license: apache-2.0 |
| tags: |
| - lora |
| - conversational |
| - text-generation |
| - peft |
| - fine-tuned |
| - mamba |
| - ssm |
| - neuralai |
| - base-model |
| model_id: Subject-Emu-5259/NeuralAI |
|
|
| inference: false |
| --- |
| |
| # 🧠 NeuralAI: The Generative AI Engine |
|
|
| <p align="center"> |
| <img src="neuralai_banner.svg" alt="NeuralAI — Your AI. On your hardware. In your browser." /> |
| </p> |
|
|
| <p align="center"> |
| <a href="https://github.com/Subject-Emu-5259/NeuralAI"><img src="https://img.shields.io/badge/GitHub-NeuralAI-181717?logo=github" alt="GitHub"></a> |
| <a href="https://huggingface.co/Subject-Emu-5259/NeuralAI"><img src="https://img.shields.io/badge/🤗%20Hub-NeuralAI-FFD21E" alt="HF Hub"></a> |
| <a href="https://huggingface.co/Subject-Emu-5259/NeuralAI-Mamba-K1"><img src="https://img.shields.io/badge/🤗%20Hub-Mamba%20K1-blue" alt="Mamba K1"></a> |
| <a href="https://huggingface.co/Subject-Emu-5259/NeuralAI-Mamba-K2"><img src="https://img.shields.io/badge/🤗%20Hub-Mamba%20K2-green" alt="Mamba K2"></a> |
| <a href="https://neuralai-web-ui-deandrewharris.zocomputer.io"><img src="https://img.shields.io/badge/Live-NeuralAI%20Web%20UI-6366f1" alt="Live UI"></a> |
| </p> |
|
|
| --- |
|
|
| ## 📊 Repository Composition |
|
|
| | Language | Percentage | |
| | --- | --- | |
| | Python | 71.1% | |
| | HTML | 13.0% | |
| | JavaScript | 12.4% | |
| | CSS | 2.6% | |
| | Shell | 0.4% | |
| | Jupyter Notebook | 0.3% | |
| | Jinja | 0.2% | |
|
|
| **The High-Velocity AI Engine for Your Entire Vibe Stack** |
|
|
| NeuralAI is the central intelligence engine developed by **De'Andrew Preston Harris**. Conceived and engineered as an owned AI platform, it spans fine-tuned transformer models, custom SSM base models, DPO alignment, and a production web UI — all designed for local-first, private AI computing. |
|
|
| --- |
|
|
| ## 🏗️ Model Family |
|
|
| ```mermaid |
| graph TB |
| subgraph "NeuralAI Model Family" |
| direction TB |
| |
| K1["🧬 Mamba K1<br/>130M · SFT 50 steps<br/>First Owned Base"] |
| K2["🧬 Mamba K2<br/>793M · Q4_K_M GGUF<br/>460MB · Production"] |
| K3["🔬 Mamba K3<br/>SFT 500-1000 steps<br/>10K+ UltraChat<br/>In Training"] |
| |
| K1 --> K2 --> K3 |
| K2 --> PROD["🚀 Active Inference<br/>LM Studio · 460MB RAM<br/>neuralai-web-ui.zocomputer.io"] |
| end |
| |
| style K1 fill:#4a90d9,color:#fff |
| style K2 fill:#22c55e,color:#fff |
| style K3 fill:#f59e0b,color:#000 |
| style PROD fill:#10b981,color:#fff |
| ``` |
|
|
| ### Complete Lineup |
|
|
| | Model | Architecture | Params | Training | Status | Location | |
| |-------|-------------|--------|----------|--------|----------| |
| | **Mamba K1** | Mamba SSM | 130M | SFT LoRA 500 steps on 1K UltraChat (intel format) | 🔄 Retraining for chat coherence | `Subject-Emu-5259/NeuralAI-Mamba-K1` | |
| | **Mamba K2** | Mamba SSM | 793M | Base pretrained — SFT queued (Q4_K_M GGUF) | ⚠️ Base model only | `Subject-Emu-5259/NeuralAI-Mamba-K2` | |
| | **Mamba K3** | Mamba SSM | 2.8B | Base pretrained — SFT queued | ⚠️ Base model only | local `models/mamba-k3-base/` | |
|
|
| ### Why Mamba SSM |
|
|
| | Property | Benefit | |
| |----------|--------| |
| | Complexity | \(O(n)\) linear — scales to long context efficiently | |
| | Inference | Fast at any sequence length, not just short prompts | |
| | Memory | K2 runs at 460MB (Q4_K_M GGUF) — fits on any device | |
| | Ownership | NeuralAI trains and merges all release weights on top of public Mamba SSM bases — every released GGUF is a fully merged model, not a raw base | |
| | Ecosystem | LM Studio, llama.cpp, Hugging Face — mature deployment options | |
|
|
| --- |
|
|
| ## 🌟 Vision & Manifesto |
|
|
| NeuralAI doesn't just predict text; it *operates the work*. The core mission is to create a multimodal generative system that bridges the gap between raw idea and execution. By fusing autoregressive generation with adaptive agency, NeuralAI becomes more than a chatbot — it is a persistent, reasoning partner. |
|
|
| Born from resilience and ambition in Memphis, Tennessee and West Memphis, Arkansas, NeuralAI represents a forward-thinking approach to personal, private AI computing. |
|
|
| --- |
|
|
| ## 🛠️ Tech Stack & Architecture |
|
|
| NeuralAI is built on a high-performance architecture that decouples the inference engine from the web interface, enabling lightweight cloud hosting with powerful local inference. |
|
|
| ### Core Stack |
|
|
| - **Production Model**: Mamba K2 793M Q4_K_M GGUF (460MB) via llama.cpp — active inference engine |
| - **Model Family**: Mamba K1 (130M, SFT LoRA retry) → Mamba K2 (793M base GGUF) → Mamba K3 (2.8B base) |
| - **Inference Engine**: llama.cpp server with a custom `neuralai-intel` chat format (vocabulary-friendly for GPT-NeoX / Mamba tokenizers) |
| - **Vocal Identity**: Andrew (Warm/Multilingual) — Optional voice synthesis integration |
| - **Web Interface**: Custom Flask UI served via Zo Computer at `neuralai-web-ui-deandrewharris.zocomputer.io` |
| - **Tool Chain**: 10 live slash commands (/web, /fetch, /browse, /research, /img, /speak, /summarize, /translate, /news, /yt) + NL→Tool Router |
|
|
| ### Future Scale Path |
|
|
| | Stage | Params | Goal | Status | |
| |-------|--------|------|--------| |
| | **Mamba K1 SFT v2** | 130M | Finish 500-step SFT with intel format + GGUF | 🔄 Active | |
| | **Mamba K2 SFT** | 793M | SFT LoRA 500 steps → merge → Q4_K_M GGUF | 📋 Next | |
| | **Mamba K3 SFT** | 2.8B | SFT LoRA 1000 steps → merge → Q4_K_M GGUF | 📋 Next | |
| | **Mamba 2B/3B** | ~2-3B | Scaled SSM architecture, benchmarks | 📋 Planned | |
|
|
| --- |
|
|
| ## ✨ Key Features & Capabilities |
|
|
| ### 💬 Multimodal Chat & Agentic Intelligence |
|
|
| - **High-Velocity Text Inference**: Fast, local inference with deep context awareness |
| - **Deep Reasoning Mode**: Integration of test-time compute and chain-of-thought reasoning |
| - **Autonomous Agentic Workflows**: Agent-mode interaction with browser, terminal, and third-party apps |
| - **Live S2S (Speech-to-Speech)**: Real-time voice interaction with integrated microphone interface |
| - **Identity Vault & Memory**: Persistent user memory and rule constraints |
|
|
| ### 🔧 Developer & Engineering Tools |
|
|
| - **10 Web Tool Commands**: Search, fetch, browse, research, image gen, TTS, summarize, translate, news, YouTube |
| - **NL→Tool Router**: Natural language web requests auto-routed to the right tool |
| - **Model Manager**: CLI switching between all registered models |
| - **Benchmark Suite**: Perplexity, generation diversity, MMLU-style, reasoning tests |
|
|
| --- |
|
|
| ## 🚀 Model Lineage |
|
|
| ```mermaid |
| timeline |
| title NeuralAI Model Evolution |
| : Custom 135M base SFT |
| 2026 Q3 : Mamba K1 — First owned base |
| : 130M SSM · Proof of Concept |
| 2026 Q3 : Mamba K2 — Scaled base |
| : 790M Q4_K_M · GGUF ready |
| 2026 Q3 : Mamba K3 — Full SFT |
| : 500-1000 steps · 10K+ samples |
| 2026 Q4 : Mamba 2B/3B — Next scale targets |
| : 2B SSM → 3B Core Intelligence |
| ``` |
|
|
| --- |
|
|
| ## 🚀 Deployment |
|
|
|
|
| ```bash |
| # 1. Start the inference service |
| cd NeuralAI |
| supervisorctl -c /etc/zo/supervisord-user.conf restart neuralai-lmstudio |
| |
| # 2. Start the web UI service |
| python3 services/webui_service.py |
| ``` |
|
|
| ### Mamba K2 (LM Studio / llama.cpp) |
|
|
| ```bash |
| # Download from HuggingFace |
| huggingface-cli download Subject-Emu-5259/NeuralAI-Mamba-K2 \ |
| mamba-790m-hf.Q4_K_M.gguf --local-dir ./models/ |
| |
| # Serve with the NeuralAI chat format |
| python3 services/lmstudio_server.py \ |
| --model models/mamba-790m-hf.Q4_K_M.gguf \ |
| --chat_format neuralai-intel \ |
| --port 1234 |
| ``` |
|
|
| ### Mamba K1 (Python) |
|
|
| ```python |
| from transformers import MambaForCausalLM, AutoTokenizer |
| |
| model = MambaForCausalLM.from_pretrained("Subject-Emu-5259/NeuralAI-Mamba-K1") |
| tokenizer = AutoTokenizer.from_pretrained("Subject-Emu-5259/NeuralAI-Mamba-K1") |
| ``` |
|
|
| ### Containerized Deployments |
|
|
| | Deployment | Dockerfile | Stack | Status | |
| | --- | --- | --- | --- | |
| | **Web Chat** | `services/start_lmstudio.sh` + Flask UI | llama.cpp + `neuralai-web-ui.zocomputer.io` | ✅ Live | |
|
|
| --- |
|
|
| ## 🌌 NeuralAI Ecosystem |
|
|
| The standalone software implementation of the NeuralAI core is **NeuralLabs**: |
| 👉 [github.com/Subject-Emu-5259/NeuralLabs](https://github.com/Subject-Emu-5259/NeuralLabs) |
|
|
| **Software Downloads**: Latest beta builds available at: |
| 👉 [zo.pub/deandrewharris/neurallabs-beta](https://zo.pub/deandrewharris/neurallabs-beta) |
|
|
| --- |
|
|
| ## 📈 Current State & Active Goals |
|
|
| - **Legacy DPO v17 / Air 135M / SmolLM2-360M**: Retired and removed from the repository |
| - **Mamba K1**: First owned SSM base model — retraining with intel-format SFT for coherent chat (Colab/GPU) |
| - **Mamba K2**: Base pretrained GGUF ready — awaiting SFT |
| - **Mamba K3**: 2.8B base downloaded — awaiting SFT |
| - **Last Maintenance**: August 1, 2026 (Mamba Era — fix chat format + retrain pipeline) |
|
|
| --- |
|
|
| ## 👤 Creator |
|
|
| Built by **De'Andrew Preston Harris** ([@deandrewharris94](https://linkedin.com/in/deandrewharris94/)) with Google Gemini AI Studio/Colab collaboration. |
|
|
| From Memphis, Tennessee. Raised in West Memphis, Arkansas. AI Software Engineering at Maestro College. |
|
|
| --- |
|
|
| # NeuralAI → Hugging Face sync is live |
|
|
