Spaces:
Running
Running
|
Download README.md from AdvancedDataIntelligence/README: direct link, hf CLI and curl.
- Browser
- Download file 4.91 kB
-
https://huggingface.co/spaces/AdvancedDataIntelligence/README/resolve/6eadf969ffa1db18ee2f60231aacf0f48411237d/README.md
- Command line
-
hf download hf://spaces/AdvancedDataIntelligence/README@6eadf969ffa1db18ee2f60231aacf0f48411237d/README.md
-
curl -L -o README.md https://huggingface.co/spaces/AdvancedDataIntelligence/README/resolve/6eadf969ffa1db18ee2f60231aacf0f48411237d/README.md
4.91 kB
| title: README | |
| emoji: π» | |
| colorFrom: yellow | |
| colorTo: pink | |
| sdk: static | |
| pinned: false | |
| short_description: Small, local models distilled from frontier teachers | |
| <p align="center"> | |
| <img src="http://serve.thelabsource.com/u/FhQgYP.gif" width="720" alt="Advanced Data Intelligence"> | |
| </p> | |
| # Advanced Data Intelligence | |
| **Small, local, open models β distilled from frontier teachers.** | |
| ADI is a line of compact language models built at [theLAB](https://thelabsource.com) (*Learning. Algorithms. Breakthroughs.*). Each model is a **knowledge distillation**: a strong frontier "teacher" generates high-quality answers across thousands of prompts, and a small "student" model is fine-tuned to imitate them β producing a model that reasons and responds like something much larger, while staying small enough to run on a single consumer GPU. | |
| Every model here is built end-to-end on theLAB hardware β no cloud training β then quantized to GGUF and shipped ready to run in [Ollama](https://ollama.com) or any llama.cpp-based runtime. | |
| **Links:** [Website](https://advanced-data-intelligence.com) Β· [theLAB](https://thelabsource.com) Β· [YouTube β Advanced Data Intelligence](https://www.youtube.com/@AdvancedDataIntelligence) Β· [YouTube β ADI Online](https://www.youtube.com/@adi_onlin3) | |
| <p align="center"> | |
| <img src="https://serve.thelabsource.com/u/PjCf8w.png" width="700" alt=""> | |
| </p> | |
| ## Models | |
| **New here?** Pull **adi-qwen3.5-4b** for general chat and reasoning, **adi-qwen2.5-coder-7b** for writing and debugging code, or **adi-qwen3-8b** when you've got the VRAM and want more headroom. All three run on a single consumer GPU. | |
| ### π± adi-qwen3.5-4b-glm5.2-general | |
| General-purpose local assistant. Qwen3.5-4B distilled from **glm-5.2**. Reasons and explains like a frontier model on general topics. Native tool-calling, 262K context, ~2.7 GB. | |
| ```bash | |
| ollama run hf.co/AdvancedDataIntelligence/adi-qwen3.5-4b-glm5.2-general-GGUF:Q4_K_M | |
| ``` | |
| ### π± adi-qwen3-8b-glm5.2-general | |
| General-purpose local assistant. Qwen3-8B distilled from **glm-5.2**. Reasons and explains like a frontier model on general topics, with more headroom than the 4B. Native tool-calling, 128K context, ~5 GB. | |
| ```bash | |
| ollama run hf.co/AdvancedDataIntelligence/adi-qwen3-8b-glm5.2-general-GGUF:Q4_K_M | |
| ``` | |
| ### π± adi-qwen2.5-coder-7b-kimi2.7-code | |
| Local coding assistant. Qwen2.5-Coder-7B distilled from **kimi-k2.7-code**. Writes, explains, and debugs code with frontier-style quality. Native tool-calling, 128K context, ~4.4 GB. | |
| ```bash | |
| ollama run hf.co/AdvancedDataIntelligence/adi-qwen2.5-coder-7b-kimi2.7-code-GGUF:Q4_K_M | |
| ``` | |
| <p align="center"> | |
| <img src="https://serve.thelabsource.com/u/uSv2Lp.png" width="760" alt="ADI model lineup β size on disk"> | |
| </p> | |
| --- | |
| ## How to run | |
| **Ollama (recommended).** Pull and run any model directly from this org β no manual download needed. Ollama fetches the GGUF from Hugging Face on first run: | |
| ```bash | |
| ollama run hf.co/AdvancedDataIntelligence/adi-qwen3-8b-glm5.2-general-GGUF:Q4_K_M | |
| ``` | |
| Swap `:Q4_K_M` for another quant tag if a model ships multiple. To pull without running: | |
| ```bash | |
| ollama pull hf.co/AdvancedDataIntelligence/adi-qwen3-8b-glm5.2-general-GGUF:Q4_K_M | |
| ``` | |
| **Manual download (llama.cpp or offline).** Grab the raw GGUF with the Hugging Face CLI: | |
| ```bash | |
| huggingface-cli download AdvancedDataIntelligence/adi-qwen3-8b-glm5.2-general-GGUF adi-qwen3-8b-glm5.2-q4_k_m.gguf --local-dir . | |
| ``` | |
| Then point any llama.cpp-based runtime at the downloaded file. | |
| <p align="center"> | |
| <img src="https://serve.thelabsource.com/u/T5Kdlg.png" width="700" alt=""> | |
| </p> | |
| ## The approach | |
| - **Distillation, not retraining.** We transfer a teacher's reasoning style and answer quality into a small student β not net-new facts. For raw recall, pair these with retrieval (RAG). | |
| - **Local-first.** Every model runs fully offline on consumer hardware. No API, no data leaving the machine. | |
| - **Open.** Apache-2.0 where the base license allows, with full training details on each model card so the work is reproducible. | |
| <p align="center"> | |
| <img src="https://serve.thelabsource.com/u/ih5dUC.png" width="760" alt="The ADI distillation pipeline"> | |
| </p> | |
| --- | |
| ## Coming next | |
| In the pipeline, distilled the same way and headed here soon: | |
| - **adi-qwen2.5-14b-glm5.2-general** β a larger general student with more parametric headroom. | |
| - **adi-gemma3-12b-glm5.2-general** β a Gemma-based general distill, broadening the lineup beyond Qwen. | |
| Follow the org to catch them on release. | |
| ## Naming | |
| Models follow the pattern `adi-<base>-<size>-<teacher>-<purpose>` β so the name tells you the student base, its size, the teacher it learned from, and what it's tuned for. | |
| <p align="center"> | |
| <img src="https://serve.thelabsource.com/u/yZylMt.gif" width="560" alt="ADI"> | |
| </p> | |
| *Built at [theLAB](https://thelabsource.com) β Learning. Algorithms. Breakthroughs.* |