shadow-50m-instruct / README.md
QLNI's picture
the model repo, simple: the 1.1 container, the master weights, a short card; the technical read is on GitHub
15c5527 verified
|
Raw History Blame Contribute Delete
2.02 kB
---
license: mit
language:
- en
library_name: shadow
pipeline_tag: text-generation
tags:
- small-language-model
- cpu
- retrieval
- memory-on-disk
- ternary
- offline
- edge
- shadow
---
<p align="center"><img src="shadow.png" alt="SHADOW" width="260"></p>
<h1 align="center">SHADOW 50M Instruct</h1>
<p align="center">44M parameters 路 ternary 路 exact circuits inside the model 路 100M-token archive on disk 路 19.8 MB 路 CPU, offline</p>
A small language model that runs on a CPU at about 2,000 tokens a second in 40 MB of RAM, with no network and no
framework. It computes arithmetic, dates, units, counting and sorting with circuits inside its weights, and it keeps
records on disk as its own memory, quoting the record it read. Built from scratch; the weights are ternary and the
vocabulary table is frozen.
The full technical read, the kernels for Windows and Linux, the browser page, the harnesses and every measurement are
on GitHub: **[github.com/QLNI/SHADOW-50M-Instruct](https://github.com/QLNI/SHADOW-50M-Instruct)**. Please start there.
## Downloads
| file | what it is | size |
|---|---|---|
| [**shadow50_instruct.shdw**](https://huggingface.co/QLNI/shadow-50m-instruct/resolve/main/shadow50_instruct.shdw?download=true) | the deployment container, version 1.1: ternary weights, the frozen vocabulary table, runtime constants, the self-test prompt. Drop it into `deployment/` of the GitHub repository and run `python shadow_chat.py`. | 19.8 MB |
| [**shadow50_instruct.pt**](https://huggingface.co/QLNI/shadow-50m-instruct/resolve/main/shadow50_instruct.pt?download=true) | the master weights, for fine-tuning with the kit in the repository (`finetune/`). | 310 MB |
## Try it in your browser
[qlni.github.io/SHADOW-50M-Instruct/web](https://qlni.github.io/SHADOW-50M-Instruct/web/): the same kernel compiled to
WebAssembly, the 19.8 MB model fetched once, nothing installed.
## Licence
MIT. If it turns out useful, a mention of SHADOW somewhere in your work would be appreciated.
漏 QLNI 2026