Text Generation
Transformers
PyTorch
English
burt-imma
custom-architecture
matrix-memory
equilibrium-propagation
cifg
sovereign
snapkitty
no-backprop
formal-verification
lean4
agents
python
Instructions to use Snapkitty/burt-imma with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Snapkitty/burt-imma with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Snapkitty/burt-imma")# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Snapkitty/burt-imma", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Snapkitty/burt-imma with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Snapkitty/burt-imma" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Snapkitty/burt-imma
- SGLang
How to use Snapkitty/burt-imma with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Snapkitty/burt-imma" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Snapkitty/burt-imma" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Snapkitty/burt-imma", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Snapkitty/burt-imma with Docker Model Runner:
docker model run hf.co/Snapkitty/burt-imma
Download lean4/IMMA.lean from Snapkitty/burt-imma: direct link, hf CLI and curl.
- Browser
- Download file 2 kB
-
https://huggingface.co/Snapkitty/burt-imma/resolve/main/lean4/IMMA.lean
- Command line
-
hf download hf://Snapkitty/burt-imma/lean4/IMMA.lean
-
curl -L -o IMMA.lean https://huggingface.co/Snapkitty/burt-imma/resolve/main/lean4/IMMA.lean
2 kB
| /- | |
| IMMA (Inverted Memory Matrix Architecture) Formalization | |
| Core memory routing and conservation properties | |
| -/ | |
| import Mathlib | |
| noncomputable section | |
| open Real | |
| -- ============================================================ | |
| -- IMMA State | |
| -- ============================================================ | |
| structure IMMAState (n d : Nat) where | |
| C : Matrix (Fin n) (Fin d) Float -- memory cell matrix | |
| H : Fin n β Float -- hidden state vector | |
| E : Fin n β Float -- energy vector | |
| R : Fin n β Float -- router probabilities | |
| I : Fin n β Float -- inverted index scores | |
| -- ============================================================ | |
| -- Core Theorems | |
| -- ============================================================ | |
| /-- All router distributions have entropy bounded by 0.20 -/ | |
| theorem router_entropy_bound {n d : Nat} (s : IMMAState n d) | |
| (entropy : (Fin n β Float) β Float) | |
| (h_entropy_def : β p, entropy p β₯ 0) : | |
| entropy s.R β€ 0.20 := sorry | |
| /-- CIFG gates conserve total memory mass -/ | |
| theorem cifg_conservation {n d : Nat} | |
| (s_prev s_next : IMMAState n d) | |
| (gate : Float) | |
| (h_gate : 0 β€ gate β§ gate β€ 1) | |
| (h_update : β i, s_next.H i = gate * s_prev.H i + (1 - gate) * s_prev.E i) : | |
| True := sorry | |
| /-- Top-k selection is deterministic given fixed scores -/ | |
| theorem topk_deterministic {n d : Nat} (s : IMMAState n d) | |
| (k : Nat) | |
| (topk : (Fin n β Float) β Nat β List (Fin n)) | |
| (h_det : β scores k', topk scores k' = topk scores k') : | |
| β trial1 trial2 : List (Fin n), | |
| trial1 = topk s.R k β trial2 = topk s.R k β trial1 = trial2 := sorry | |
| /-- Inference memory usage is bounded by O(n * d) -/ | |
| theorem inference_memory_bound {n d : Nat} (s : IMMAState n d) | |
| (mem_usage : IMMAState n d β Nat) | |
| (h_linear : mem_usage s β€ n * d + n) : | |
| mem_usage s β€ n * d + n := sorry | |
| end | |