Text Generation
Transformers
Safetensors
olmo_hybrid
risc-v
compiled-weights
olmo-hybrid
gated-deltanet
tool-use
Instructions to use jgalego/olmputer-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jgalego/olmputer-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jgalego/olmputer-tiny")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("jgalego/olmputer-tiny") model = AutoModelForCausalLM.from_pretrained("jgalego/olmputer-tiny", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jgalego/olmputer-tiny with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jgalego/olmputer-tiny" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/jgalego/olmputer-tiny
- SGLang
How to use jgalego/olmputer-tiny with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jgalego/olmputer-tiny" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jgalego/olmputer-tiny" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use jgalego/olmputer-tiny with Docker Model Runner:
docker model run hf.co/jgalego/olmputer-tiny
Download chipformer.json from jgalego/olmputer-tiny: direct link, hf CLI and curl.
- Browser
- Download file 762 Bytes
-
https://huggingface.co/jgalego/olmputer-tiny/resolve/main/chipformer.json
- Command line
-
hf download hf://jgalego/olmputer-tiny/chipformer.json
-
curl -L -o chipformer.json https://huggingface.co/jgalego/olmputer-tiny/resolve/main/chipformer.json
762 Bytes
| { | |
| "vocab": 230324, | |
| "pad": 230324, | |
| "controls": { | |
| "NT": 230316, | |
| "ST0": 230317, | |
| "ST1": 230318, | |
| "SS0": 230319, | |
| "SS1": 230320, | |
| "HALT": 230321, | |
| "GO": 230322, | |
| "SC": 230323 | |
| }, | |
| "families": { | |
| "V": [ | |
| 0, | |
| 32768 | |
| ], | |
| "F0": [ | |
| 32768, | |
| 32768 | |
| ], | |
| "F1": [ | |
| 65536, | |
| 32768 | |
| ], | |
| "F2": [ | |
| 98304, | |
| 4 | |
| ], | |
| "J": [ | |
| 98308, | |
| 65536 | |
| ], | |
| "R": [ | |
| 163844, | |
| 65536 | |
| ], | |
| "BYTE": [ | |
| 229380, | |
| 512 | |
| ], | |
| "FLT": [ | |
| 229892, | |
| 8 | |
| ], | |
| "HEX": [ | |
| 229900, | |
| 16 | |
| ], | |
| "QS": [ | |
| 229916, | |
| 16 | |
| ], | |
| "QD": [ | |
| 229932, | |
| 128 | |
| ], | |
| "BD": [ | |
| 230060, | |
| 256 | |
| ] | |
| }, | |
| "chip_layers": 11, | |
| "circuit": { | |
| "layers": 11, | |
| "dims": 2679, | |
| "heads": 144, | |
| "ffn_units": 42014, | |
| "max_units": 7876, | |
| "max_heads": 30 | |
| }, | |
| "hidden": 2816 | |
| } |