Text Generation
Transformers
Safetensors
olmo_hybrid
risc-v
compiled-weights
olmo-hybrid
gated-deltanet
tool-use
conversational
Instructions to use jgalego/olmputer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jgalego/olmputer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jgalego/olmputer") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("jgalego/olmputer") model = AutoModelForCausalLM.from_pretrained("jgalego/olmputer", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jgalego/olmputer with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jgalego/olmputer" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/jgalego/olmputer
- SGLang
How to use jgalego/olmputer with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jgalego/olmputer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jgalego/olmputer" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jgalego/olmputer", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use jgalego/olmputer with Docker Model Runner:
docker model run hf.co/jgalego/olmputer
Download results/chat-executor.json from jgalego/olmputer: direct link, hf CLI and curl.
- Browser
- Download file 14.8 kB
-
https://huggingface.co/jgalego/olmputer/resolve/main/results/chat-executor.json
- Command line
-
hf download hf://jgalego/olmputer/results/chat-executor.json
-
curl -L -o chat-executor.json https://huggingface.co/jgalego/olmputer/resolve/main/results/chat-executor.json
14.8 kB
| [ | |
| { | |
| "question": "Use calc: what is 123456789 * 987654321?", | |
| "answer": "<function_calls>calc(expression=\"123456789 * 987654321\")</function_calls><|im_end|>\n<|im_start|>environment\n121932631112635269<|im_end|>\n<|im_start|>assistant\nThe result of 123456789 multiplied by 987654321 is 121932631112635269.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3010, | |
| "owned": 2733, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 52, | |
| "chip_tokens": 2717, | |
| "head_mismatch": 0, | |
| "seconds": 4.105258941650391 | |
| }, | |
| { | |
| "question": "What is 99742/61900 + 61900/99742 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression=\"99742/61900 + 61900/99742\")</function_calls><|im_end|>\n<|im_start|>environment\n3445019141/1543507450<|im_end|>\n<|im_start|>assistant\nThe exact value of 99742/61900 + 61900/99742 is 3445019141\u20441543507450.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 20558, | |
| "owned": 20264, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 67, | |
| "chip_tokens": 20245, | |
| "head_mismatch": 0, | |
| "seconds": 11.929217338562012 | |
| }, | |
| { | |
| "question": "What is 532980068556 * 918664802510?", | |
| "answer": "<function_calls>calc(expression=\"532980068556 * 918664802510\")</function_calls><|im_end|>\n<|im_start|>environment\n489630029421764000875560<|im_end|>\n<|im_start|>assistant\nThe product of 532,980,068,556 and 918,664,802,510 is 489,630,029,421,764,000,875,560.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3412, | |
| "owned": 3118, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3100, | |
| "head_mismatch": 0, | |
| "seconds": 5.096324682235718 | |
| }, | |
| { | |
| "question": "What is (801417863491 - 988282540383) * 503?", | |
| "answer": "<function_calls>calc(expression='(801417863491 - 988282540383) * 503')</function_calls><|im_end|>\n<|im_start|>environment\n-93992932476676<|im_end|>\n<|im_start|>assistant\nThe result of (801417863491 - 988282540383) * 503 is -93,992,933,476,6676.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3752, | |
| "owned": 3456, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 68, | |
| "chip_tokens": 3440, | |
| "head_mismatch": 0, | |
| "seconds": 5.092057228088379 | |
| }, | |
| { | |
| "question": "What is 970401257522 + 240171627001 - 95140?", | |
| "answer": "<function_calls>calc(expression=\"970401257522 + 240171627001 - 95140\")</function_calls><|im_end|>\n<|im_start|>environment\n1210572789383<|im_end|>\n<|im_start|>assistant\nThe result of 970,401,257,522 + 240,171,627,001 \u2212 95,140 is 1,211,057,278,883.<|im_end|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3591, | |
| "owned": 3290, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3275, | |
| "head_mismatch": 0, | |
| "seconds": 5.145190477371216 | |
| }, | |
| { | |
| "question": "What is 695/781 + 781/695 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression=\"695/781 + 781/695\")</function_calls><|im_end|>\n<|im_start|>environment\n1092986/542795<|im_end|>\n<|im_start|>assistant\nThe exact value of 695/781 + 781/695 is 1092986\u2044542795.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 12550, | |
| "owned": 12271, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 53, | |
| "chip_tokens": 12255, | |
| "head_mismatch": 0, | |
| "seconds": 7.696610689163208 | |
| }, | |
| { | |
| "question": "What is 25464152153 // 646?", | |
| "answer": "<function_calls>calc(expression=\"25464152153 // 646\")</function_calls><|im_end|>\n<|im_start|>environment\n39418192<|im_end|>\n<|im_start|>assistant\nThe result of 25464152153 // 646 is 39,418,192.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3125, | |
| "owned": 2856, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 45, | |
| "chip_tokens": 2843, | |
| "head_mismatch": 0, | |
| "seconds": 3.525099039077759 | |
| }, | |
| { | |
| "question": "What is 925348/66230 + 66230/925348 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression='925348/66230 + 66230/925348')</function_calls><|im_end|>\n<|im_start|>environment\n215163833501/15321449510<|im_end|>\n<|im_start|>assistant\nThe exact value of 925348/66230 + 66230/925348 is 215163833501/15321449510.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 17791, | |
| "owned": 17498, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 66, | |
| "chip_tokens": 17479, | |
| "head_mismatch": 0, | |
| "seconds": 10.45876431465149 | |
| }, | |
| { | |
| "question": "What is 268350532516 // 377?", | |
| "answer": "<function_calls>calc(expression=\"268350532516 // 377\")</function_calls><|im_end|>\n<|im_start|>environment\n711805126<|im_end|>\n<|im_start|>assistant\nThe result of 268350532516 floor-divided by 377 is 711805126.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3200, | |
| "owned": 2930, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 46, | |
| "chip_tokens": 2917, | |
| "head_mismatch": 0, | |
| "seconds": 3.570854663848877 | |
| }, | |
| { | |
| "question": "What is 535/48567 + 48567/535 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression=\"535/48567 + 48567/535\")</function_calls><|im_end|>\n<|im_start|>environment\n2359039714/25983345<|im_end|>\n<|im_start|>assistant\nThe exact value of 535/48567 + 48567/535 is 2359039714\u204425983345.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 16752, | |
| "owned": 16465, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 61, | |
| "chip_tokens": 16447, | |
| "head_mismatch": 0, | |
| "seconds": 9.820337057113647 | |
| }, | |
| { | |
| "question": "What is 49260355920 + 935038906300 - 622000?", | |
| "answer": "<function_calls>calc(expression=\"49260355920 + 935038906300 - 622000\")</function_calls><|im_end|>\n<|im_start|>environment\n984298640220<|im_end|>\n<|im_start|>assistant\nThe result of 49,260,355,920 + 935,038,906,300 - 622,000 is 984,298,640,220.<|im_end|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3556, | |
| "owned": 3257, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 69, | |
| "chip_tokens": 3243, | |
| "head_mismatch": 0, | |
| "seconds": 4.989410638809204 | |
| }, | |
| { | |
| "question": "What is 964782/243456 + 243456/964782 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression='964782/243456 + 243456/964782')</function_calls><|im_end|>\n<|im_start|>environment\n27502086985/6524499072<|im_end|>\n<|im_start|>assistant\nThe exact value of 964782/243456 + 243456/964782 is 27502086985\u20446524499072.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 19115, | |
| "owned": 18821, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 67, | |
| "chip_tokens": 18802, | |
| "head_mismatch": 0, | |
| "seconds": 11.004999876022339 | |
| }, | |
| { | |
| "question": "What is 735000009752 * 998504368427?", | |
| "answer": "<function_calls>calc(expression='735000009752 * 998504368427')</function_calls><|im_end|>\n<|im_start|>environment\n733900720531259600900104<|im_end|>\n<|im_start|>assistant\nThe product of 735,000,009,752 and 998,504,368,427 is 733,900,720,531,259,600,900,104.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3432, | |
| "owned": 3138, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3120, | |
| "head_mismatch": 0, | |
| "seconds": 4.994328737258911 | |
| }, | |
| { | |
| "question": "What is 815162/215468 + 215468/815162 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression=\"815162/215468 + 215468/815162\")</function_calls><|im_end|>\n<|im_start|>environment\n177728886317/43910331454<|im_end|>\n<|im_start|>assistant\nThe exact value of 815162/215468 + 215468/815162 is 177728886317\u204443910331454.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 20853, | |
| "owned": 20559, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 67, | |
| "chip_tokens": 20540, | |
| "head_mismatch": 0, | |
| "seconds": 11.669281005859375 | |
| }, | |
| { | |
| "question": "What is 965/433483 + 433483/965 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression='965/433483 + 433483/965')</function_calls><|im_end|>\n<|im_start|>environment\n187908442514/418311095<|im_end|>\n<|im_start|>assistant\nThe exact value of 965/433483 + 433483/965 is 187908442514\u2044418311095.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 16194, | |
| "owned": 15907, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 61, | |
| "chip_tokens": 15889, | |
| "head_mismatch": 0, | |
| "seconds": 9.518018007278442 | |
| }, | |
| { | |
| "question": "What is 824648/347224 + 347224/824648 as an exact fraction?", | |
| "answer": "<function_calls>calc(expression='824648/347224 + 347224/824648')</function_calls><|im_end|>\n<|im_start|>environment\n12509512970/4474024643<|im_end|>\n<|im_start|>assistant\nThe exact value of 824648/347224 + 347224/824648 is 12509512970\u20444474024643.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 19465, | |
| "owned": 19171, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 67, | |
| "chip_tokens": 19152, | |
| "head_mismatch": 0, | |
| "seconds": 11.138115644454956 | |
| }, | |
| { | |
| "question": "What is 252563703788 // 883?", | |
| "answer": "<function_calls>calc(expression=\"252563703788 // 883\")</function_calls><|im_end|>\n<|im_start|>environment\n286029109<|im_end|>\n<|im_start|>assistant\nThe result of 252563703788 floor-divided by 883 is 286029109.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3173, | |
| "owned": 2903, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 46, | |
| "chip_tokens": 2890, | |
| "head_mismatch": 0, | |
| "seconds": 3.5056533813476562 | |
| }, | |
| { | |
| "question": "What is 80200412905 // 1910?", | |
| "answer": "<function_calls>calc(expression=\"80200412905 // 1910\")</function_calls><|im_end|>\n<|im_start|>environment\n41989744<|im_end|>\n<|im_start|>assistant\nThe result of 80200412905 // 1910 is 41,989,744.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3182, | |
| "owned": 2910, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 47, | |
| "chip_tokens": 2897, | |
| "head_mismatch": 0, | |
| "seconds": 3.573049545288086 | |
| }, | |
| { | |
| "question": "What is (686324134734 - 319306964841) * 23?", | |
| "answer": "<function_calls>calc(expression='(686324134734 - 319306964841) * 23')</function_calls><|im_end|>\n<|im_start|>environment\n8441394907539<|im_end|>\n<|im_start|>assistant\nThe result of (686324134734 - 319306964841) * 23 is 8,441,399,007,539.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3693, | |
| "owned": 3398, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 66, | |
| "chip_tokens": 3383, | |
| "head_mismatch": 0, | |
| "seconds": 4.757973909378052 | |
| }, | |
| { | |
| "question": "What is 299173161642 * 770762074618?", | |
| "answer": "<function_calls>calc(expression='299173161642 * 770762074618')</function_calls><|im_end|>\n<|im_start|>environment\n230591326737214179402756<|im_end|>\n<|im_start|>assistant\nThe product of 299,173,161,642 and 770,762,074,618 is 230,591,326,737,214,179,402,756.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3411, | |
| "owned": 3117, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3099, | |
| "head_mismatch": 0, | |
| "seconds": 4.954685926437378 | |
| }, | |
| { | |
| "question": "What is 375332404876 + 210578096096 - 1783?", | |
| "answer": "<function_calls>calc(expression=\"375332404876 + 210578096096 - 1783\")</function_calls><|im_end|>\n<|im_start|>environment\n585910499189<|im_end|>\n<|im_start|>assistant\nThe result of 375,332,404,876 + 210,578,096,096 \u2212 1,783 is 585,910,499,189.<|im_end|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3524, | |
| "owned": 3225, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 69, | |
| "chip_tokens": 3211, | |
| "head_mismatch": 0, | |
| "seconds": 5.068606615066528 | |
| }, | |
| { | |
| "question": "What is (245902548968 - 160620247477) * 94?", | |
| "answer": "<function_calls>calc(expression='(245902548968 - 160620247477) * 94')</function_calls><|im_end|>\n<|im_start|>environment\n8016536340154<|im_end|>\n<|im_start|>assistant\nThe result of (245,902,548,968 - 160,620,247,477) \u00d7 94 is 8,016,536,401,554.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3697, | |
| "owned": 3396, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3381, | |
| "head_mismatch": 0, | |
| "seconds": 5.171700477600098 | |
| }, | |
| { | |
| "question": "What is 918167512013 * 878883472768?", | |
| "answer": "<function_calls>calc(expression=\"918167512013 * 878883472768\")</function_calls><|im_end|>\n<|im_start|>environment\n806962251540739798361984<|im_end|>\n<|im_start|>assistant\nThe product of 918,167,512,013 and 878,883,472,768 is 806,962,251,540,739,798,361,984.<|endoftext|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3453, | |
| "owned": 3159, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3141, | |
| "head_mismatch": 0, | |
| "seconds": 5.033058166503906 | |
| }, | |
| { | |
| "question": "What is 635258877015 + 694423656695 - 7707?", | |
| "answer": "<function_calls>calc(expression=\"635258877015 + 694423656695 - 7707\")</function_calls><|im_end|>\n<|im_start|>environment\n1329682526003<|im_end|>\n<|im_start|>assistant\nThe result of 635,258,877,015 + 694,423,656,695 \u2212 7,707 is 1,329,681,825,603.<|im_end|>", | |
| "clean": true, | |
| "lock_error": null, | |
| "replay": { | |
| "ok": true, | |
| "positions": 3559, | |
| "owned": 3258, | |
| "wrong_predictions": 0, | |
| "owner_mismatch": 0, | |
| "runs": 1 | |
| }, | |
| "text_tokens": 72, | |
| "chip_tokens": 3243, | |
| "head_mismatch": 0, | |
| "seconds": 5.064943552017212 | |
| } | |
| ] |