Text Generation
Transformers
Safetensors
mistral3
image-text-to-text
decision-model
typed-decisions
jev
jevbench
calibration
decode-free
multilingual
vision-language
conversational
Instructions to use StandardThinking/StandardOne-3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use StandardThinking/StandardOne-3B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="StandardThinking/StandardOne-3B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("StandardThinking/StandardOne-3B") model = AutoModelForMultimodalLM.from_pretrained("StandardThinking/StandardOne-3B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use StandardThinking/StandardOne-3B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "StandardThinking/StandardOne-3B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "StandardThinking/StandardOne-3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/StandardThinking/StandardOne-3B
- SGLang
How to use StandardThinking/StandardOne-3B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "StandardThinking/StandardOne-3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "StandardThinking/StandardOne-3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "StandardThinking/StandardOne-3B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "StandardThinking/StandardOne-3B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use StandardThinking/StandardOne-3B with Docker Model Runner:
docker model run hf.co/StandardThinking/StandardOne-3B
Download SHA256SUMS from StandardThinking/StandardOne-3B: direct link, hf CLI and curl.
- Browser
- Download file 9.33 kB
-
https://huggingface.co/StandardThinking/StandardOne-3B/resolve/main/SHA256SUMS
- Command line
-
hf download hf://StandardThinking/StandardOne-3B/SHA256SUMS
-
curl -L -o SHA256SUMS https://huggingface.co/StandardThinking/StandardOne-3B/resolve/main/SHA256SUMS
9.33 kB
| 1495e1e757ef4d0925a2350563cf5754bb23c51701a8ec4fb3c5cdcbedae6747 LICENSE | |
| 1f8351b8fdbbd1f8784ccc7ac322ab79914c38fa77eb737da624881c027ccb31 MERGE_REPORT.json | |
| f10343f951ecb3a72670e12720de6e04d59e9cb872e84b2ceddd7d54853bb7e7 NOTICE | |
| 523393207c7d56233cc7d83548eb6293a62e09d01fdd218d82e4f4208bc28ae8 QUICKSTART.md | |
| 3c5238c9714163618212890291f53a89266a0bd7447f293744dc5f92e3717ef9 README.md | |
| 331b249682cd52226c50e533f59825184997f3b31f9a62b2c3fea940db6999c5 SYSTEM_PROMPT.txt | |
| 0701cfbdc2b7d44fdbad104dff604faee4b0543e8247624568777fe465746f9b chat_template.jinja | |
| c4446cf970fefd8b65f2e3119c30d406ea7026dca362dfb319c9aa08643131c3 config.json | |
| 3db0aef5755a2332131e8176fbc73a46f37b73deef4582979441d8305e79b3fb docs/BENCHMARKS.md | |
| 648a7d239492e96aaf33064afd195f567d197c13c1c427bf6e2a68443b6d11b1 docs/assets/00-benchmark-card.png | |
| 8aad0fa1dc5e4a6c389be125513dc1e3e6fbbaabdee8a714018a84d24c9e57dc docs/assets/00-benchmark-card.svg | |
| 7313f2b0645ee401d082572986dcee0c08d3daed1ae79fa650cfa685570ad7e2 docs/assets/02-latency-vs-qwen.png | |
| 0b48a0dd4b4c9ac7c1842836940348edc2e1ba697184943f0c84c3e3d3c7f2d0 docs/assets/02-latency-vs-qwen.svg | |
| 5f430f8841e393548f080833524840adb93deef1c6f75dca93d0571262a2ac68 docs/assets/04-throughput.png | |
| dd888be78c0e32894cf04a8e3fbf8757e7218873668fa4443ba47c7c1c48b6dc docs/assets/04-throughput.svg | |
| 4900de357045839e7cd48331a8ae4db8a8ce722a41a462ec2ccbbca03587f84e docs/assets/05-gain-over-base.png | |
| e24a379bc590f91ec757edec44b7c286e762966095093dc31b67903bbab7337e docs/assets/05-gain-over-base.svg | |
| 0274d259fe3ea27ba6a5122452ab15970ba51575cf2e4f278e983e1c3cbe1528 docs/assets/06-vs-jev.png | |
| 034a5d015b98b34e55b8639271e9fcf4676820f1301f99d48e179b4381ebf4e6 docs/assets/06-vs-jev.svg | |
| e6302b40bb4acd94fbac3d7fc08c92c4b5930b1e4127b5e7e8bff9c03b6ccd24 docs/public-classification-suites.md | |
| a6423137b37e89b106336034107c41c8915818c421be869fcf76684cf67d667e evidence/calibration-leaderboard-ablate-nosys.json | |
| b6fc93a0c07713654c0b98a34380b78d558db774158b3f681634e1c9c92e2421 evidence/calibration-leaderboard-merged-native.json | |
| af92bc8ad5010acc9c7d134080325dc09d7e4343dfee72bc4336adf496227e91 evidence/calibration-per-type-served.json | |
| e622df488a08b425d5a464b2ab7e8b2d60b3b703baef8e4bdf927357adb87c2e evidence/prompt-wording-choice.json | |
| b07691c0eda24ef08288f58cc6e0906f4c5b7ced57ebb9cb49888e4e2ed8672c evidence/served-nosys-easy-report.json | |
| 60dad968740e62f6c19dd6d530e4299784b1a26e22e7e60f26bee42367ee6398 evidence/served-nosys-hard-report.json | |
| 7b9b1ee2f93166a817ead61bbc0f4c62984afe7d6c8affefd051007582d0a485 evidence/served-nosys-latency-idle-gpu.json | |
| d6c43f4f53bf63ca49dbed9355f601d4791776b4bb99c38452abca5c7aa41b4c evidence/served-nosys-original-report.json | |
| e0923390059f84a9180b00e5501778acc45ea9856cd7f2fd68208b360927c677 generation_config.json | |
| 521646ccb298cdb40ad3cd6819ae3ee13d3d7297818f05b42544c50830d72fcb model-00001-of-00002.safetensors | |
| 9529809ee3b5c0e087e6f2a3df68f1396cd7b15e4c662a8cdd68d566bf65b6a1 model-00002-of-00002.safetensors | |
| 55641440eb385d8bc83a319b0a92f60fe45e6aef4b6992245eee91142237786e model.safetensors.index.json | |
| d15587c57574d2a92c66ff2552c6db5173d4c440ad47f7454dc51bad0ecaeb59 params.json | |
| ece2373c2ae391bce18785a1810543bc6173a1f28b6767cffab2c35dbea5f002 processor_config.json | |
| 414e0a803ca148e5c0b8c2b56719ca0de77b16a47746fac62690fe1501ff8384 release-manifest.json | |
| 1495e1e757ef4d0925a2350563cf5754bb23c51701a8ec4fb3c5cdcbedae6747 server/LICENSE | |
| 0f1f023b916d38d7c12af3a71e09f5e82b819a7e156e4992118bb160ee63ede1 server/NOTICE | |
| 1dfc7768424d67d0b8834bf66bda131b2e3ff482332ea59c7b1170beefd3811d server/README.md | |
| 88e4dea8cc92f467a03bdd45a5fb968e402517116b09e24edcea85bb15f121e5 server/benchmarks/DECISION_BENCHMARK_SELECTION.md | |
| 7fea6b9dc44e34ce448f1d80a9f2d273b76ab9b0ac1859c032fa4faa4f458501 server/benchmarks/METRIC_VALIDATION.md | |
| bb88f12ef294680e389147d781bf1f8680ea0a5ca9ed554730d8ea29f1c25eb9 server/benchmarks/PUBLIC_DATASETS.md | |
| e844e0de19ef528bc28ec09339072e1eab4df05bfc4ec56a220cfc7528d2d481 server/benchmarks/README.md | |
| 3e5beed774bb0bcbfb2fcf24ba9554212c6ae112937d308040989465ab0c5784 server/benchmarks/data/jevbench-easy/LICENSE | |
| 396422e29055bba4073f4a9e5a7163cc724f13e970a34ef58e8ea1fb439b9b38 server/benchmarks/data/jevbench-easy/THIRD-PARTY.md | |
| e186c6dd90b3a7a177ef15f2fd3673d7bbfce95340bfdc6062dc15bfa0e01a6a server/benchmarks/data/jevbench-easy/public.jsonl | |
| d43b510898b867e3633ac9a50940f2cf237c114241c3d8e4f26437ff75b64da7 server/benchmarks/data/jevbench-easy/public.manifest.json | |
| 3e5beed774bb0bcbfb2fcf24ba9554212c6ae112937d308040989465ab0c5784 server/benchmarks/data/jevbench-hard/LICENSE | |
| 396422e29055bba4073f4a9e5a7163cc724f13e970a34ef58e8ea1fb439b9b38 server/benchmarks/data/jevbench-hard/THIRD-PARTY.md | |
| 6c93c82edf10d08b70ee0c3addcf7c1ea8fd19957e94fb8021969ff4c0027f95 server/benchmarks/data/jevbench-hard/public.jsonl | |
| 6a1589498ef3ac71798ea8681fbb6a42d8c0a3a329a972818f71f246d1f88909 server/benchmarks/data/jevbench-hard/public.manifest.json | |
| 3e5beed774bb0bcbfb2fcf24ba9554212c6ae112937d308040989465ab0c5784 server/benchmarks/data/jevbench-original/LICENSE | |
| 396422e29055bba4073f4a9e5a7163cc724f13e970a34ef58e8ea1fb439b9b38 server/benchmarks/data/jevbench-original/THIRD-PARTY.md | |
| ad453e78624b1c150d5eb3f0f47c5c14caa79542329b4f7e1bcc6199e2eb7007 server/benchmarks/data/jevbench-original/public.jsonl | |
| 89fe50f5cc0654b37f81833ed91f171cdbd0d4c1da3622ac4736949fbea23e95 server/benchmarks/data/jevbench-original/public.manifest.json | |
| 5434d64a4bf45a6693287b72edd9d823a907b639a8c3a18fd40cc744073c144b server/benchmarks/run_matrix.py | |
| fee797d1a2ff128a5d61dd436e8252d63bc726b8ce4ba72641a1ffd9196135a6 server/benchmarks/verify_metrics.py | |
| 2544280dd3e669985bf57dfc61c2212bcf16d27230a79cea76f9f4e822476429 server/examples/request.json | |
| 7a14fe0f5bf73aca7a4930423c310c0a3b1f9b546d07abc8d3fd5d9f38c9a5d7 server/examples/smoke.py | |
| e589f268969c87f82ddd2c81c0432c6335c08a9f9f2537ce68ddd5708f1e6f9e server/jev_adapter/__init__.py | |
| caacf020f66bbfbf1e09ac303a7e9adbe493ad4154a1339c203c8ff87fb3392a server/jev_adapter/__main__.py | |
| e2f84bb7867934533f8f2a87034cad76af695ca1bbdbf096c545fe60b790c6fa server/jev_adapter/backend.py | |
| 2cd67e71c1a601fc9333c266d909197031b7c0dc746b9a2d5475a5fb0c085e95 server/jev_adapter/benchmarks/__init__.py | |
| 44104bc2d6431c05345cd697dd2c377cc6ba9fd57f2177df7b548490cf5f53fc server/jev_adapter/benchmarks/compare.py | |
| a504e8051886086934751bffc948e588ebe0ad92c613327014b627be454d3e8c server/jev_adapter/benchmarks/data.py | |
| a66e6ec289b4c32f79ac990261650870be6b923e47753b9c89ff9e58fe2f982f server/jev_adapter/benchmarks/jevbench.py | |
| 1b78c52f723cb3a3e614d1be4ca531e7595e0a6690e704d6f1bb3045dd948bf0 server/jev_adapter/benchmarks/metrics.py | |
| 9c51ce87269c587f1353b9dd32d886f9f0a51613a996721a7bb81695af445c02 server/jev_adapter/benchmarks/prepare.py | |
| 0fef99cd01164c5548de530c9ab93255e2a95d17757c12e8e3d23016afd1a03c server/jev_adapter/benchmarks/run.py | |
| 9a3d1c89d7451a52383709487acb883f683dbdcb2ca73b5a9b39b9b75407a09e server/jev_adapter/labels.py | |
| 86e113a3ee9d15d9be93ba5e964d5f5d51171619e7856cc7dde812c6c90f4a37 server/jev_adapter/native_tokenizer.py | |
| 0acba8046427725f4275cd971cfc29f48c04c64e73f96115b83ce8ac1bcbe8b7 server/jev_adapter/protocol.py | |
| 4375a9eafb6d252a76b2b57dd7cecfd600baae04a9ab4dd0abbd6c86a3778be9 server/jev_adapter/server.py | |
| 24667f1c1d6967f5a1c90d6e9bf13922bdfe1ce1a3aea8709c18a1837d2fe09c server/jev_adapter/service.py | |
| 18b3191db6a3e43a2ad01243c709bab2c8db771b1363638de64ab4871b0f1d7b server/jev_adapter/sglang.py | |
| 159eb400efb830c762a36f81e51ba79888570284ffa70326301adfeee50b5bd3 server/pyproject.toml | |
| d4d01e7e2c0d49ccce56516db8aaef0eb32d001b42e8f394e7e355e90047db71 server/tests/conftest.py | |
| 63046320ac89d71770afccf8f3ad861c795151ede968354f34f59aabff9ec5c3 server/tests/data/ministral3-label-probe.json | |
| 27119a52ee9a0417809c3a50b5b07e77aa723d4a63266d1065ba8ca82589d512 server/tests/data/upper-labels-ministral3.json | |
| f5bf6e9b916ff0d24a2551b4f9f24ed353e7343f5be343b141d38c4c04bd1101 server/tests/test_benchmark_data.py | |
| c197a90d57c7516eb615f7f0626f4c3e95b2fd0773d74e8f32601251804fca66 server/tests/test_benchmark_matrix.py | |
| 56a48c36d322d7131978809397da79d0f9abbb6801ab6176d27ed2f9dfb26063 server/tests/test_benchmark_run.py | |
| c492b41c07050d9b76c6c9d7d21bbfcdac6ec137346cf995df3f624cb1e345c8 server/tests/test_disconnect_cleanup.py | |
| 83769ec3f35f5034787ffa8160a5ea7c9c7e23200b303d8b908500d71e3fe13f server/tests/test_http_integration.py | |
| 746cc73422976ec22b460a74a7c70d937c0ba4fd9fb7151fa6745641dbca5616 server/tests/test_jevbench.py | |
| de052504cc7d82c964ef7cf4d6d2fafabf3ec61e4c4b359b9baadeea6b27c7f2 server/tests/test_labels.py | |
| af1ebfb5c57e2de76b8f90bdb6eec89abaa29ae3a1873595d4de287788c991af server/tests/test_main.py | |
| 83084f098020374a4abfa3d4402e74e357d45170ca840843e58dba13162e9986 server/tests/test_native_tokenizer.py | |
| b296814c9f0837d7c2625e1867b3197021f11c0b1c7ab5b74aa9c4b298b82396 server/tests/test_protocol.py | |
| 617f08c82448932cf13320166c4df66a1a85b5056a354aa8e9f748ce9b6f57d3 server/tests/test_service.py | |
| 340e91fb9a6c870990187386da8d165fafcbcb5f08559056fd9da4e4e78b681f server/tests/test_sglang.py | |
| 0a5c981e8c5c6f8886ee007a6d4543a0be6b221cb9ca32a8709384a4c6fc8cbb special_tokens_map.json | |
| 600bb27946565481ecf51ba8aee252e49b9a68507866080ac9c30185bb312843 tekken.json | |
| d5f6046775b112f0e2d456ee9dba450684ab964fe5c4e231599bdc6773028135 tokenizer.json | |
| f59f7294e4f26383d0ea93840fe21cf197784be0842a8301a0343e8c34ed0d6d tokenizer_config.json | |