Text Classification
Transformers
Safetensors
English
mistral3
image-text-to-text
decision-model
typed-decisions
schema-head
jev
calibration
decode-free
Instructions to use StandardThinking/StandardOne-8B-SH with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use StandardThinking/StandardOne-8B-SH with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="StandardThinking/StandardOne-8B-SH")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("StandardThinking/StandardOne-8B-SH") model = AutoModelForMultimodalLM.from_pretrained("StandardThinking/StandardOne-8B-SH", device_map="auto") - Notebooks
- Google Colab
- Kaggle
README: tested environments, Blackwell note
Browse files- README.md +6 -1
- SHA256SUMS +1 -1
README.md
CHANGED
|
@@ -109,7 +109,12 @@ curl -s localhost:30171/v1/systemone -H 'content-type: application/json' -d '{
|
|
| 109 |
```
|
| 110 |
|
| 111 |
The server batches concurrent requests (`--max-batch-requests`, `--max-batch-tokens`) and binds `127.0.0.1` by
|
| 112 |
-
default. It runs on one GPU with the backbone in bfloat16 and the head in float32.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 113 |
[StandardOne-8B-SH-GGUF](https://huggingface.co/StandardThinking/StandardOne-8B-SH-GGUF).
|
| 114 |
|
| 115 |
## Files
|
|
|
|
| 109 |
```
|
| 110 |
|
| 111 |
The server batches concurrent requests (`--max-batch-requests`, `--max-batch-tokens`) and binds `127.0.0.1` by
|
| 112 |
+
default. It runs on one GPU with the backbone in bfloat16 and the head in float32.
|
| 113 |
+
|
| 114 |
+
Tested with this exact quick start on an NVIDIA H200 (PyTorch 2.11, CUDA 12.8) and on AMD MI350X (PyTorch 2.9, ROCm 7.2);
|
| 115 |
+
the JevBench public tiers reproduce the numbers above. On Blackwell GPUs (B200/B300) install a CUDA 13 build of PyTorch
|
| 116 |
+
first (`pip install torch --index-url https://download.pytorch.org/whl/cu130`); the CUDA 12.8 build lacks kernels for
|
| 117 |
+
those GPUs. For CPU or Apple-silicon use, see
|
| 118 |
[StandardOne-8B-SH-GGUF](https://huggingface.co/StandardThinking/StandardOne-8B-SH-GGUF).
|
| 119 |
|
| 120 |
## Files
|
SHA256SUMS
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
1495e1e757ef4d0925a2350563cf5754bb23c51701a8ec4fb3c5cdcbedae6747 LICENSE
|
| 2 |
-
|
| 3 |
66e0fda8c8ab269ccd010dca6196931d475a22c3f2eebe5b6b3a2ec33a354d0e SYSTEM_PROMPT.txt
|
| 4 |
e62f05da25555a4c109d0f413eb673d328fcc40f7c82537c61631611f6954372 chat_template.jinja
|
| 5 |
5f3d6035ca36885c9be04b7cfa88b5ba532c87d5b26fa3525c94327fb1b4348b code/head.py
|
|
|
|
| 1 |
1495e1e757ef4d0925a2350563cf5754bb23c51701a8ec4fb3c5cdcbedae6747 LICENSE
|
| 2 |
+
d9ac54c2ca89376a28d11ddd398a69ca10690371dcb2013f2402c9d7cd497e62 README.md
|
| 3 |
66e0fda8c8ab269ccd010dca6196931d475a22c3f2eebe5b6b3a2ec33a354d0e SYSTEM_PROMPT.txt
|
| 4 |
e62f05da25555a4c109d0f413eb673d328fcc40f7c82537c61631611f6954372 chat_template.jinja
|
| 5 |
5f3d6035ca36885c9be04b7cfa88b5ba532c87d5b26fa3525c94327fb1b4348b code/head.py
|