Instructions to use mudler/timestral-cpp-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mudler/timestral-cpp-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mudler/timestral-cpp-gguf:F16 # Run inference directly in the terminal: llama cli -hf mudler/timestral-cpp-gguf:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mudler/timestral-cpp-gguf:F16 # Run inference directly in the terminal: llama cli -hf mudler/timestral-cpp-gguf:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf mudler/timestral-cpp-gguf:F16 # Run inference directly in the terminal: ./llama-cli -hf mudler/timestral-cpp-gguf:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf mudler/timestral-cpp-gguf:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf mudler/timestral-cpp-gguf:F16
Use Docker
docker model run hf.co/mudler/timestral-cpp-gguf:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use mudler/timestral-cpp-gguf with Ollama:
ollama run hf.co/mudler/timestral-cpp-gguf:F16
- Unsloth Desktop
- Docker Model Runner
How to use mudler/timestral-cpp-gguf with Docker Model Runner:
docker model run hf.co/mudler/timestral-cpp-gguf:F16
- Lemonade
How to use mudler/timestral-cpp-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mudler/timestral-cpp-gguf:F16
Run and chat with the model
lemonade run user.timestral-cpp-gguf-F16
List all available models
lemonade list
- Atomic Chat
Add pinned 28M and 123M GGUF conversions and upstream relations
Browse files- .gitattributes +5 -0
- 123M/LICENSE +10 -0
- 123M/timestral-123m-f16.gguf +3 -0
- 123M/timestral-123m-f32.gguf +3 -0
- 28M/LICENSE +10 -0
- 28M/timestral-28m-f16.gguf +3 -0
- 28M/timestral-28m-f32.gguf +3 -0
- 28M/timestral-28m-q8_0.gguf +3 -0
- README.md +9 -4
- SHA256SUMS +5 -0
- manifest.json +35 -0
.gitattributes
CHANGED
|
@@ -42,3 +42,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 42 |
5M/timestral-5m-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
5M/timestral-5m-f32.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
5M/timestral-5m-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
5M/timestral-5m-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
5M/timestral-5m-f32.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
5M/timestral-5m-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
123M/timestral-123m-f32.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
28M/timestral-28m-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
28M/timestral-28m-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
123M/timestral-123m-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
28M/timestral-28m-f32.gguf filter=lfs diff=lfs merge=lfs -text
|
123M/LICENSE
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Modified MIT License
|
| 2 |
+
|
| 3 |
+
Attribution notice: 2026 - Mistral AI
|
| 4 |
+
|
| 5 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy of the weights of this model and associated documentation files (the “Model”), to deal in the Model without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Model, and to permit persons to whom the Model is furnished to do so, subject to the following conditions:
|
| 6 |
+
|
| 7 |
+
1. The above attribution notice and this permission notice shall be included in all copies or substantial portions of the Model.
|
| 8 |
+
2. You are not authorized to exercise any rights under this license if the global consolidated monthly revenue of your company (or that of your employer) exceeds $20 million (or its equivalent in another currency) for the preceding month. This restriction in (b) applies to the Model and any derivatives, modifications, or combined works based on it, whether provided by Mistral AI or by a third party. You may contact Mistral AI (sales@mistral.ai) to request a commercial license, which Mistral AI may grant you at its sole discretion, or choose to use the Model on Mistral AI's hosted services available at https://mistral.ai/.
|
| 9 |
+
|
| 10 |
+
THE MODEL IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL MISTRAL AI BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE MODEL OR THE USE OR OTHER DEALINGS IN THE MODEL.
|
123M/timestral-123m-f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cf3e7eb0ab9581407d9edc2f4b2d1b8dda8c3a39674dbf3b6967971f906c54b0
|
| 3 |
+
size 246787936
|
123M/timestral-123m-f32.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90a2cad5bff9ac6ef695689b03d459df1cdfb5bb140755da7b99d01cfa0cbeb4
|
| 3 |
+
size 491523712
|
28M/LICENSE
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Modified MIT License
|
| 2 |
+
|
| 3 |
+
Attribution notice: 2026 - Mistral AI
|
| 4 |
+
|
| 5 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy of the weights of this model and associated documentation files (the “Model”), to deal in the Model without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Model, and to permit persons to whom the Model is furnished to do so, subject to the following conditions:
|
| 6 |
+
|
| 7 |
+
1. The above attribution notice and this permission notice shall be included in all copies or substantial portions of the Model.
|
| 8 |
+
2. You are not authorized to exercise any rights under this license if the global consolidated monthly revenue of your company (or that of your employer) exceeds $20 million (or its equivalent in another currency) for the preceding month. This restriction in (b) applies to the Model and any derivatives, modifications, or combined works based on it, whether provided by Mistral AI or by a third party. You may contact Mistral AI (sales@mistral.ai) to request a commercial license, which Mistral AI may grant you at its sole discretion, or choose to use the Model on Mistral AI's hosted services available at https://mistral.ai/.
|
| 9 |
+
|
| 10 |
+
THE MODEL IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL MISTRAL AI BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE MODEL OR THE USE OR OTHER DEALINGS IN THE MODEL.
|
28M/timestral-28m-f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64b5b836c54c2d3a83b428e6b9e44e2bbf668c60297245c97a0df160d2c5366d
|
| 3 |
+
size 57008064
|
28M/timestral-28m-f32.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fbb5a8dcb8b224a45b149dc802428beca20504e71f585d942b0530f67f46a89c
|
| 3 |
+
size 112377536
|
28M/timestral-28m-q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:910e94210a8e87c1b67f8c84643cec5328db7d2d11ef833b5b7a4eab8b5ba028
|
| 3 |
+
size 31053504
|
README.md
CHANGED
|
@@ -4,6 +4,8 @@ license_name: mistral-modified-mit
|
|
| 4 |
license_link: LICENSE
|
| 5 |
base_model:
|
| 6 |
- mistralai/Timestral-5M
|
|
|
|
|
|
|
| 7 |
- mistralai/Timestral-209M
|
| 8 |
base_model_relation: quantized
|
| 9 |
library_name: timestral.cpp
|
|
@@ -15,7 +17,7 @@ tags:
|
|
| 15 |
---
|
| 16 |
# Timestral GGUF models for timestral.cpp
|
| 17 |
|
| 18 |
-
This interim release contains
|
| 19 |
Inference requires no Python or libtorch. Conversion uses the pinned upstream checkpoints listed in `manifest.json`.
|
| 20 |
|
| 21 |
## Available models
|
|
@@ -23,10 +25,13 @@ Inference requires no Python or libtorch. Conversion uses the pinned upstream ch
|
|
| 23 |
| Directory | Available formats | Validation |
|
| 24 |
| --- | --- | --- |
|
| 25 |
| `5M/` | F32, F16, Q8_0 | All three pass storage, schema, lineage, and byte-encoding audits. F32 passes trained parity; reduced-format forecast quality is not yet evaluated. |
|
|
|
|
|
|
|
| 26 |
| `209M/` | F32, F16, Q8_0, Q6_K, Q5_K, Q4_K | All six pass cohort/storage admission. Full quality evaluation completes, but the Q8 mean-deviation gate fails. |
|
| 27 |
|
| 28 |
-
|
| 29 |
-
|
|
|
|
| 30 |
|
| 31 |
## Quality and performance limitations
|
| 32 |
|
|
@@ -71,6 +76,6 @@ Keep the original notices with copies and derivatives. This repository does not
|
|
| 71 |
## Integrity and provenance
|
| 72 |
|
| 73 |
`manifest.json` records exact sizes, SHA-256 hashes, upstream revisions, and runtime/reference identities.
|
| 74 |
-
`SHA256SUMS` contains checksums for all
|
| 75 |
F32/F16/Q8_0 use the pinned converter; 209M K formats use the reviewed native quantizer.
|
| 76 |
The 5M F32 file is byte-identical to the previously accepted trained-parity artifact.
|
|
|
|
| 4 |
license_link: LICENSE
|
| 5 |
base_model:
|
| 6 |
- mistralai/Timestral-5M
|
| 7 |
+
- mistralai/Timestral-28M
|
| 8 |
+
- mistralai/Timestral-123M
|
| 9 |
- mistralai/Timestral-209M
|
| 10 |
base_model_relation: quantized
|
| 11 |
library_name: timestral.cpp
|
|
|
|
| 17 |
---
|
| 18 |
# Timestral GGUF models for timestral.cpp
|
| 19 |
|
| 20 |
+
This interim release contains fourteen GGUF files for native CPU forecasting with [timestral.cpp](https://github.com/mudler/timestral.cpp).
|
| 21 |
Inference requires no Python or libtorch. Conversion uses the pinned upstream checkpoints listed in `manifest.json`.
|
| 22 |
|
| 23 |
## Available models
|
|
|
|
| 25 |
| Directory | Available formats | Validation |
|
| 26 |
| --- | --- | --- |
|
| 27 |
| `5M/` | F32, F16, Q8_0 | All three pass storage, schema, lineage, and byte-encoding audits. F32 passes trained parity; reduced-format forecast quality is not yet evaluated. |
|
| 28 |
+
| `28M/` | F32, F16, Q8_0 | Storage, schema, source-byte association, RoPE, and encoding audits pass. Native inference and forecast quality remain pending. |
|
| 29 |
+
| `123M/` | F32, F16 | Storage, schema, source-byte association, RoPE, and encoding audits pass. Native inference and forecast quality remain pending. |
|
| 30 |
| `209M/` | F32, F16, Q8_0, Q6_K, Q5_K, Q4_K | All six pass cohort/storage admission. Full quality evaluation completes, but the Q8 mean-deviation gate fails. |
|
| 31 |
|
| 32 |
+
All four upstream models now have converted artifacts in this repository. Native qualification is incomplete for 28M and 123M.
|
| 33 |
+
123M Q8_0 is unavailable: its 1712-wide FFN matrices do not satisfy the unchanged 32-value block requirement.
|
| 34 |
+
K formats for 5M, 28M, and 123M are incompatible with the unchanged complete weight policy. No padding or selective exclusions are used.
|
| 35 |
|
| 36 |
## Quality and performance limitations
|
| 37 |
|
|
|
|
| 76 |
## Integrity and provenance
|
| 77 |
|
| 78 |
`manifest.json` records exact sizes, SHA-256 hashes, upstream revisions, and runtime/reference identities.
|
| 79 |
+
`SHA256SUMS` contains checksums for all fourteen GGUF files.
|
| 80 |
F32/F16/Q8_0 use the pinned converter; 209M K formats use the reviewed native quantizer.
|
| 81 |
The 5M F32 file is byte-identical to the previously accepted trained-parity artifact.
|
SHA256SUMS
CHANGED
|
@@ -7,3 +7,8 @@ bf7605545245a2dd4d32f7ac2f7bbe5c2a12d8f47370814a254862150255b8e8 209M/timestral
|
|
| 7 |
49f364c750906c2a0513a407af5c94cf16a6d711976ce803ef966b17a0f6fe4d 209M/timestral-209m-q6_k.gguf
|
| 8 |
e894e488baf17ba07a8dc20c685506a5a7bb89ca8ddb82e920cb2113401d1fef 209M/timestral-209m-q5_k.gguf
|
| 9 |
05b9a0c99c099ba23ecb0a8dabf1552a6f0fbd0b7e37df0163fe41c851d575a6 209M/timestral-209m-q4_k.gguf
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
49f364c750906c2a0513a407af5c94cf16a6d711976ce803ef966b17a0f6fe4d 209M/timestral-209m-q6_k.gguf
|
| 8 |
e894e488baf17ba07a8dc20c685506a5a7bb89ca8ddb82e920cb2113401d1fef 209M/timestral-209m-q5_k.gguf
|
| 9 |
05b9a0c99c099ba23ecb0a8dabf1552a6f0fbd0b7e37df0163fe41c851d575a6 209M/timestral-209m-q4_k.gguf
|
| 10 |
+
90a2cad5bff9ac6ef695689b03d459df1cdfb5bb140755da7b99d01cfa0cbeb4 123M/timestral-123m-f32.gguf
|
| 11 |
+
64b5b836c54c2d3a83b428e6b9e44e2bbf668c60297245c97a0df160d2c5366d 28M/timestral-28m-f16.gguf
|
| 12 |
+
910e94210a8e87c1b67f8c84643cec5328db7d2d11ef833b5b7a4eab8b5ba028 28M/timestral-28m-q8_0.gguf
|
| 13 |
+
cf3e7eb0ab9581407d9edc2f4b2d1b8dda8c3a39674dbf3b6967971f906c54b0 123M/timestral-123m-f16.gguf
|
| 14 |
+
fbb5a8dcb8b224a45b149dc802428beca20504e71f585d942b0530f67f46a89c 28M/timestral-28m-f32.gguf
|
manifest.json
CHANGED
|
@@ -67,6 +67,41 @@
|
|
| 67 |
"sha256": "05b9a0c99c099ba23ecb0a8dabf1552a6f0fbd0b7e37df0163fe41c851d575a6",
|
| 68 |
"upstream": "mistralai/Timestral-209M",
|
| 69 |
"revision": "9874d252ab0aae16f7f7c999f98f98d6ad7d8365"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
}
|
| 71 |
]
|
| 72 |
}
|
|
|
|
| 67 |
"sha256": "05b9a0c99c099ba23ecb0a8dabf1552a6f0fbd0b7e37df0163fe41c851d575a6",
|
| 68 |
"upstream": "mistralai/Timestral-209M",
|
| 69 |
"revision": "9874d252ab0aae16f7f7c999f98f98d6ad7d8365"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"path": "123M/timestral-123m-f32.gguf",
|
| 73 |
+
"bytes": 491523712,
|
| 74 |
+
"sha256": "90a2cad5bff9ac6ef695689b03d459df1cdfb5bb140755da7b99d01cfa0cbeb4",
|
| 75 |
+
"upstream": "mistralai/Timestral-123M",
|
| 76 |
+
"revision": "5a147287addda85f6acd8da3fb8858fe9af7e8f7"
|
| 77 |
+
},
|
| 78 |
+
{
|
| 79 |
+
"path": "28M/timestral-28m-f16.gguf",
|
| 80 |
+
"bytes": 57008064,
|
| 81 |
+
"sha256": "64b5b836c54c2d3a83b428e6b9e44e2bbf668c60297245c97a0df160d2c5366d",
|
| 82 |
+
"upstream": "mistralai/Timestral-28M",
|
| 83 |
+
"revision": "49b26409ac87b5935539a5d8ffe7f397b720db47"
|
| 84 |
+
},
|
| 85 |
+
{
|
| 86 |
+
"path": "28M/timestral-28m-q8_0.gguf",
|
| 87 |
+
"bytes": 31053504,
|
| 88 |
+
"sha256": "910e94210a8e87c1b67f8c84643cec5328db7d2d11ef833b5b7a4eab8b5ba028",
|
| 89 |
+
"upstream": "mistralai/Timestral-28M",
|
| 90 |
+
"revision": "49b26409ac87b5935539a5d8ffe7f397b720db47"
|
| 91 |
+
},
|
| 92 |
+
{
|
| 93 |
+
"path": "123M/timestral-123m-f16.gguf",
|
| 94 |
+
"bytes": 246787936,
|
| 95 |
+
"sha256": "cf3e7eb0ab9581407d9edc2f4b2d1b8dda8c3a39674dbf3b6967971f906c54b0",
|
| 96 |
+
"upstream": "mistralai/Timestral-123M",
|
| 97 |
+
"revision": "5a147287addda85f6acd8da3fb8858fe9af7e8f7"
|
| 98 |
+
},
|
| 99 |
+
{
|
| 100 |
+
"path": "28M/timestral-28m-f32.gguf",
|
| 101 |
+
"bytes": 112377536,
|
| 102 |
+
"sha256": "fbb5a8dcb8b224a45b149dc802428beca20504e71f585d942b0530f67f46a89c",
|
| 103 |
+
"upstream": "mistralai/Timestral-28M",
|
| 104 |
+
"revision": "49b26409ac87b5935539a5d8ffe7f397b720db47"
|
| 105 |
}
|
| 106 |
]
|
| 107 |
}
|