pin v2 payload: engine 2610171128001, cuda 2610160820001, cuda12 2610141455002, sbsa 2610141455003, vulkan 2610141455004, macos 2610141455005, media 2610071902001
Browse files- .gitattributes +2 -0
- components/cuda/2610160820001/BUILD_INFO.cuda.md +3 -1
- components/engine/2610171128001/BUILD_INFO.engine.md +61 -0
- components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001 +3 -0
- components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001.exe +3 -0
- components/vulkan/2610141455004/BUILD_INFO.vulkan.md +3 -1
.gitattributes
CHANGED
|
@@ -300,3 +300,5 @@ components/cuda/2610160820001/ggml-cuda-x86_64.so filter=lfs diff=lfs merge=lfs
|
|
| 300 |
components/cuda/2610160820001/ggml-cuda-win-x86_64.dll filter=lfs diff=lfs merge=lfs -text
|
| 301 |
components/engine/2610161651001/opencoti-0.10.5-c13-2610161651001 filter=lfs diff=lfs merge=lfs -text
|
| 302 |
components/engine/2610161651001/opencoti-0.10.5-c13-2610161651001.exe filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 300 |
components/cuda/2610160820001/ggml-cuda-win-x86_64.dll filter=lfs diff=lfs merge=lfs -text
|
| 301 |
components/engine/2610161651001/opencoti-0.10.5-c13-2610161651001 filter=lfs diff=lfs merge=lfs -text
|
| 302 |
components/engine/2610161651001/opencoti-0.10.5-c13-2610161651001.exe filter=lfs diff=lfs merge=lfs -text
|
| 303 |
+
components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001 filter=lfs diff=lfs merge=lfs -text
|
| 304 |
+
components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001.exe filter=lfs diff=lfs merge=lfs -text
|
components/cuda/2610160820001/BUILD_INFO.cuda.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
|
| 3 |
Component of the opencoti pin format v2 (docs/protocols/PIN_FORMAT.md).
|
| 4 |
|
| 5 |
-
Built from the engine source of build 2610141255001; gated floor (engine-min) 2610141212001; gated with 2610160746001, 2610161700001,
|
| 6 |
|
| 7 |
| file | platform | kind | sha256 | bytes |
|
| 8 |
|---|---|---|---|---|
|
|
@@ -26,6 +26,8 @@ llama.cpp/ggml/src/ggml-backend-impl.h f9fdfe6bae61d1387593b40fc0f90ceee490c6a33
|
|
| 26 |
llamafile/gpu_backend.h 4929c36c034b6589e88653bcb7a5c5a225743a07320f64c0857d92bdaf048208
|
| 27 |
```
|
| 28 |
|
|
|
|
|
|
|
| 29 |
**Gated with the r4 engine 2610161700001 (2026-10-16), the same bytes as r3:** the glibc 2.28 image on bs2 PASS; the bug-4108 reproducer and greedy identity with r3 on the Linux library (RTX PRO 6000).
|
| 30 |
|
| 31 |
**xOllama on these bytes (2026-10-16; xOllama dev, the pin move to r3 (owner 2026-10-16 08:51), on the published bytes of index 7c1fa53f): PASS.** eleven2go RTX 3090, the Windows DLL 68cd73b1: qwen3:8b 124.5β125.1 tok/s (r2 124.2β125.1); f16-K / q8_0-V with flash attention 127.6β127.9 tok/s, prompt ~4.2k tok/s, attention on the GPU (bug-4090 fixed; the r2 DLL: 30.9); the engine gone 852 ms after a server kill. solidPC RTX 3090, the Linux library: G3 / G4 / G5 / G6 PASS (llama3 77.4 tok/s, four slots 311.2, council 6 / 6, speech 8 / 8, video 33 frames).
|
|
|
|
| 2 |
|
| 3 |
Component of the opencoti pin format v2 (docs/protocols/PIN_FORMAT.md).
|
| 4 |
|
| 5 |
+
Built from the engine source of build 2610141255001; gated floor (engine-min) 2610141212001; gated with 2610160746001, 2610161700001, 2610170942001, 2610171128001.
|
| 6 |
|
| 7 |
| file | platform | kind | sha256 | bytes |
|
| 8 |
|---|---|---|---|---|
|
|
|
|
| 26 |
llamafile/gpu_backend.h 4929c36c034b6589e88653bcb7a5c5a225743a07320f64c0857d92bdaf048208
|
| 27 |
```
|
| 28 |
|
| 29 |
+
**Gated with the r5 engine 2610170942001 (2026-10-17), the same bytes as r4:** the glibc 2.28 image on bs2 PASS; the notice gates (v2 and v3), the bug-4108 reproducer and greedy identity with r4 on the Linux library (RTX PRO 6000).
|
| 30 |
+
|
| 31 |
**Gated with the r4 engine 2610161700001 (2026-10-16), the same bytes as r3:** the glibc 2.28 image on bs2 PASS; the bug-4108 reproducer and greedy identity with r3 on the Linux library (RTX PRO 6000).
|
| 32 |
|
| 33 |
**xOllama on these bytes (2026-10-16; xOllama dev, the pin move to r3 (owner 2026-10-16 08:51), on the published bytes of index 7c1fa53f): PASS.** eleven2go RTX 3090, the Windows DLL 68cd73b1: qwen3:8b 124.5β125.1 tok/s (r2 124.2β125.1); f16-K / q8_0-V with flash attention 127.6β127.9 tok/s, prompt ~4.2k tok/s, attention on the GPU (bug-4090 fixed; the r2 DLL: 30.9); the engine gone 852 ms after a server kill. solidPC RTX 3090, the Linux library: G3 / G4 / G5 / G6 PASS (llama3 77.4 tok/s, four slots 311.2, council 6 / 6, speech 8 / 8, video 33 frames).
|
components/engine/2610171128001/BUILD_INFO.engine.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# engine 2610171128001
|
| 2 |
+
|
| 3 |
+
Component of the opencoti pin format v2 (docs/protocols/PIN_FORMAT.md).
|
| 4 |
+
|
| 5 |
+
| file | platform | kind | sha256 | bytes |
|
| 6 |
+
|---|---|---|---|---|
|
| 7 |
+
| `opencoti-0.10.5-c13-2610171128001` | any | bin | `98836c63f84b59dfa5abc90fef5b637470a75a0fe3fe622de12b32af1ec11540` | 145676430 |
|
| 8 |
+
| `opencoti-0.10.5-c13-2610171128001.exe` | win-x86_64 | bin | `98836c63f84b59dfa5abc90fef5b637470a75a0fe3fe622de12b32af1ec11540` | 145676430 |
|
| 9 |
+
|
| 10 |
+
ABI `ggml` = `bac5050ddc8c58c51f0b059a7f9753b33af0ed79d355090e7c9a17ffaaaf340a` (exported) β sha256 of this list:
|
| 11 |
+
|
| 12 |
+
```
|
| 13 |
+
llama.cpp/ggml/include/ggml-alloc.h 94e4cd069b9313b2ceb35dacec901981e0bb478d8bb31035b7126be091998c23
|
| 14 |
+
llama.cpp/ggml/include/ggml-backend.h 764d1640ad62579513c4837539708f89e8603c9dbeae053a13d1cbd84a82c865
|
| 15 |
+
llama.cpp/ggml/include/ggml-cuda.h 674ea064021cf5b9970e78f1209e513dd23350b94a44a705a27eec1423fe4b0a
|
| 16 |
+
llama.cpp/ggml/include/ggml-metal.h 322f36cd30f3e9e7aad7b5b9bc63078012fd0b7706ac4e24f5721b604f3d8980
|
| 17 |
+
llama.cpp/ggml/include/ggml-neo-pipeline.h 190f39e183542d16588a3104d8cb4359bf52fc7a62afe8d8cc4c822f4085086d
|
| 18 |
+
llama.cpp/ggml/include/ggml-oc-kvarn-range.h 76635fdd8978632f670640ddf5125a666441e3d47c680bb8b5c0a099e4861202
|
| 19 |
+
llama.cpp/ggml/include/ggml-oc-ledger.h c1be11d69a57a1e721f1ae8720b87887d239ac0183d4277fbaa07f1be257d20c
|
| 20 |
+
llama.cpp/ggml/include/ggml-vulkan.h f9df4f7161a84ce7600d53c3fac8a62837d5716676c9f38cd340699ef1c070d9
|
| 21 |
+
llama.cpp/ggml/include/ggml.h ecfbf114f9e9151d22e30ef6d5139570c5c41b595843ca4f99125bd0196709aa
|
| 22 |
+
llama.cpp/ggml/include/opencoti-devtype.h 94dea946173449bb76bffd7f733ab822fe658fe7198992de750ac012d29308ec
|
| 23 |
+
llama.cpp/ggml/src/ggml-backend-impl.h f9fdfe6bae61d1387593b40fc0f90ceee490c6a339ec6d7388c51e4fca318d8f
|
| 24 |
+
llamafile/gpu_backend.h 4929c36c034b6589e88653bcb7a5c5a225743a07320f64c0857d92bdaf048208
|
| 25 |
+
```
|
| 26 |
+
|
| 27 |
+
ABI `media` = `b099409b3029a6e380268e31d1caefa6706569961d32e72b3543fbc73903d95c` (exported) β sha256 of this list:
|
| 28 |
+
|
| 29 |
+
```
|
| 30 |
+
llamafile/oc-audiocpp/audiocpp.h 6ad0b55d5f28adc9ad60a45bf9a7caa428c4f5441389a6932d6670a8e2a90d73
|
| 31 |
+
llamafile/oc-codec/oc_codec_sidecar.h f2c9001d1414aa2a55533b867b79c52a52c682558e0234c5bebd30bf97b91005
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
ABI `loader` = `d6ff34022f1d3fb5af56ca0c80e3f4e552bf09f1bebdf0cb5f314a454bf38dbc` (exported) β sha256 of this list:
|
| 35 |
+
|
| 36 |
+
```
|
| 37 |
+
.cosmocc/4.0.2/bin/ape-m1.c 78af79e20abbb3f99a97355959b59bd58949564064adb754f0302ebabb4bf7a3
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
**c13 r5 dev snapshot β the development build of the c13 r5 release, for integration testing.** Engine 2610171128001 (`opencoti-0.10.5-c13`, dev channel) is built from the same source as the c13 r5 release engine 2610170942001 (chain 0001β0693; identical by content). The libraries are the r5 release index's β the r4 bytes, unchanged. This engine itself ran the glibc 2.28 route gate (Vulkan + CUDA), the notices v2 gates and the notices v3 gate on bs2, the copy-bar switch check included; the scoped regression gates of the release ran on 2610170942001 (see the release notes). The r4 dev snapshot was 2610161651001.
|
| 41 |
+
|
| 42 |
+
What is new in r5 (chain 0690β0693):
|
| 43 |
+
|
| 44 |
+
- **Generation notices contract v3** (0692, c13 row 46.1), opt-in per request with `"notices": {"version": 3, β¦}`; v2 stays the default and is unchanged. A v3 notice is one plain-text line in the model's own voice, planted as its own paragraph at a prose boundary: no `<engine_status>` frame and no bars. The built-in thinking lines carry the words left ("I'm stopping my thinking now and writing the answer β only {words} words left."), the answer lines do not ("I'm writing the conclusion now."). Every planted line is reported exactly, so a client can hide it: a top-level `notice` field on the stream chunk that carries the line's first token (`index`, `phase`, `channel`, `text`, `break`, and `cut` when the line was cut short), the list in `timings.notices`, and the built-in forms in `/props` `generation_notice.v3`. Routes: `/v1/chat/completions`, `/v1/completions`, `/completion`. Feature `generation_notice_v3`. Measured with the built-in v3 lines on the development build of this source (bs2, four models: Qwen3.6-27B, Nemotron 3.5 Lightning, Qwen3.5-9B, Gemma 4 E4B; answer cap 3000 with prompts asking ~3000 words, 24 answers each): answers that end inside the cap 13 of 96 without a notice, 64 of 96 with the v3 answer lines (per model 1 β 13, 1 β 20, 0 β 8, 11 β 23); no copy of a planted line in any answer.
|
| 45 |
+
- **The copy bar** (0693, c13 row 46.3, bug-4115), v3 only. A model can copy a line the engine planted: Qwen3.6-27B wrote a planted line again, verbatim, in about 1β2 % of thinking requests (3 of 168 with MTP self-speculation, 1 of 72 without), once or in a loop of up to 21 copies. A copy has no record, so a client hiding by the records shows it. Once the line being written would become the first 8 or more characters of a line planted earlier in the response, the token that continues the copy is refused, and the engine log names it. Measured on the development build: 0 copies in 216 Qwen3.6-27B-MTP thinking requests; thinking cut at the budget 21 against 22 times on the same 120 prompts and seeds; finished answers 64 of 96 with and without the bar; the same decode speed. On by default in both phases; `notices.copy_bar` switches it per request: `true`, `false`, or `{"think": bool, "answer": bool}` (a missing phase stays on; on a v2 request it is a 400). `/props` `generation_notice.v3.copy_bar` shows the defaults; feature `generation_notice_copy_bar`.
|
| 46 |
+
- **The notice bar no longer writes random tokens** (0690, bug-4112 / bug-4113, in every c13 build since r2). On the device sampling path a token refused by the bar was resampled from an all-zero logits row, i.e. at random from the whole vocabulary, which could write stub lines such as `<engine8_status β¦>` and start a loop of them. Now the engine keeps the row for every request with notices, and the built-in v2 wording is the model's own voice (S2), still in `<engine_status>β¦</engine_status>`.
|
| 47 |
+
- An experiment-only environment knob, `OPENCOTI_NOTICE_X_PLAIN` (0691), off by default.
|
| 48 |
+
|
| 49 |
+
What is new in r4 (chain 0689):
|
| 50 |
+
|
| 51 |
+
- **No placeholder token in the output where the notice bar acts** (0689, c13 row 45.1, bug-4108). Gemma 4's 6227 `<unusedNN>` tokens are ordinary tokens in its GGUF files; with notices on, Gemma 4 26B-A4B's own copy of a notice reached the reply as `<engine_<unused29>_status output_budget="140">β¦` (the built-in form) or `<system_notice` with `<unused22>` inside (a request template), or as a stray `<unused30>` right after a planted notice β visible, and not hidden by a client that hides from the notice's opening. Now a placeholder (marked unused, or named `<unusedN>` / `[unusedN]`) is never sampled while the bar is on, a line may not start with any template's opening character at a prose boundary after a notice, and the line right after a planted notice gets the same bar. Measured on the release bytes (2610161700001) (bs2, Gemma 4 26B-A4B Q4_K_M, the built-in form and a self-closing template, 48 answers each): 0 placeholders and 0 copies (r3: 2 + 1 and 9 + 12), every planted notice in the text.
|
| 52 |
+
|
| 53 |
+
What is new in r3 (chain 0666β0688):
|
| 54 |
+
|
| 55 |
+
- **The CPU at stock llama.cpp speed** (0666β0675, 0678, 0685β0687, c13 row 41.1). Measured on the release bytes (2610160746001) against stock llama.cpp b11521, Qwen3.6-35B-A3B UD-IQ3_XXS on the CPU: EPYC 9575F 6 threads **110.2 %** (r2 92.3 %), 1 thread 107.4 % (r2 88.3 %); Mac mini (Apple M-series, Metal off) 6 threads 99.7 % (r2 81.7 %), 4 threads 97.9 % (r2 77.4 %); Ryzen 5 5600G 6 threads 102.2 % (r2 96.1 %, a noisy host); Raspberry Pi 5 (Qwen2.5-1.5B, 4 threads) 104.2 % (r2 97.3 %). The causes, each fixed with stock's own code path: cosmopolitan's `memcpy` copied backward (a forward copy replaces it); flash attention runs on the CPU as in stock (llamafile's layer turned it off); stock's tiled int8 matmul for K / IQ quant prompts; stock's Q8_0 / Q4_0 prompt kernel (with an AVX-VNNI copy); f16 V rows converted at the variant's ISA; the CPU work buffer 64-byte aligned; F16 / BF16 prompt matmuls reach stock's kernel; ARM kernels built with clang and tuned for Apple cores; IQ2_S matrix Γ vector on ARM through stock's kernel; no OpenMP (ggml's own threadpool, as stock's portable builds); a CPU-only engine samples on the host; on macOS a recurrent state on the CPU is f32. `--recurrent-state-type {bf16,f16,f32}` (0680).
|
| 56 |
+
- **CPUSet core selection** (0671, row 41.2; a port of the owner's llama.cpp PR #6832): threads are pinned, the default pick is physical cores, no efficiency cores, one last level cache (the prompt pool gets every last level cache); Windows CPU sets across processor groups (no 64-core limit). `--cpuset on|off`, `-bco`, `-llct`, `-atc`, `--cpuset-skip-core0`. Thread placement had never run in an opencoti build (bug-4080). i5-14600K: 115.2 % of stock native, 9950X3D 103.7 %.
|
| 57 |
+
- **cpp-httplib 0.60.1** (0676, 0688, row 41.3): with stock's build definitions β a request body over 8 KB without a JSON content type is accepted (HTTP 413 before, bug-4082); a realtime websocket message that arrives in pieces no longer ends the session (bug-4105).
|
| 58 |
+
- **Generation notices, contract v2** (0681, 0682, 0684, row 41.4; feature `generation_notice_v2`): the request's `notices` object (steps by `at_percent` or `left`, templates with `{left}` / `{total}`), `--notice-templates FILE`, `--print-notice-config`, `/props` `generation_notice` (the templates and the spans a client hides), `timings.notices_planted`, `POST /v1/notice {key, kind: "message_waiting"}` (through the router by key). A notice is planted only at a prose boundary, never inside code, and only while 200 or more tokens of its phase are left.
|
| 59 |
+
- **`num_ctx_hold`** (0683, row 41.6; feature `elastic_window_unheld_v1`): `false` sizes the window from `num_ctx` / `num_ctx_min` and releases it at the end of the request, with a `session_id` too.
|
| 60 |
+
- **Tool calls keep Windows path backslashes** (0679, bug-4092).
|
| 61 |
+
- **The Windows CUDA library runs flash attention with mixed K / V types on the GPU** (bug-4090): every Windows DLL since c10 r3 was built without `GGML_CUDA_FA_ALL_QUANTS`, so an f16-K / q8_0-V cache ran attention on the CPU. New cuda component 2610160820001.
|
components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98836c63f84b59dfa5abc90fef5b637470a75a0fe3fe622de12b32af1ec11540
|
| 3 |
+
size 145676430
|
components/engine/2610171128001/opencoti-0.10.5-c13-2610171128001.exe
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98836c63f84b59dfa5abc90fef5b637470a75a0fe3fe622de12b32af1ec11540
|
| 3 |
+
size 145676430
|
components/vulkan/2610141455004/BUILD_INFO.vulkan.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
|
| 3 |
Component of the opencoti pin format v2 (docs/protocols/PIN_FORMAT.md).
|
| 4 |
|
| 5 |
-
Built from the engine source of build 2610141255001; gated floor (engine-min) 2610141212001; gated with 2610141255001, 2610141633001, 2610160746001, 2610161700001,
|
| 6 |
|
| 7 |
| file | platform | kind | sha256 | bytes |
|
| 8 |
|---|---|---|---|---|
|
|
@@ -26,6 +26,8 @@ llama.cpp/ggml/src/ggml-backend-impl.h f9fdfe6bae61d1387593b40fc0f90ceee490c6a33
|
|
| 26 |
llamafile/gpu_backend.h 4929c36c034b6589e88653bcb7a5c5a225743a07320f64c0857d92bdaf048208
|
| 27 |
```
|
| 28 |
|
|
|
|
|
|
|
| 29 |
**Gated with the r4 engine 2610161700001 (2026-10-16), the same bytes as r3:** the glibc 2.28 image on bs2 PASS; the Linux library.
|
| 30 |
|
| 31 |
**xOllama on these bytes with the r3 engine 2610160746001 (2026-10-16; xOllama dev, the pin move to r3 (owner 2026-10-16 08:51), on the published bytes of index 7c1fa53f): PASS.** eleven2go (Windows 11): RX 9070 XT, pinned by name, 100.5β103.3 tok/s, 103.9 after 120 s loaded idle, the card OK, 0 LiveKernelReports; Radeon iGPU 5.0 tok/s, 37 / 37 layers. The Linux library: not run by xOllama for r3.
|
|
|
|
| 2 |
|
| 3 |
Component of the opencoti pin format v2 (docs/protocols/PIN_FORMAT.md).
|
| 4 |
|
| 5 |
+
Built from the engine source of build 2610141255001; gated floor (engine-min) 2610141212001; gated with 2610141255001, 2610141633001, 2610160746001, 2610161700001, 2610170942001, 2610171128001.
|
| 6 |
|
| 7 |
| file | platform | kind | sha256 | bytes |
|
| 8 |
|---|---|---|---|---|
|
|
|
|
| 26 |
llamafile/gpu_backend.h 4929c36c034b6589e88653bcb7a5c5a225743a07320f64c0857d92bdaf048208
|
| 27 |
```
|
| 28 |
|
| 29 |
+
**Gated with the r5 engine 2610170942001 (2026-10-17), the same bytes as r4:** the glibc 2.28 image on bs2 PASS; the Linux library.
|
| 30 |
+
|
| 31 |
**Gated with the r4 engine 2610161700001 (2026-10-16), the same bytes as r3:** the glibc 2.28 image on bs2 PASS; the Linux library.
|
| 32 |
|
| 33 |
**xOllama on these bytes with the r3 engine 2610160746001 (2026-10-16; xOllama dev, the pin move to r3 (owner 2026-10-16 08:51), on the published bytes of index 7c1fa53f): PASS.** eleven2go (Windows 11): RX 9070 XT, pinned by name, 100.5β103.3 tok/s, 103.9 after 120 s loaded idle, the card OK, 0 LiveKernelReports; Radeon iGPU 5.0 tok/s, 37 / 37 layers. The Linux library: not run by xOllama for r3.
|