hdae commited on
Commit
69ca9d7
·
verified ·
1 Parent(s): 591efc3

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -99,8 +99,8 @@ for await (const text of stream) Deno.stdout.write(new TextEncoder().encode(text
99
  console.log(await stream.done); // { reason: "eos" | "max-tokens" | "aborted", … }
100
  ```
101
 
102
- Messages are plain `system` / `user` / `assistant` turns; tool calls, thinking channels
103
- and image or audio parts are rejected rather than silently dropped.
104
  With no `sampler` in the request, generation uses this repository's recommended default: temperature 1.0, top-k 64, top-p 0.95.
105
  Weights are fetched once and cached (verified against `karume.json`'s `size` / `sha256`).
106
 
@@ -129,4 +129,4 @@ checked against each other when this repository was assembled.
129
  - **recommended sampler**: temperature 1.0, top-k 64, top-p 0.95 — used when a request omits
130
  `sampler`; pass `{ temperature: 0 }` for greedy decoding
131
  - **stop tokens** come from the tokenizer asset in this repository, not from the caller
132
- - **device limits**: `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B / `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B / `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B (the largest single tensor must bind)
 
99
  console.log(await stream.done); // { reason: "eos" | "max-tokens" | "aborted", … }
100
  ```
101
 
102
+ Messages are plain `system` / `developer` / `user` / `assistant` turns; tool calls,
103
+ thinking channels and image or audio parts are rejected rather than silently dropped.
104
  With no `sampler` in the request, generation uses this repository's recommended default: temperature 1.0, top-k 64, top-p 0.95.
105
  Weights are fetched once and cached (verified against `karume.json`'s `size` / `sha256`).
106
 
 
129
  - **recommended sampler**: temperature 1.0, top-k 64, top-p 0.95 — used when a request omits
130
  `sampler`; pass `{ temperature: 0 }` for greedy decoding
131
  - **stop tokens** come from the tokenizer asset in this repository, not from the caller
132
+ - **device limits**: `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B (the largest single tensor must bind)