Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -99,8 +99,8 @@ for await (const text of stream) Deno.stdout.write(new TextEncoder().encode(text
|
|
| 99 |
console.log(await stream.done); // { reason: "eos" | "max-tokens" | "aborted", … }
|
| 100 |
```
|
| 101 |
|
| 102 |
-
Messages are plain `system` / `user` / `assistant` turns; tool calls,
|
| 103 |
-
and image or audio parts are rejected rather than silently dropped.
|
| 104 |
With no `sampler` in the request, generation uses this repository's recommended default: temperature 1.0, top-k 64, top-p 0.95.
|
| 105 |
Weights are fetched once and cached (verified against `karume.json`'s `size` / `sha256`).
|
| 106 |
|
|
@@ -129,4 +129,4 @@ checked against each other when this repository was assembled.
|
|
| 129 |
- **recommended sampler**: temperature 1.0, top-k 64, top-p 0.95 — used when a request omits
|
| 130 |
`sampler`; pass `{ temperature: 0 }` for greedy decoding
|
| 131 |
- **stop tokens** come from the tokenizer asset in this repository, not from the caller
|
| 132 |
-
- **device limits**: `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B
|
|
|
|
| 99 |
console.log(await stream.done); // { reason: "eos" | "max-tokens" | "aborted", … }
|
| 100 |
```
|
| 101 |
|
| 102 |
+
Messages are plain `system` / `developer` / `user` / `assistant` turns; tool calls,
|
| 103 |
+
thinking channels and image or audio parts are rejected rather than silently dropped.
|
| 104 |
With no `sampler` in the request, generation uses this repository's recommended default: temperature 1.0, top-k 64, top-p 0.95.
|
| 105 |
Weights are fetched once and cached (verified against `karume.json`'s `size` / `sha256`).
|
| 106 |
|
|
|
|
| 129 |
- **recommended sampler**: temperature 1.0, top-k 64, top-p 0.95 — used when a request omits
|
| 130 |
`sampler`; pass `{ temperature: 0 }` for greedy decoding
|
| 131 |
- **stop tokens** come from the tokenizer asset in this repository, not from the caller
|
| 132 |
+
- **device limits**: `maxBufferSize` ≥ 402,653,184 B / `maxStorageBufferBindingSize` ≥ 402,653,184 B (the largest single tensor must bind)
|