llm.js → latest llama.cpp wasm32 · CPU · no WebGPU

Same LLM API as llm.js, running current llama.cpp. Models live in a local library: downloaded from a URL or read straight off your disk — never both.
engine launch

how launch settings apply

Applied when a model loads — press Reload engine after changing them. One parallel sequence: extra slots would only duplicate a cache a single user cannot fill. A quantized V cache needs flash attention; asking for one switches it on. KV memory grows with context length.

Flag a GGUF as mmproj in the model library to choose it here. Then attach images to a message (button or drag & drop); the image goes into the prompt as the projector's media marker.

idle

chat completion

This list is the conversation. Generate appends an assistant turn and streams into it; Stop keeps whatever has already arrived and the turn stays editable.