Hugging Face's logo

jfan
/
litert-lm-web-runtime

LiteRT
LiteRT-LM
webgpu
wasm
gemma4
mtp
speculative-decoding
vision
audio
metal
Model card Files
xet
 Community
litert-lm-web-runtime / packages

Commit History

Yesterday

  1. Release @litert-lm /core 0.18.3 -c opt WebGPU WASM runtime (Piper HEAD CL 1014981939) with spatial_w_groups FC tiling and text scoring

    jfan
    Verified signature
    2ad809f

8 days ago

  1. Release @litert-lm /core 0.18.3 WebGPU WASM runtime + Python 0.18.3 wheels (Lever 13c: Audio Adapter on WebGPU, + Lever 4b + 12B MQA)

    jfan
    Verified signature
    c65c12c

  2. Release @litert-lm /core 0.18.3 WebGPU WASM runtime + Python 0.18.3 wheels (Lever 13c: Audio Adapter on WebGPU, + Lever 4b + 12B MQA)

    jfan
    Verified signature
    b9bc9aa

9 days ago

  1. Release @litert-lm /core 0.18.3 WebGPU WASM runtime + Python 0.18.3 wheels (lever4b multimodal prefill speedup, 12B MQA Metal shader fix, Metal & Linux wheels)

    jfan
    Verified signature
    0fe1694

16 days ago

  1. Release @litert-lm /core 0.18.2 WebGPU WASM runtime + Python 0.18.2 wheels (subgroup-matrix, decide() API, Metal & Linux wheels)

    jfan
    Verified signature
    753bff8

19 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with FusedAttention ViT self-attention (qnszmuyt) and untiled fusable attention chains (zvoytmmv): M5 Pro E4B vision encode -15% at 1120

    jfan
    Verified signature
    87f3f2b

22 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with bounded-in-flight prefill command buffers (min(128, 16384/group_size)), createLegacyEngine/createStreaming compatibility, and prune wasm_dev_jank_v*

    jfan
    Verified signature
    09af975

  2. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with 1120 vision support and 57-CL stack optimizations

    jfan
    Verified signature
    10e35c7

  3. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with 1120 vision adapter selection fix (mszqroqq) and 10080 patches support

    jfan
    Verified signature
    1a8a435

23 days ago

  1. Update LiteRT-LM Web runtime (0.18.1) with standardized 26B/31B vision support, trailing EOI rope mask fix, and SRQ FP16 capability guard

    jfan
    Verified signature
    77afd1b

24 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with windowed [MTP_TELEMETRY]/[DECODE_TELEMETRY] (long-turn decay investigation, base CL 996998560) and prune main to one wasm set + one tgz

    jfan
    Verified signature
    300976b

  2. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with L2 DP bucket calibration and L4 fused MoE⁠

    jfan
    Verified signature
    6064f7b

25 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with windowed [MTP_TELEMETRY]/[DECODE_TELEMETRY] (long-turn decay investigation, base CL 996998560) and prune main to one wasm set + one tgz

    jfan
    Verified signature
    7a3e421

  2. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime (Wave 2/4 stack: H2 rewind fallback + mutex fix, MTP token accounting, A0 AutoToolChat & vision defaults, A1 native profiler)

    jfan
    Verified signature
    4e679d1

26 days ago

  1. Release final validated 66-CL stack -c opt WebGPU WASM runtime & @litert-lm /core@0.18.1 (M-ARCH, V12-fix, Track R, E2 non-blocking refill, P1 host parity shader drain)

    jfan
    Verified signature
    037940c

  2. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime (all tracks R, V12-fix, M-ARCH, M5 V1..V6/E1..E2/P1..P3 merged)

    jfan
    Verified signature
    87c67e6

27 days ago

  1. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, Phase 3 T-D3a + T-D1 v2 + T-D3c + Task V)

    jfan
    Verified signature
    3f30428

28 days ago

  1. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, dc3acde07086)

    jfan
    Verified signature
    bc3197e

  2. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, e98354862e6c)

    jfan
    Verified signature
    db4c78a

  3. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt)

    jfan
    Verified signature
    6348755

29 days ago

  1. Update LiteRT-LM Web runtime with prefill (P1-P7d) and decode (OPT-M2+M3 ScoreTokens staging & greedy drafter remap) optimizations

    jfan
    Verified signature
    83b1099

  2. Update LiteRT-LM Web runtime with prefill (P1-P7d) and decode (OPT-M2+M3 ScoreTokens staging & greedy drafter remap) optimizations

    jfan
    Verified signature
    9fce354

  3. Fix Gemma 4 12B MTP suppressed-token masking (scoring_post_processing_, centroid_constraint_mask, shared drafter config) and RejectAfterResample token_override preservation

    jfan
    Verified signature
    1b10bee

  4. Release @litert-lm /core 0.18.1: fix Apple Silicon prefill ringed_weights shader explosion, WebGPU device loss, and ReadBufferDataJs OOB

    jfan
    Verified signature
    e05399f

30 days ago

  1. Release -c opt WebGPU WASM runtime & @litert-lm /core@0.18.1: 64k CleanCacheOp/CopyCacheOp dispatch fix, decode subgraph deduplication, lazy vision/audio executor init, <empty_linear> warning fix, and live streaming benchmark cache

    jfan
    Verified signature
    36a37c6

  2. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime, fresh build from stack top cl/995335252 (includes cl/994475540, cl/995291160, cl/995335252)

    jfan
    Verified signature
    a543cf3

  3. Release -c opt WebGPU WASM runtime & @litert-lm /core@0.18.0-dev: Artisan decode FC linking, fake-quant dedupe, ring KV cache (+21% E2B standard decode on V100); stack synced to cl/995128901

    jfan
    Verified signature
    2239bdc

  4. Release @litert-lm /core 0.18.0 / 0.18.0-dev: RMSNorm gamma fusion (cl/994475540), cumulative vision compile/encode telemetry in litertlm_web.cc

    jfan
    Verified signature
    adc4310

  1. Release optimized -c opt WebGPU WASM runtime & @litert-lm /core@0.18.0-dev (clean ESM build, zero goog.*, EXP_WALLCLOCK_TUNE deadlock eliminated)

    jfan
    Verified signature
    166bee2

  2. Release WebGPU WASM runtime & @litert-lm /core with baseline decode speedup (+40.77% on Gemma 4 E2B)

    jfan
    Verified signature
    3ea6403

  3. Release latest WebGPU WASM runtime & @litert-lm /core (GEMV decode, bind group dispatch, graph fusions, and 26B real audio+MTP)

    jfan
    Verified signature
    5afe7c8

  4. Release @litert-lm /core@0.18.0-dev (2026-10-06): drafter GPU config no longer inherits main-model MoE/laurel/altup config; built from workspace investigate_multimodal_web_support_jj @ cl/994039145

    jfan
    Verified signature
    f0d711e

  1. Release Gemma 4 MTP speculative acceptance gap closure runtime & @litert-lm /core 0.18.0

    jfan
    Verified signature
    fa9d3f0

  2. Fix MTP unseeded TOP_P greedy verification alignment + retain cached KV scales for InitShared

    jfan
    Verified signature
    f9a10ee

  3. Fix 12B/26B/31B multimodal audio/vision initialization and enable realtime MTP acceptance telemetry during streaming

    jfan
    Verified signature
    8d04d9a

  4. Fix MTP shared KV scale cache retention across streaming LlmWebGpu::Init -> InitShared

    jfan
    Verified signature
    1795933

  5. Update WASM runtime (-c opt) and @litert-lm /core 0.18.0-dev / 0.18.0 npm tarballs after stack slimming

    jfan
    Verified signature
    576ce9e

  1. Publish clean ESM @litert-lm /core@0.18.0 bundle and -c opt WASM runtime

    jfan
    Verified signature
    3171277

  2. Publish @litert-lm /core@0.18.1-dev ESM clean tsc build (fix goog is not defined)

    jfan
    Verified signature
    c67ea5b

  3. Re-export @litert-lm /core@0.18.0-dev using standard tsc (no Google3 closure rules) & recompiled opt wasm

    jfan
    Verified signature
    2bf2459

  1. Release @litert-lm /core@0.18.0-dev: MTP GPU PLE gather + full-vocabulary drafter head (1.44x MTP), audio FP32 fixes; synced to cl/992674170

    jfan
    Verified signature
    f938177

  1. Release @litert-lm /core@0.18.0-dev: fix PLE decode garbage, MTP quantized centroid scoring, deferred vision signature selection (vision_280 only)

    jfan
    Verified signature
    c9ed261

  2. Release @litert-lm /core@0.18.0-dev WASM runtime and tarball from latest 53-CL stack

    jfan
    Verified signature
    93ec636

  3. Release @litert-lm /core@0.18.0-dev with cross-backend multimodal memory optimizations

    jfan
    Verified signature
    c538263

  1. Release WebGPU WASM runtime & @litert-lm /core v0.17.10-dev (unified cross-backend MTP & multimodal WebGPU runtime)

    jfan
    Verified signature
    7f48691

  1. Release WebGPU WASM runtime & @litert-lm /core v0.17.10 (V100 WebGPU MTP & vision optimizations, live tool streaming, browser RGBA8 decode)

    jfan
    Verified signature
    1d5779d

  1. Release LiteRT-LM Web Runtime 0.17.9-dev (clean 111-entry tarball + latest -c opt WASM)

    jfan
    Verified signature
    e9432c9

  2. Build latest WebGPU WASM runtime & @litert-lm /core (DraftTokens drafter_pos KV slot fix + Leviathan rejection sampling + top-p WGSL + media_cache_size_)

    jfan
    Verified signature
    ef70a47

  3. Update WebGPU WASM runtime and core bundle with ConvGeneric fix for E4B

    jfan
    Verified signature
    39dae62

  4. Update WebGPU WASM runtime and @litert-lm /core 0.17.9-dev with E2B/E4B vision & prefill fixes

    jfan
    Verified signature
    a539ccc