Hugging Face's logo

jfan
/
litert-lm-web-runtime

LiteRT
LiteRT-LM
webgpu
wasm
gemma4
mtp
speculative-decoding
vision
audio
Model card Files
xet
 Community
litert-lm-web-runtime

Commit History

Today

  1. Stage wasm_dev_flash_rows2/ (-c opt, zvoytmmv: skip-tiling + lazy rescale + 64 threads x 2 rows/thread)

    jfan
    Verified signature
    0b1476c

  2. Stage wasm_dev_flash_lazy/ (-c opt, zvoytmmv: skip-tiling + lazy rescale, 128x1)

    jfan
    Verified signature
    71eeae5

  3. Stage wasm_dev_flash/ (-c opt, zvoytmmv skip-tiling-only variant: TileDecomposedAttention leaves fusable chains whole, 128x1, always-rescale)

    jfan
    Verified signature
    55df2d9

Yesterday

  1. Stage wasm_dev_flash/ (-c opt WASM runtime from qnszmuyt cc530645091c74 with FusedAttention special kernel)

    jfan
    Verified signature
    a187de5

2 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with bounded-in-flight prefill command buffers (min(128, 16384/group_size)), createLegacyEngine/createStreaming compatibility, and prune wasm_dev_jank_v*

    jfan
    Verified signature
    09af975

  2. Stage prefill jank sweep WASM runtime variants v0..v3

    jfan
    Verified signature
    12dabe1

  3. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with 1120 vision support and 57-CL stack optimizations

    jfan
    Verified signature
    10e35c7

  4. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with 1120 vision adapter selection fix (mszqroqq) and 10080 patches support

    jfan
    Verified signature
    1a8a435

3 days ago

  1. Update LiteRT-LM Web runtime (0.18.1) with standardized 26B/31B vision support, trailing EOI rope mask fix, and SRQ FP16 capability guard

    jfan
    Verified signature
    77afd1b

4 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with windowed [MTP_TELEMETRY]/[DECODE_TELEMETRY] (long-turn decay investigation, base CL 996998560) and prune main to one wasm set + one tgz

    jfan
    Verified signature
    300976b

  2. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with L2 DP bucket calibration and L4 fused MoE⁠

    jfan
    Verified signature
    6064f7b

5 days ago

  1. Release @litert-lm /core 0.18.1 -c opt WebGPU WASM runtime with windowed [MTP_TELEMETRY]/[DECODE_TELEMETRY] (long-turn decay investigation, base CL 996998560) and prune main to one wasm set + one tgz

    jfan
    Verified signature
    7a3e421

  2. Dev runtime: windowed [MTP_TELEMETRY]/[DECODE_TELEMETRY], O(gamma) spec rewind, getBenchmarkInfo throttle (long-turn decay investigation)

    jfan
    Verified signature
    e308929

  3. Fix minijinja Chainable undefined behavior and guard empty messages in Gemma 4 templates (@litert-lm /core 0.18.1)

    jfan
    Verified signature
    4041721

  4. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime (Wave 2/4 stack: H2 rewind fallback + mutex fix, MTP token accounting, A0 AutoToolChat & vision defaults, A1 native profiler)

    jfan
    Verified signature
    4e679d1

6 days ago

  1. Release final validated 66-CL stack -c opt WebGPU WASM runtime & @litert-lm /core@0.18.1 (M-ARCH, V12-fix, Track R, E2 non-blocking refill, P1 host parity shader drain)

    jfan
    Verified signature
    037940c

  2. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime (all tracks R, V12-fix, M-ARCH, M5 V1..V6/E1..E2/P1..P3 merged)

    jfan
    Verified signature
    87c67e6

7 days ago

  1. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, Phase 3 T-D3a + T-D1 v2 + T-D3c + Task V)

    jfan
    Verified signature
    3f30428

8 days ago

  1. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, dc3acde07086)

    jfan
    Verified signature
    bc3197e

  2. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt, e98354862e6c)

    jfan
    Verified signature
    db4c78a

  3. Release @litert-lm /core 0.18.1 WASM runtime & JS SDK (-c opt)

    jfan
    Verified signature
    6348755

9 days ago

  1. Release post-fix WebGPU WASM runtime (out-of-order tensor read fix in fused residual norm for sequence_size >= 1)

    jfan
    Verified signature
    0215477

  2. Update LiteRT-LM Web runtime with prefill (P1-P7d) and decode (OPT-M2+M3 ScoreTokens staging & greedy drafter remap) optimizations

    jfan
    Verified signature
    83b1099

  3. Update LiteRT-LM Web runtime with prefill (P1-P7d) and decode (OPT-M2+M3 ScoreTokens staging & greedy drafter remap) optimizations

    jfan
    Verified signature
    9fce354

  4. Fix Gemma 4 12B MTP suppressed-token masking (scoring_post_processing_, centroid_constraint_mask, shared drafter config) and RejectAfterResample token_override preservation

    jfan
    Verified signature
    1b10bee

  5. Update wasm_vision_hires with WGSL vec4<f16> constructor fix

    jfan
    Verified signature
    7a8ad36

  6. Fix WGSL vec4<f16>(f32) constructor type mismatch in MakeFusedResidualNorm and DequantizeEmbedding

    jfan
    Verified signature
    aad8c95

  7. Release @litert-lm /core 0.18.1: fix Apple Silicon prefill ringed_weights shader explosion, WebGPU device loss, and ReadBufferDataJs OOB

    jfan
    Verified signature
    e05399f

10 days ago

  1. Release -c opt WebGPU WASM runtime & @litert-lm /core@0.18.1: 64k CleanCacheOp/CopyCacheOp dispatch fix, decode subgraph deduplication, lazy vision/audio executor init, <empty_linear> warning fix, and live streaming benchmark cache

    jfan
    Verified signature
    36a37c6

  2. Restore subgraph deduplication, lazy multimodal WebGPU compile, and 64k cache grid fix

    jfan
    Verified signature
    27ad698

  3. Release @litert-lm /core@0.18.1 + -c opt WebGPU WASM runtime, fresh build from stack top cl/995335252 (includes cl/994475540, cl/995291160, cl/995335252)

    jfan
    Verified signature
    a543cf3

  4. Release -c opt WebGPU WASM runtime & @litert-lm /core@0.18.0-dev: Artisan decode FC linking, fake-quant dedupe, ring KV cache (+21% E2B standard decode on V100); stack synced to cl/995128901

    jfan
    Verified signature
    2239bdc

  5. Release @litert-lm /core 0.18.0 / 0.18.0-dev: RMSNorm gamma fusion (cl/994475540), cumulative vision compile/encode telemetry in litertlm_web.cc

    jfan
    Verified signature
    adc4310

  6. Update LiteRT-LM Web Wasm runtime: LinkNodes operand swaps and GEMV reduction

    jfan
    Verified signature
    83c717f

  7. Update LiteRT-LM Web Wasm runtime: validated optimizations

    jfan
    Verified signature
    2a32aa8

11 days ago

  1. Release optimized -c opt WebGPU WASM runtime & @litert-lm /core@0.18.0-dev (clean ESM build, zero goog.*, EXP_WALLCLOCK_TUNE deadlock eliminated)

    jfan
    Verified signature
    166bee2

  2. Release WebGPU WASM runtime & @litert-lm /core with baseline decode speedup (+40.77% on Gemma 4 E2B)

    jfan
    Verified signature
    3ea6403

  3. Release latest WebGPU WASM runtime & @litert-lm /core (GEMV decode, bind group dispatch, graph fusions, and 26B real audio+MTP)

    jfan
    Verified signature
    5afe7c8

  4. Release @litert-lm /core@0.18.0-dev (2026-10-06): drafter GPU config no longer inherits main-model MoE/laurel/altup config; built from workspace investigate_multimodal_web_support_jj @ cl/994039145

    jfan
    Verified signature
    f0d711e

12 days ago

  1. Release Gemma 4 MTP speculative acceptance gap closure runtime & @litert-lm /core 0.18.0

    jfan
    Verified signature
    fa9d3f0

  2. Fix MTP unseeded TOP_P greedy verification alignment + retain cached KV scales for InitShared

    jfan
    Verified signature
    f9a10ee

  3. Fix 12B/26B/31B multimodal audio/vision initialization and enable realtime MTP acceptance telemetry during streaming

    jfan
    Verified signature
    8d04d9a

  4. Fix MTP shared KV scale cache retention across streaming LlmWebGpu::Init -> InitShared

    jfan
    Verified signature
    1795933

  5. Update WASM runtime (-c opt) and @litert-lm /core 0.18.0-dev / 0.18.0 npm tarballs after stack slimming

    jfan
    Verified signature
    576ce9e

13 days ago

  1. Rebuild WASM runtime with audio executor model_resources fix (streamed audio sections)

    jfan
    Verified signature
    800aaac

  2. Publish clean ESM @litert-lm /core@0.18.0 bundle and -c opt WASM runtime

    jfan
    Verified signature
    3171277

  3. Publish @litert-lm /core@0.18.1-dev ESM clean tsc build (fix goog is not defined)

    jfan
    Verified signature
    c67ea5b

  4. Re-export @litert-lm /core@0.18.0-dev using standard tsc (no Google3 closure rules) & recompiled opt wasm

    jfan
    Verified signature
    2bf2459

14 days ago

  1. Release @litert-lm /core@0.18.0-dev: MTP GPU PLE gather + full-vocabulary drafter head (1.44x MTP), audio FP32 fixes; synced to cl/992674170

    jfan
    Verified signature
    f938177

  2. Fix Gemma 4 USM Conformer GPU audio FP32 activation precision and AudioAdapter input buffer indexing

    jfan
    Verified signature
    3e011cd