alexwengg commited on
Commit
91654d7
·
verified ·
1 Parent(s): f1d871b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - webgpu
5
+ - wasm
6
+ - in-browser
7
+ - asr
8
+ - tts
9
+ - vad
10
+ - speech
11
+ - fluidaudio
12
+ ---
13
+
14
+ # FluidAudio Web — raw model weights
15
+
16
+ Model weights for **[fluidaudio-web](https://github.com/FluidInference/fluidaudio-web)**:
17
+ fully in-browser inference (WebGPU + WebAssembly) for FluidAudio's speech models.
18
+
19
+ These are **raw weights only — no ONNX, no onnxruntime.** Each engine is a
20
+ hand-written forward pass (WebGPU/WASM/JS) that loads these tensors directly and,
21
+ where applicable, dequantizes them in-shader. Weights are extracted from the
22
+ source models and parity-verified against the originals before publishing.
23
+
24
+ ## Layout (one folder per engine)
25
+
26
+ | folder | model | status |
27
+ |---|---|---|
28
+ | `vad/` | Silero VAD v5 (16 kHz) | ✅ available (fp32) |
29
+ | `parakeet/` | Parakeet TDT 0.6B v3 (encoder + decoder/joint) | 🚧 in progress (int4/palettized) |
30
+ | `kokoro/` | Kokoro TTS 82M | 🚧 planned |
31
+ | `nemotron/` · `eou/` · `sortformer/` · `whisper/` | streaming ASR / EOU / diarization / multilingual ASR | 🚧 planned |
32
+
33
+ ## Format
34
+
35
+ - `*.bin` — concatenated little-endian tensors.
36
+ - `manifest.json` — `name -> { dims, offset, len }` (offset/len in **elements**, not bytes).
37
+
38
+ Load: fetch the `.bin`, slice each tensor per the manifest. Extraction scripts and
39
+ the forward passes live in the fluidaudio-web repo (`scripts/`, `src/engines/`).
40
+
41
+ Quantized engines additionally carry per-tensor scales / palettes (documented per
42
+ folder) for in-shader dequant.