Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- webgpu
|
| 5 |
+
- wasm
|
| 6 |
+
- in-browser
|
| 7 |
+
- asr
|
| 8 |
+
- tts
|
| 9 |
+
- vad
|
| 10 |
+
- speech
|
| 11 |
+
- fluidaudio
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# FluidAudio Web — raw model weights
|
| 15 |
+
|
| 16 |
+
Model weights for **[fluidaudio-web](https://github.com/FluidInference/fluidaudio-web)**:
|
| 17 |
+
fully in-browser inference (WebGPU + WebAssembly) for FluidAudio's speech models.
|
| 18 |
+
|
| 19 |
+
These are **raw weights only — no ONNX, no onnxruntime.** Each engine is a
|
| 20 |
+
hand-written forward pass (WebGPU/WASM/JS) that loads these tensors directly and,
|
| 21 |
+
where applicable, dequantizes them in-shader. Weights are extracted from the
|
| 22 |
+
source models and parity-verified against the originals before publishing.
|
| 23 |
+
|
| 24 |
+
## Layout (one folder per engine)
|
| 25 |
+
|
| 26 |
+
| folder | model | status |
|
| 27 |
+
|---|---|---|
|
| 28 |
+
| `vad/` | Silero VAD v5 (16 kHz) | ✅ available (fp32) |
|
| 29 |
+
| `parakeet/` | Parakeet TDT 0.6B v3 (encoder + decoder/joint) | 🚧 in progress (int4/palettized) |
|
| 30 |
+
| `kokoro/` | Kokoro TTS 82M | 🚧 planned |
|
| 31 |
+
| `nemotron/` · `eou/` · `sortformer/` · `whisper/` | streaming ASR / EOU / diarization / multilingual ASR | 🚧 planned |
|
| 32 |
+
|
| 33 |
+
## Format
|
| 34 |
+
|
| 35 |
+
- `*.bin` — concatenated little-endian tensors.
|
| 36 |
+
- `manifest.json` — `name -> { dims, offset, len }` (offset/len in **elements**, not bytes).
|
| 37 |
+
|
| 38 |
+
Load: fetch the `.bin`, slice each tensor per the manifest. Extraction scripts and
|
| 39 |
+
the forward passes live in the fluidaudio-web repo (`scripts/`, `src/engines/`).
|
| 40 |
+
|
| 41 |
+
Quantized engines additionally carry per-tensor scales / palettes (documented per
|
| 42 |
+
folder) for in-shader dequant.
|