supertonic-2-web / README.md
rapidrabbit76's picture
Add webgpu/ float16-compute variant for lower GPU memory
566d907 verified
|
Raw History Blame Contribute Delete
1.97 kB
metadata
license: openrail
base_model:
  - supertone-oss-archive/supertonic-2
language:
  - ko
  - en
  - es
  - pt
  - fr
pipeline_tag: text-to-speech
library_name: onnx
tags:
  - onnxruntime-web
  - webgpu

Supertonic 2 โ€” web (fp16 weights)

Supertonic 2๋ฅผ ๋ธŒ๋ผ์šฐ์ €(onnxruntime-web, WebGPUยทWASM)์—์„œ ๊ฐ€๋ณ๊ฒŒ ๋ฐ›๋„๋ก ๋‹ค์‹œ ์ €์žฅํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์„œ๊ฐ€(Seoga) ๋ฆฌ๋”์˜ "์„œ๊ฐ€ ์Œ์„ฑ"์ด ์ด ํŒŒ์ผ์„ ๋ฐ›์•„ ๊ธฐ๊ธฐ์—์„œ ํ•ฉ์„ฑํ•ฉ๋‹ˆ๋‹ค.

A browser-friendly repackaging of Supertone Supertonic 2 (revision 7edbcd0bba8cd579100a353a9e0b2b49cad7c875) for onnxruntime-web (WebGPU / WASM).

What changed

  • Large float32 initializers (โ‰ฅ1024 elements) are stored as float16 and cast back to float32 by a Cast node at the start of each graph. ONNX Runtime folds these casts when the session is created, so inference still runs in float32; only the download size is halved (~263 MB โ†’ ~130 MB).
  • Graph inputs/outputs, tts.json, unicode_indexer.json and the ten preset voice styles (voices/F1โ€“F5, M1โ€“M5) are unchanged.
  • webgpu/: the same four models converted to float16 compute (inputs/outputs stay float32) for WebGPU. They use half the GPU memory because weights are not expanded to float32 โ€” important on phones (iOS). Seoga uses them first on WebGPU and falls back to the root files (WebGPU without shader-f16, or WASM).
  • manifest.json lists file sizes for download progress (including webgpu/).

Conversion script: packages/tts/scripts/prepare-models.py in the Seoga repository.

License

The model weights are licensed under the BigScience Open RAIL-M License by Supertone Inc. This repackaging is a derivative of the model and is distributed under the same license, including its use-based restrictions (see LICENSE, Attachment A). Original model and code: supertone-inc/supertonic (sample code MIT).