Add MOSS-SoundEffect v2 BF16 and Q8 GGUF packages
Browse files
.gitattributes
CHANGED
|
@@ -270,3 +270,5 @@ MuLaCover-GGUF/mulacover-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 270 |
MuLaCover-GGUF/mulacover-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 271 |
Orukeet-GGUF/orukeet-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 272 |
Orukeet-GGUF/orukeet-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 270 |
MuLaCover-GGUF/mulacover-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 271 |
Orukeet-GGUF/orukeet-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 272 |
Orukeet-GGUF/orukeet-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 273 |
+
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 274 |
+
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
MOSS-SoundEffect-v2-GGUF/README.md
ADDED
|
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: audio.cpp
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
pipeline_tag: text-to-audio
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
- zh
|
| 8 |
+
base_model:
|
| 9 |
+
- OpenMOSS-Team/MOSS-SoundEffect-v2.0
|
| 10 |
+
tags:
|
| 11 |
+
- audio.cpp
|
| 12 |
+
- gguf
|
| 13 |
+
- sound-effects
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# MOSS-SoundEffect v2 GGUF
|
| 17 |
+
|
| 18 |
+
Follow or star [audio.cpp](https://github.com/0xShug0/audio.cpp) for the native
|
| 19 |
+
inference code and model updates.
|
| 20 |
+
|
| 21 |
+
Generate sound effects from English or Chinese descriptions, with 48 kHz mono
|
| 22 |
+
output. Each package contains the Qwen3 text encoder, audio diffusion transformer,
|
| 23 |
+
continuous DAC decoder, tokenizer, and embedded model specification.
|
| 24 |
+
|
| 25 |
+
The upstream checkpoint is
|
| 26 |
+
[OpenMOSS-Team/MOSS-SoundEffect-v2.0](https://huggingface.co/OpenMOSS-Team/MOSS-SoundEffect-v2.0/tree/e35df4d82fbe87fcd5d14e5d100e349c0c3c076d),
|
| 27 |
+
pinned at `e35df4d82fbe87fcd5d14e5d100e349c0c3c076d`.
|
| 28 |
+
The implementation reference is
|
| 29 |
+
[OpenMOSS/MOSS-TTS](https://github.com/OpenMOSS/MOSS-TTS/tree/4cf2dab88fc8711aef93089b3b75c0ae07373e47/moss_soundeffect_v2).
|
| 30 |
+
|
| 31 |
+
| File | Transformer weights | DAC decoder |
|
| 32 |
+
|---|---|---|
|
| 33 |
+
| `moss-soundeffect-v2-q8_0.gguf` | Q8_0 matrices, F16 embeddings | F32 |
|
| 34 |
+
| `moss-soundeffect-v2-bf16.gguf` | BF16 matrices | F32 |
|
| 35 |
+
|
| 36 |
+
Timestep embedding, modulation and normalization retain F32, matching upstream.
|
| 37 |
+
The runtime family is `moss_soundeffect`; these packages implement v2.
|
| 38 |
+
|
| 39 |
+
## Performance
|
| 40 |
+
|
| 41 |
+
RTX 5090, CUDA, eight CPU threads, offline generation after a short warmup.
|
| 42 |
+
Mean of two different 10-second outputs, using 100 Euler steps, guidance 4,
|
| 43 |
+
shift 5, and the trained 30-second latent window. Python uses the official
|
| 44 |
+
BF16 eager pipeline. Peak VRAM is observed process memory.
|
| 45 |
+
|
| 46 |
+
| Runtime | RTF | Peak VRAM (MiB) |
|
| 47 |
+
|---|---:|---:|
|
| 48 |
+
| Official Python BF16 | 0.692 | 18,586 |
|
| 49 |
+
| audio.cpp BF16 | 0.999 | 11,347 |
|
| 50 |
+
| audio.cpp Q8_0 | 0.849 | 8,853 |
|
| 51 |
+
|
| 52 |
+
Q8_0 reduces peak VRAM by about 52% versus Python in this comparison;
|
| 53 |
+
native generation is currently slower. Lower RTF is faster.
|
| 54 |
+
|
| 55 |
+
## Usage
|
| 56 |
+
|
| 57 |
+
```bash
|
| 58 |
+
audiocpp_cli --model moss-soundeffect-v2-q8_0.gguf \
|
| 59 |
+
--family moss_soundeffect --task gen --backend cuda \
|
| 60 |
+
--text "Steady rain pattering on a wooden roof, with distant thunder." \
|
| 61 |
+
--request-option duration_sec=10 --out rain.wav --log
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
Output duration is 0.1–30 seconds, rounded to one decimal. The model always
|
| 65 |
+
denoises its trained 30-second window and crops the resulting waveform.
|
| 66 |
+
The default is 100 Euler steps, guidance scale 4, and seed 0.
|
| 67 |
+
It supports offline generation, not streaming.
|
| 68 |
+
|
| 69 |
+
See the [model documentation](https://github.com/0xShug0/audio.cpp/blob/main/docs/models/moss_soundeffect.md)
|
| 70 |
+
for request options and conversion instructions. Model weights and upstream code
|
| 71 |
+
are Apache-2.0 licensed.
|
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-bf16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:28804478da9867f70ba85385580e597d2279ee4550aff0624d0032dd28dfa706
|
| 3 |
+
size 6627551200
|
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:99feab80176e5fdd178aa005fa5e4079f8f6a8c45e576b8c4b48f26981ce63a1
|
| 3 |
+
size 4001175520
|