audio-cpp commited on
Commit
73ce416
·
verified ·
1 Parent(s): 4baf9cc

Add MOSS-SoundEffect v2 BF16 and Q8 GGUF packages

Browse files
.gitattributes CHANGED
@@ -270,3 +270,5 @@ MuLaCover-GGUF/mulacover-f16.gguf filter=lfs diff=lfs merge=lfs -text
270
  MuLaCover-GGUF/mulacover-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
271
  Orukeet-GGUF/orukeet-f16.gguf filter=lfs diff=lfs merge=lfs -text
272
  Orukeet-GGUF/orukeet-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
270
  MuLaCover-GGUF/mulacover-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
271
  Orukeet-GGUF/orukeet-f16.gguf filter=lfs diff=lfs merge=lfs -text
272
  Orukeet-GGUF/orukeet-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
273
+ MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-bf16.gguf filter=lfs diff=lfs merge=lfs -text
274
+ MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
MOSS-SoundEffect-v2-GGUF/README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: audio.cpp
3
+ license: apache-2.0
4
+ pipeline_tag: text-to-audio
5
+ language:
6
+ - en
7
+ - zh
8
+ base_model:
9
+ - OpenMOSS-Team/MOSS-SoundEffect-v2.0
10
+ tags:
11
+ - audio.cpp
12
+ - gguf
13
+ - sound-effects
14
+ ---
15
+
16
+ # MOSS-SoundEffect v2 GGUF
17
+
18
+ Follow or star [audio.cpp](https://github.com/0xShug0/audio.cpp) for the native
19
+ inference code and model updates.
20
+
21
+ Generate sound effects from English or Chinese descriptions, with 48 kHz mono
22
+ output. Each package contains the Qwen3 text encoder, audio diffusion transformer,
23
+ continuous DAC decoder, tokenizer, and embedded model specification.
24
+
25
+ The upstream checkpoint is
26
+ [OpenMOSS-Team/MOSS-SoundEffect-v2.0](https://huggingface.co/OpenMOSS-Team/MOSS-SoundEffect-v2.0/tree/e35df4d82fbe87fcd5d14e5d100e349c0c3c076d),
27
+ pinned at `e35df4d82fbe87fcd5d14e5d100e349c0c3c076d`.
28
+ The implementation reference is
29
+ [OpenMOSS/MOSS-TTS](https://github.com/OpenMOSS/MOSS-TTS/tree/4cf2dab88fc8711aef93089b3b75c0ae07373e47/moss_soundeffect_v2).
30
+
31
+ | File | Transformer weights | DAC decoder |
32
+ |---|---|---|
33
+ | `moss-soundeffect-v2-q8_0.gguf` | Q8_0 matrices, F16 embeddings | F32 |
34
+ | `moss-soundeffect-v2-bf16.gguf` | BF16 matrices | F32 |
35
+
36
+ Timestep embedding, modulation and normalization retain F32, matching upstream.
37
+ The runtime family is `moss_soundeffect`; these packages implement v2.
38
+
39
+ ## Performance
40
+
41
+ RTX 5090, CUDA, eight CPU threads, offline generation after a short warmup.
42
+ Mean of two different 10-second outputs, using 100 Euler steps, guidance 4,
43
+ shift 5, and the trained 30-second latent window. Python uses the official
44
+ BF16 eager pipeline. Peak VRAM is observed process memory.
45
+
46
+ | Runtime | RTF | Peak VRAM (MiB) |
47
+ |---|---:|---:|
48
+ | Official Python BF16 | 0.692 | 18,586 |
49
+ | audio.cpp BF16 | 0.999 | 11,347 |
50
+ | audio.cpp Q8_0 | 0.849 | 8,853 |
51
+
52
+ Q8_0 reduces peak VRAM by about 52% versus Python in this comparison;
53
+ native generation is currently slower. Lower RTF is faster.
54
+
55
+ ## Usage
56
+
57
+ ```bash
58
+ audiocpp_cli --model moss-soundeffect-v2-q8_0.gguf \
59
+ --family moss_soundeffect --task gen --backend cuda \
60
+ --text "Steady rain pattering on a wooden roof, with distant thunder." \
61
+ --request-option duration_sec=10 --out rain.wav --log
62
+ ```
63
+
64
+ Output duration is 0.1–30 seconds, rounded to one decimal. The model always
65
+ denoises its trained 30-second window and crops the resulting waveform.
66
+ The default is 100 Euler steps, guidance scale 4, and seed 0.
67
+ It supports offline generation, not streaming.
68
+
69
+ See the [model documentation](https://github.com/0xShug0/audio.cpp/blob/main/docs/models/moss_soundeffect.md)
70
+ for request options and conversion instructions. Model weights and upstream code
71
+ are Apache-2.0 licensed.
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28804478da9867f70ba85385580e597d2279ee4550aff0624d0032dd28dfa706
3
+ size 6627551200
MOSS-SoundEffect-v2-GGUF/moss-soundeffect-v2-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99feab80176e5fdd178aa005fa5e4079f8f6a8c45e576b8c4b48f26981ce63a1
3
+ size 4001175520