Aero-Ex commited on
Commit
8870bee
·
verified ·
1 Parent(s): 6a7b44d

Add model card README

Browse files
Files changed (1) hide show
  1. README.md +54 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: sam-license
4
+ license_link: LICENSE
5
+ tags:
6
+ - comfyui
7
+ - audio-separation
8
+ - sam-audio
9
+ - audio
10
+ - flow-matching
11
+ pipeline_tag: audio-to-audio
12
+ ---
13
+
14
+ # ComfyUI-SamAudio
15
+
16
+ Converted standard `BF16` `.safetensors` checkpoints for **SAM-Audio** (Segment Anything Model for Audio) by Meta AI, optimized for native use in **ComfyUI**.
17
+
18
+ ## Available Checkpoints
19
+
20
+ | Checkpoint | Format | Size | Description |
21
+ | :--- | :---: | :---: | :--- |
22
+ | **`sam_audio_base.safetensors`** | BF16 | 1.73 GB | 12-layer DiT, 1536 dim. Fast daily driver. |
23
+ | **`sam_audio_large.safetensors`** | BF16 | 6.38 GB | 22-layer DiT, 2816 dim. Maximum separation fidelity. |
24
+
25
+ ## Installation & Placement in ComfyUI
26
+
27
+ Place the `.safetensors` model(s) into:
28
+ ```
29
+ ComfyUI/models/sam-audio/
30
+ ```
31
+
32
+ Quick download via CLI:
33
+ ```bash
34
+ hf download Aero-Ex/ComfyUI-SamAudio --local-dir ComfyUI/models/sam-audio
35
+ ```
36
+
37
+ ## Required Text Encoder
38
+
39
+ For text prompting, place `t5-base.safetensors` into `ComfyUI/models/text_encoders/`:
40
+ - Download: [Comfy-Org/t5-base](https://huggingface.co/Comfy-Org/t5-base/blob/main/t5-base.safetensors)
41
+
42
+ ## Custom Node
43
+
44
+ Run these models natively using the dependency-free custom node:
45
+ - **`ComfyUI-SAM-Audio-Native`**
46
+
47
+ ### Supported Modalities
48
+ - **Text-Prompted Separation:** Isolate vocals, speech, instruments, sound effects using natural language.
49
+ - **Temporal Span Separation:** Isolate sounds using `+` (present) or `-` (absent) time intervals.
50
+ - **Video-Guided Separation:** Isolate sounds tied to visual objects using video frames and tracking masks (e.g. from SAM 3).
51
+
52
+ ## License
53
+
54
+ This model is subject to Meta's SAM License. See [LICENSE](LICENSE) for details.