Add model card README
Browse files
README.md
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: sam-license
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
tags:
|
| 6 |
+
- comfyui
|
| 7 |
+
- audio-separation
|
| 8 |
+
- sam-audio
|
| 9 |
+
- audio
|
| 10 |
+
- flow-matching
|
| 11 |
+
pipeline_tag: audio-to-audio
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# ComfyUI-SamAudio
|
| 15 |
+
|
| 16 |
+
Converted standard `BF16` `.safetensors` checkpoints for **SAM-Audio** (Segment Anything Model for Audio) by Meta AI, optimized for native use in **ComfyUI**.
|
| 17 |
+
|
| 18 |
+
## Available Checkpoints
|
| 19 |
+
|
| 20 |
+
| Checkpoint | Format | Size | Description |
|
| 21 |
+
| :--- | :---: | :---: | :--- |
|
| 22 |
+
| **`sam_audio_base.safetensors`** | BF16 | 1.73 GB | 12-layer DiT, 1536 dim. Fast daily driver. |
|
| 23 |
+
| **`sam_audio_large.safetensors`** | BF16 | 6.38 GB | 22-layer DiT, 2816 dim. Maximum separation fidelity. |
|
| 24 |
+
|
| 25 |
+
## Installation & Placement in ComfyUI
|
| 26 |
+
|
| 27 |
+
Place the `.safetensors` model(s) into:
|
| 28 |
+
```
|
| 29 |
+
ComfyUI/models/sam-audio/
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
Quick download via CLI:
|
| 33 |
+
```bash
|
| 34 |
+
hf download Aero-Ex/ComfyUI-SamAudio --local-dir ComfyUI/models/sam-audio
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
## Required Text Encoder
|
| 38 |
+
|
| 39 |
+
For text prompting, place `t5-base.safetensors` into `ComfyUI/models/text_encoders/`:
|
| 40 |
+
- Download: [Comfy-Org/t5-base](https://huggingface.co/Comfy-Org/t5-base/blob/main/t5-base.safetensors)
|
| 41 |
+
|
| 42 |
+
## Custom Node
|
| 43 |
+
|
| 44 |
+
Run these models natively using the dependency-free custom node:
|
| 45 |
+
- **`ComfyUI-SAM-Audio-Native`**
|
| 46 |
+
|
| 47 |
+
### Supported Modalities
|
| 48 |
+
- **Text-Prompted Separation:** Isolate vocals, speech, instruments, sound effects using natural language.
|
| 49 |
+
- **Temporal Span Separation:** Isolate sounds using `+` (present) or `-` (absent) time intervals.
|
| 50 |
+
- **Video-Guided Separation:** Isolate sounds tied to visual objects using video frames and tracking masks (e.g. from SAM 3).
|
| 51 |
+
|
| 52 |
+
## License
|
| 53 |
+
|
| 54 |
+
This model is subject to Meta's SAM License. See [LICENSE](LICENSE) for details.
|