File size: 1,674 Bytes
8870bee | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 | ---
license: other
license_name: sam-license
license_link: LICENSE
tags:
- comfyui
- audio-separation
- sam-audio
- audio
- flow-matching
pipeline_tag: audio-to-audio
---
# ComfyUI-SamAudio
Converted standard `BF16` `.safetensors` checkpoints for **SAM-Audio** (Segment Anything Model for Audio) by Meta AI, optimized for native use in **ComfyUI**.
## Available Checkpoints
| Checkpoint | Format | Size | Description |
| :--- | :---: | :---: | :--- |
| **`sam_audio_base.safetensors`** | BF16 | 1.73 GB | 12-layer DiT, 1536 dim. Fast daily driver. |
| **`sam_audio_large.safetensors`** | BF16 | 6.38 GB | 22-layer DiT, 2816 dim. Maximum separation fidelity. |
## Installation & Placement in ComfyUI
Place the `.safetensors` model(s) into:
```
ComfyUI/models/sam-audio/
```
Quick download via CLI:
```bash
hf download Aero-Ex/ComfyUI-SamAudio --local-dir ComfyUI/models/sam-audio
```
## Required Text Encoder
For text prompting, place `t5-base.safetensors` into `ComfyUI/models/text_encoders/`:
- Download: [Comfy-Org/t5-base](https://huggingface.co/Comfy-Org/t5-base/blob/main/t5-base.safetensors)
## Custom Node
Run these models natively using the dependency-free custom node:
- **`ComfyUI-SAM-Audio-Native`**
### Supported Modalities
- **Text-Prompted Separation:** Isolate vocals, speech, instruments, sound effects using natural language.
- **Temporal Span Separation:** Isolate sounds using `+` (present) or `-` (absent) time intervals.
- **Video-Guided Separation:** Isolate sounds tied to visual objects using video frames and tracking masks (e.g. from SAM 3).
## License
This model is subject to Meta's SAM License. See [LICENSE](LICENSE) for details.
|