ComfyUI-SamAudio / README.md
Aero-Ex's picture
Add model card README
8870bee verified
|
Raw History Blame Contribute Delete
1.67 kB
metadata
license: other
license_name: sam-license
license_link: LICENSE
tags:
  - comfyui
  - audio-separation
  - sam-audio
  - audio
  - flow-matching
pipeline_tag: audio-to-audio

ComfyUI-SamAudio

Converted standard BF16 .safetensors checkpoints for SAM-Audio (Segment Anything Model for Audio) by Meta AI, optimized for native use in ComfyUI.

Available Checkpoints

Checkpoint Format Size Description
sam_audio_base.safetensors BF16 1.73 GB 12-layer DiT, 1536 dim. Fast daily driver.
sam_audio_large.safetensors BF16 6.38 GB 22-layer DiT, 2816 dim. Maximum separation fidelity.

Installation & Placement in ComfyUI

Place the .safetensors model(s) into:

ComfyUI/models/sam-audio/

Quick download via CLI:

hf download Aero-Ex/ComfyUI-SamAudio --local-dir ComfyUI/models/sam-audio

Required Text Encoder

For text prompting, place t5-base.safetensors into ComfyUI/models/text_encoders/:

Custom Node

Run these models natively using the dependency-free custom node:

  • ComfyUI-SAM-Audio-Native

Supported Modalities

  • Text-Prompted Separation: Isolate vocals, speech, instruments, sound effects using natural language.
  • Temporal Span Separation: Isolate sounds using + (present) or - (absent) time intervals.
  • Video-Guided Separation: Isolate sounds tied to visual objects using video frames and tracking masks (e.g. from SAM 3).

License

This model is subject to Meta's SAM License. See LICENSE for details.