magnet-small-4bit / README.md
MusicForge's picture
Mirror from aufklarer/MAGNeT-Small-30secs-MLX-4bit
a2c208f verified
|
Raw History Blame Contribute Delete
1.93 kB
metadata
license: cc-by-nc-4.0
language:
  - en
tags:
  - mlx
  - audio
  - music
  - text-to-music
  - magnet
  - quantized
  - int4
base_model: facebook/magnet-small-30secs
library_name: mlx
pipeline_tag: text-to-audio

MAGNeT-Small-30secs-MLX-4bit

MLX port of Meta's MAGNeT — a masked parallel text-to-music model — quantized to INT4 weight-only for on-device generation on Apple Silicon. EnCodec 32 kHz audio decoder; T5-base text encoder; per-codebook iterative decoding with restricted-context self-attention.

Model

Parameters (LM) 300M
Quantization INT4 weight-only, group size 64
Format MLX safetensors
Sample rate 32 kHz mono
Output length 30 s per generation (fixed)
Decoding steps 50 total ([20, 10, 10, 10] across 4 RVQ codebooks)
Bundle size 499 MB on disk
Source facebook/magnet-small-30secs

Performance (Apple Silicon, 30 s audio)

Metric Value
Real-time factor (wall / audio) 0.28
Peak RSS 1351 MB
CLAP score (laion/clap-htsat-unfused, 5 prompts) 0.409

Usage

from huggingface_hub import snapshot_download
bundle = snapshot_download("aufklarer/MAGNeT-Small-30secs-MLX-4bit")
# See https://github.com/soniqo/speech-swift for production usage.

Source

License

CC-BY-NC 4.0 — inherited from upstream MAGNeT weights. Non-commercial use only.