File size: 1,216 Bytes
9e47b0e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | ---
license: apache-2.0
base_model: laion/larger_clap_general
tags: [coreml, clap, audio, embeddings]
---
# CLAP (larger_clap_general) for Core ML — Gridshift
Core ML conversion of [`laion/larger_clap_general`](https://huggingface.co/laion/larger_clap_general), used by Gridshift's smart sample search.
- `GridshiftCLAP.mlpackage.zip`: audio encoder. Input `audio`: fp32 [1, 480000], mono 48 kHz, 10 s (HF `repeatpad` for shorter files). Output `embedding`: fp32 [1, 512], L2-normalized. Log-mel front-end in the graph (matches `ClapFeatureExtractor`), front-end ops fp32, int8 weights (convolutions excepted).
- `GridshiftCLAPText.mlpackage.zip`: text encoder. Inputs `input_ids`, `attention_mask`: int32 [1, 64] (RoBERTa tokenizer in `tokenizer.tokenizer.zip`). Output `embedding`: fp32 [1, 512], same space.
Validated against the PyTorch reference (`transformers` ClapModel): audio cosine ≥ 0.9995 per sample, pairwise structure Δ ≤ 0.012; text cosine ≥ 0.999. SHA-256s are in `manifest.json` and `text_manifest.json`.
Upstream: LAION-CLAP, Apache-2.0. Wu et al., 2022, *Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation* (arXiv:2211.06687).
|