188 MB
12 files
Updated 2 months ago
Name
Size
uhm.mlmodelc
.gitattributes1.52 kB
xet
README.md4.87 kB
xet
THIRD_PARTY_NOTICES.md1.55 kB
xet
UhmLabel.mlmodel13 kB
xet
labels.json207 Bytes
xet
uhm-web-fp16.onnx47 MB
xet
uhm.onnx94 MB
xet
README.md

Uhm

Find and remove every filler word.

On-device filler-word detection: frame-precise "uh"/"um"/"hmm" spans.

Find every "uh", "um" and "hmm" in an audio file, down to 20ms. Uhm runs on device, does not require ASR, and is trained on English with acoustic transfer to Spanish, French, German, and Dutch.

Try it

Platforms iOS, macOS, tvOS, visionOS
Languages 5
Weights 612592c

Install

Swift (requirements)

.package(url: "https://github.com/Desert-Ant-Labs/desert-ant-core.git", from: "3.1.0")

Then add the Uhm product to your target.

Files

File Format Size Use
uhm.mlmodelc/ Core ML fp16 (compiled) 45MB iOS / macOS on-device
uhm-web-fp16.onnx ONNX fp16 51MB Browser, server, Python (onnxruntime)
uhm.onnx ONNX fp32 98MB Quantization-free reference

uhm.mlmodelc/ is a compiled Core ML model directory. The Swift SDK downloads it with the Hugging Face Hub snapshot API, so only changed files are re-fetched on model updates.

The shipped model is a DistilHuBERT fine-tune, the smaller and more precise Uhm runtime model; the older HuBERT-base tier is no longer published.

Use

Python (ONNX)

from huggingface_hub import hf_hub_download
import onnxruntime as ort

path = hf_hub_download("desert-ant-labs/uhm", "uhm-web-fp16.onnx")
session = ort.InferenceSession(path, providers=["CPUExecutionProvider"])

Swift

import Uhm

let uhm = try await Uhm()
let result = try await uhm.analyze(audioURL: url)
for filler in result.fillers {
    print(filler.start, filler.end, filler.confidence, filler.type ?? .other)
}

Inputs and outputs

  • Input: 16kHz mono audio, up to 30-second windows.
  • Output: per-frame softmax over 6 classes, one prediction every 20ms.
  • Class indices: 0 = not_filler, 1 = uh, 2 = um, 3 = hmm, 4 = and, 5 = other.

Core ML input shape (1, 480000) float32; output (1, 1499, 6). Requires iOS 17 / macOS 14 or newer.

Performance

Warm on-device runs on the published fp16 Core ML model:

Device Realtime factor
iPhone 17 Pro ~296×
iPhone 15 Pro ~169×
iPad Pro M4 ~279×

Realtime factor = audio duration ÷ analyze time; model load excluded.

Limitations

  • Trained on English; non-English performance is by acoustic transfer and has not been measured against per-language ground truth.
  • Best on podcast / meeting / talking-head audio. Heavy background music, laughter, or multi-speaker overlap degrades quality.
  • Type labels (uh / um / hmm / and / other) are secondary. Trust filler vs. not-filler more than the specific subtype.

Built on

License

Desert Ant Labs Source-Available License. Free for most apps, and a commercial license is required at scale. Full terms are at the link. Licensing: licensing@desertant.com.

See THIRD_PARTY_NOTICES.md.

Citation

@software{uhm_2026,
  title  = {Uhm: On-device filler-word detection: frame-precise "uh"/"um"/"hmm" spans},
  author = {Desert Ant Labs},
  year   = {2026},
  url    = {https://huggingface.co/desert-ant-labs/uhm},
}

© 2026 Desert Ant Labs · https://desertant.com

Total size
188 MB
Files
12
Last updated
Sep 9
Pre-warmed CDN
US EU US EU

Contributors