File size: 1,321 Bytes
eb0268f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | ---
license: mit
base_model: huper29/huper_recognizer
tags:
- coreml
- phoneme-recognition
- ctc
- wavlm
- pronunciation
language:
- en
---
# HuPER recognizer, Core ML (int8)
A Core ML build of [huper29/huper_recognizer](https://huggingface.co/huper29/huper_recognizer)
(WavLM-large with a CTC head over 39 ARPAbet phones plus DX), made for Accent Lab, a macOS app
for English pronunciation practice, to check each sound on the Mac.
- `HuPER.mlmodelc`: compiled Core ML model, macOS 15 or later. Weights are int8 (linear,
symmetric, per channel); the math runs in FP32.
- `vocab.json`, `added_tokens.json`: the output labels, unchanged from the original.
## Input and output
- `audio`: Float32 `[1, samples]`, 16 kHz mono, 1 to 20 s, normalized to zero mean and unit
variance (as the original's `Wav2Vec2FeatureExtractor` with `do_normalize`).
- `logprobs`: Float32 `[1, frames, 46]`, log-softmax over the labels, one frame per 20 ms.
## How close it is to the original
On 17 lines of real speech (845 phones), goodness-of-pronunciation scores differ from the
PyTorch model by 0.34 on average, and 4 of the 845 phones change sides of a −2.0 threshold.
The best label per frame matches 98 % of the time.
## License
MIT, as the original model. All credit for the model goes to the HuPER authors.
|