---
license: mit
library_name: coreml
base_model: segment-any-text/sat-12l-sm
tags:
- sentence-segmentation
- coreml
- multilingual
---

# sat-12l-sm for Core ML

A Core ML conversion of [segment-any-text/sat-12l-sm](https://huggingface.co/segment-any-text/sat-12l-sm)
(Segment any Text, [wtpsplit](https://github.com/segment-any-text/wtpsplit), MIT), used by the Vocena
app to find sentence ends in speech-recognition text that has no punctuation.

- `SaTSegmenter.mlmodelc`: compiled Core ML model. Inputs `input_ids` and `attention_mask`, Int32
  [1, N] with N ∈ {64, 128, 256, 512}; output `logits` Float32 [1, N], one sentence-end logit per token.
  Wrap each block as `<s>` (0) + tokens + `</s>` (2) and pad with `<pad>` (1), mask 0.
- Word and position embeddings are int8 (per-block, block 32); the 12 encoder layers stay fp16. On the
  validation texts (Thai, Chinese, English, Japanese) the cuts at thresholds 0.05 and 0.03 are identical
  to wtpsplit 2.2.2 with the original ONNX model. Runs on the CPU and Neural Engine
  (`MLComputeUnits.cpuAndNeuralEngine`).
- `tokenizer.json`: the [FacebookAI/xlm-roberta-base](https://huggingface.co/FacebookAI/xlm-roberta-base)
  tokenizer (MIT), unchanged. `tokenizer_config.json` names its class for swift-transformers.

Licence: MIT, as the original model and tokenizer.