aoiandroid/nllb200-coreml-512

NLLB-200 Core ML 512 (KV decoders)

Core ML export of facebook/nllb-200-distilled-600M with max sequence length 512 for encoder and decoder.

Layout

Artifact	Role
NLLB_Encoder_512.mlpackage	Encoder
NLLB_Decoder_512_init.mlpackage	First autoregressive step + initial KV
NLLB_Decoder_512_step.mlpackage	Later steps; past KV in/out
tokenizer/	Hugging Face tokenizer files
config.json	Base model config copy

Do not use a single legacy NLLB_Decoder_512.mlpackage only: greedy decoding breaks when the graph was traced with a fixed short prefix.

The palettized repo (nllb200-coreml-512-pal8) uses the same three mlpackage names with 8-bit weight palettization.

App

on-device iOS client model IDs: nllb200-coreml-512, nllb200-coreml-512-pal8 (NLLBCoreMLTranslationService).

Conversion

Produced from [nllb200_coreml_colab_v3_fixed.ipynb](local iOS project (private)) (same KV pipeline as 1024, enc_len=512).

Validation (macOS)

python3 Scripts/validate_nllb512_bleu_macos.py --local-dir Notebooks/nllb/output/nllb200-coreml-512 --min-bleu 50

License

Same as the base model (CC-BY-NC-4.0) and NLLB-200 terms.