Buckets:

rhtse's picture
download
raw
955 Bytes
"""interscript-ml — the Python runtime for Interscript Model Format (IMF v1).
The reference implementation: the Ruby and TypeScript runtimes are
diffed against this one on shared golden sets.
from interscript_ml import Model
model = Model.load("khm-latn-1.0.zip")
model.translate("ភាសា") # -> "pheasaea"
Byte-level only: the tokenizer is the canonical ByT5 table (byte b ->
token id b+3, trailing EOS), fixed and documented — no vocab files.
"""
from __future__ import annotations
from interscript_ml.loader import Manifest, ModelFormatError
from interscript_ml.model import Model
from interscript_ml.registry import RegistryError, resolve
from interscript_ml.tokens import BYTE_OFFSET, EOS_ID, PAD_ID, UNK_ID, decode, encode
__all__ = [
"BYTE_OFFSET",
"EOS_ID",
"Manifest",
"Model",
"ModelFormatError",
"PAD_ID",
"RegistryError",
"UNK_ID",
"decode",
"encode",
"resolve",
]

Xet Storage Details

Size:
955 Bytes
·
Xet hash:
35bcc00c6e513ba912e528d945224ca476ba7c59a206b3efdf0eac66c3bec2fd

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.