tokenizers/pr_2449/en/api/encoding.md

Encoding

TODO -- coming soon. Reference documentation on this page is not generated yet: the rc0 bindings do not expose all of these APIs. It comes back with them, along with the other bindings. See REQUIRED_FOR_V1.md for the full list.

Encoding[[tokenizers.Encoding]]

tokenizers.Encoding

Attributes: attention_mask, ids, type_ids

Not yet available in the rc0 bindings: n_sequences, offsets, overflowing, sequence_ids, special_tokens_mask, tokens, word_ids, words.

The Rust API Reference is available directly on the Docs.rs website.