Translation
Transformers
Safetensors
PyTorch
Khmer
blenderbot
text2text-generation
transliteration
romanization
romanized-khmer
khmer
character-level
pretrained
Instructions to use samdei/samdei-type-base-pretrained with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use samdei/samdei-type-base-pretrained with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("translation", model="samdei/samdei-type-base-pretrained")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("samdei/samdei-type-base-pretrained") model = AutoModelForSeq2SeqLM.from_pretrained("samdei/samdei-type-base-pretrained", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download tokenizer_config.json from samdei/samdei-type-base-pretrained: direct link, hf CLI and curl.
- Browser
- Download file 326 Bytes
-
https://huggingface.co/samdei/samdei-type-base-pretrained/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://samdei/samdei-type-base-pretrained/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/samdei/samdei-type-base-pretrained/resolve/main/tokenizer_config.json
326 Bytes
| { | |
| "tokenizer_class": "PreTrainedTokenizerFast", | |
| "model_max_length": 250, | |
| "padding_side": "right", | |
| "truncation_side": "right", | |
| "clean_up_tokenization_spaces": false, | |
| "bos_token": "<s>", | |
| "eos_token": "</s>", | |
| "pad_token": "<pad>", | |
| "unk_token": "<src_unk>", | |
| "model_input_names": [ | |
| "input_ids", | |
| "attention_mask" | |
| ] | |
| } | |