Instructions to use thanyu/libero_tokenizer128 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thanyu/libero_tokenizer128 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("thanyu/libero_tokenizer128", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download processor_config.json from thanyu/libero_tokenizer128: direct link, hf CLI and curl.
- Browser
- Download file 292 Bytes
-
https://huggingface.co/thanyu/libero_tokenizer128/resolve/main/processor_config.json
- Command line
-
hf download hf://thanyu/libero_tokenizer128/processor_config.json
-
curl -L -o processor_config.json https://huggingface.co/thanyu/libero_tokenizer128/resolve/main/processor_config.json
292 Bytes
| { | |
| "action_dim": null, | |
| "coeff_dims": { | |
| "Approx": 14, | |
| "Detail_1": 67, | |
| "Detail_2": 37, | |
| "Detail_3": 22, | |
| "Detail_4": 14 | |
| }, | |
| "level": 4, | |
| "min_token": -65, | |
| "processor_class": "WaveUniversalActionProcessor", | |
| "scale": 10, | |
| "time_horizon": 128, | |
| "vocab_size": 2048 | |
| } | |