Instructions to use AIcademic/DeBERTaRefCheckTokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AIcademic/DeBERTaRefCheckTokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AIcademic/DeBERTaRefCheckTokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download added_tokens.json from AIcademic/DeBERTaRefCheckTokenizer: direct link, hf CLI and curl.
- Browser
- Download file 519 Bytes
-
https://huggingface.co/AIcademic/DeBERTaRefCheckTokenizer/resolve/main/added_tokens.json
- Command line
-
hf download hf://AIcademic/DeBERTaRefCheckTokenizer/added_tokens.json
-
curl -L -o added_tokens.json https://huggingface.co/AIcademic/DeBERTaRefCheckTokenizer/resolve/main/added_tokens.json
519 Bytes
| { | |
| "[MASK]": 128000, | |
| "[SEC_ABSTRACT]": 128001, | |
| "[SEC_ACKNOWLEDGMENTS]": 128005, | |
| "[SEC_ACKNOW]": 128002, | |
| "[SEC_BACKGROUND]": 128006, | |
| "[SEC_CATEGORIES_AND_SUBJECT_DESCRIPTORS]": 128007, | |
| "[SEC_CONCLUSIONS]": 128008, | |
| "[SEC_CONCL]": 128003, | |
| "[SEC_DISCUSSIONS]": 128009, | |
| "[SEC_EVALUATION]": 128010, | |
| "[SEC_GENERAL_TERMS]": 128011, | |
| "[SEC_INTRODUCTION]": 128012, | |
| "[SEC_INTRO]": 128004, | |
| "[SEC_KEYWORDS]": 128013, | |
| "[SEC_METHOD]": 128014, | |
| "[SEC_REFERENCES]": 128015, | |
| "[SEC_RELATED_WORK]": 128016 | |
| } | |