Instructions to use ocisd4/Phi-3-mini-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ocisd4/Phi-3-mini-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ocisd4/Phi-3-mini-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update tokenizer_config.json
Verified signature6524c20
-
fix
AlexHT_Hung4bb24b8 -
Revert "Upload tokenizer"
AlexHT_HungThis reverts commit 73c49a12e3243978affacfcaf5427654288b8583.6d96773
-
Upload tokenizer
Verified signature73c49a1
-
Update tokenizer_config.json
Verified signaturea78445f
-
Update added_tokens.json
Verified signature8181b4a
-
Update tokenizer_config.json
Verified signaturea161c27
-
update tokenizer.model
AlexHT_Hungbf8f660
-
Update
AlexHT_Hungbe97034
-
Update tokenizer_config.json
Verified signature466db0d -
Update tokenizer_config.json
Verified signaturec449b93 -
Update tokenizer_config.json
Verified signature89e63b6 -
<|tool_results|>
Verified signature86dc196 -
Upload tokenizer
Verified signatureacc19a6 -
Upload tokenizer
Verified signature22fe123 -
initial commit
Verified signature577abfb