Instructions to use Xenova/dbrx-instruct-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Xenova/dbrx-instruct-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Xenova/dbrx-instruct-tokenizer", device_map="auto") - Transformers.js
How to use Xenova/dbrx-instruct-tokenizer with Transformers.js:
// ⚠️ Unknown pipeline tag
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Add/update the quantized ONNX model files and README.md for Transformers.js v3
Verified signature## Applied Quantizations **No new quantized models were added.**950be77
-
Update README.md
Verified signaturef2253a2
-
Upload tokenizer.json
Verified signature4ec0196 -
Upload vocab.json
Verified signature39221ee -
Upload tokenizer.json
Verified signatureba49911 -
Update tokenizer_config.json
Verified signatured5cbfd2 -
Upload 6 files
Verified signature70af4c8 -
initial commit
Verified signature0b94a02