Instructions to use onnookk/trainer_bpe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use onnookk/trainer_bpe with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, LlamaForCausalLM_bpe tokenizer = AutoTokenizer.from_pretrained("onnookk/trainer_bpe") model = LlamaForCausalLM_bpe.from_pretrained("onnookk/trainer_bpe", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Training in progress, step 3500
Verified signaturec49256a -
Training in progress, step 3000
Verified signaturefdd49ab -
Training in progress, step 2500
Verified signature1d6c708 -
Training in progress, step 2000
Verified signaturecdd9d12 -
Training in progress, step 1500
Verified signature20a7608
-
Training in progress, step 1000
Verified signaturece947de -
Training in progress, step 500
Verified signatured94b69c -
initial commit
Verified signature3951e58