Instructions to use onnookk/trainer_bpe_v2_batch_from_scratch with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use onnookk/trainer_bpe_v2_batch_from_scratch with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, LlamaForCausalLM_bpe tokenizer = AutoTokenizer.from_pretrained("onnookk/trainer_bpe_v2_batch_from_scratch") model = LlamaForCausalLM_bpe.from_pretrained("onnookk/trainer_bpe_v2_batch_from_scratch", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Training in progress, step 15000
Verified signature4e1fd45 -
Training in progress, step 10000
Verified signature33af55d -
Training in progress, step 5000
Verified signature5163ffc
-
Training in progress, step 1500
Verified signature01ef1de -
initial commit
Verified signature8bb2f03