Instructions to use Prathyusha101/quantized_model_2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Prathyusha101/quantized_model_2 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("Prathyusha101/quantized_model_2") model = AutoModelForSeq2SeqLM.from_pretrained("Prathyusha101/quantized_model_2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 202 Bytes
eeba48a | 1 2 3 4 5 6 7 8 9 10 11 | {
"_from_model_config": true,
"bos_token_id": 0,
"decoder_start_token_id": 2,
"eos_token_id": 2,
"max_length": 512,
"num_beams": 4,
"pad_token_id": 1,
"transformers_version": "4.50.3"
}
|