Instructions to use sajjadamjad/storyteller with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use sajjadamjad/storyteller with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigscience/bloom-3b") model = PeftModel.from_pretrained(base_model, "sajjadamjad/storyteller") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload handler.py
To deploy our model on an endpoint, we need to load the model during the initialization and return the generated text based on the initial text input. The initialization and call phases are handled in the handler.py script.0aa2c42