How to use Killer-C0wboy/IBPS-v0.2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Killer-C0wboy/IBPS-v0.2")
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Killer-C0wboy/IBPS-v0.2", device_map="auto")
9ff5c03
1
In phase 1, the model was first trained to completion while keeping the bigbird frozen. Later in phase 2 the bigbird weights were set as trainable and trained using warmup.
