Instructions to use adesogus/T5utor with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use adesogus/T5utor with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("adesogus/T5utor") model = AutoModelForSeq2SeqLM.from_pretrained("adesogus/T5utor", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,5 +11,13 @@ We have built an educational assistant using Flan-T5 large, a modestly sized lan
|
|
| 11 |
Model quantization results in a 68% reduction in memory footprint without severely impacting performance, maintaining a 32% accuracy. Furthermore, our flagship model, T5utor, utilizing RAG, increased performance by 4.4% compared to our Multiple Choice Question Answering (MCQA) model. After our training pipelines, some of the models achieve higher accuracies on common benchmarks relative to the reference model.
|
| 12 |
|
| 13 |
## Approach
|
| 14 |
-
 model. After our training pipelines, some of the models achieve higher accuracies on common benchmarks relative to the reference model.
|
| 12 |
|
| 13 |
## Approach
|
| 14 |
+

|
| 15 |
+
*Figure 1: Diagram showing our general approach. Starting from the left with our chosen generator model LaMini-Flan-T5-783M, then going through multiple fine-tuning stages. The names of the models follow the nomenclature in Table 1. The relative sizes of the datasets are also significant, with the DPO External Dataset being roughly six times the size of the other smaller datasets.*
|
| 16 |
+
|
| 17 |
+
### SFT with PEFT
|
| 18 |
+

|
| 19 |
+
*Figure 2: Diagram illustrating our mixed LoRA architecture. Weights on the left block are freezed, only the additional LoRA layer depicted in green is optimized.*
|
| 20 |
+
|
| 21 |
+
### RAG Pipeline
|
| 22 |
+

|
| 23 |
+
*Figure 3: We used an Advanced RAG approach a the inference stage leveraging the specialized framework LangChain and a retrieval source.*
|