Spaces:
Paused
Paused
File size: 718 Bytes
2f86d9b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | # Kauldron Configurations for SFT Training
This directory contains the Kauldron configuration files defining the models,
datasets, training losses, optimizers, schedules, and evaluators for SFT
training.
The configurations are flat, self-contained files defining the end-to-end
setup (model, dataset, training losses, optimizer, schedule, and evaluators)
for each task.
## Configuration Files
* **`sft_sudoku.py`** (Sudoku):
* Configures SFT training with LoRA on the sudoku dataset.
* **`sft_sudoku_full.py`** (Sudoku):
* Configures full weight SFT training on the sudoku dataset.
* **`sft_pubmedqa.py`** (PubMedQA):
* Configures Parameter-Efficient SFT training using LoRA on PubMedQA.
|