File size: 718 Bytes
2f86d9b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
# Kauldron Configurations for SFT Training

This directory contains the Kauldron configuration files defining the models,
datasets, training losses, optimizers, schedules, and evaluators for SFT
training.

The configurations are flat, self-contained files defining the end-to-end
setup (model, dataset, training losses, optimizer, schedule, and evaluators)
for each task.

## Configuration Files

*   **`sft_sudoku.py`** (Sudoku):
    *   Configures SFT training with LoRA on the sudoku dataset.

*   **`sft_sudoku_full.py`** (Sudoku):
    *   Configures full weight SFT training on the sudoku dataset.

*   **`sft_pubmedqa.py`** (PubMedQA):
    *   Configures Parameter-Efficient SFT training using LoRA on PubMedQA.