Instructions to use bahree/ModelAdaptationBook with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use bahree/ModelAdaptationBook with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
README: list ch5-qlora
Browse files
README.md
CHANGED
|
@@ -27,6 +27,7 @@ model and running inference/eval, without training it yourself.
|
|
| 27 |
| Subfolder | Chapter | What | Base |
|
| 28 |
|---|---|---|---|
|
| 29 |
| `ch5-lora` | 5 | LoRA adapter | Qwen3-4B-Instruct-2507 |
|
|
|
|
| 30 |
| `ch6-sft` | 6 | full SFT model (standalone) | (full fine-tune) |
|
| 31 |
| `ch7-distilled` | 7 | distilled student (LoRA) | Qwen3-4B-Instruct-2507 |
|
| 32 |
| `ch8-dpo` | 8 | full DPO model (standalone) | (full fine-tune) |
|
|
|
|
| 27 |
| Subfolder | Chapter | What | Base |
|
| 28 |
|---|---|---|---|
|
| 29 |
| `ch5-lora` | 5 | LoRA adapter | Qwen3-4B-Instruct-2507 |
|
| 30 |
+
| `ch5-qlora` | 5 | QLoRA adapter (r=8; load on the 4-bit base, CUDA only, or on the bf16 base) | Qwen3-4B-Instruct-2507 |
|
| 31 |
| `ch6-sft` | 6 | full SFT model (standalone) | (full fine-tune) |
|
| 32 |
| `ch7-distilled` | 7 | distilled student (LoRA) | Qwen3-4B-Instruct-2507 |
|
| 33 |
| `ch8-dpo` | 8 | full DPO model (standalone) | (full fine-tune) |
|