AaronTekle commited on
Commit
ba8fbb3
·
verified ·
1 Parent(s): c6371da

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -177,6 +177,15 @@ completed fine-tuning run shows:
177
  * **100% syntax-valid SQL generation** across the 50-example held-out benchmark
178
  * successful local fine-tuning of a code-focused language model using an **NVIDIA GeForce RTX 3050**
179
 
 
 
 
 
 
 
 
 
 
180
  ## References:
181
  - Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. *LoRA: Low-Rank Adaptation of Large Language Models*. arXiv:2106.09685, 2021.](https://arxiv.org/abs/2106.09685)
182
 
 
177
  * **100% syntax-valid SQL generation** across the 50-example held-out benchmark
178
  * successful local fine-tuning of a code-focused language model using an **NVIDIA GeForce RTX 3050**
179
 
180
+ ## Imports:
181
+ ```python
182
+ from peft import PeftModel
183
+ from transformers import AutoModelForCausalLM
184
+
185
+ base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-0.5B-Instruct")
186
+ model = PeftModel.from_pretrained(base_model, "AaronTekle/SQLQwen")
187
+ ```
188
+
189
  ## References:
190
  - Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. *LoRA: Low-Rank Adaptation of Large Language Models*. arXiv:2106.09685, 2021.](https://arxiv.org/abs/2106.09685)
191