Instructions to use AaronTekle/SQLQwen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use AaronTekle/SQLQwen with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-0.5B-Instruct") model = PeftModel.from_pretrained(base_model, "AaronTekle/SQLQwen") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -177,6 +177,15 @@ completed fine-tuning run shows:
|
|
| 177 |
* **100% syntax-valid SQL generation** across the 50-example held-out benchmark
|
| 178 |
* successful local fine-tuning of a code-focused language model using an **NVIDIA GeForce RTX 3050**
|
| 179 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 180 |
## References:
|
| 181 |
- Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. *LoRA: Low-Rank Adaptation of Large Language Models*. arXiv:2106.09685, 2021.](https://arxiv.org/abs/2106.09685)
|
| 182 |
|
|
|
|
| 177 |
* **100% syntax-valid SQL generation** across the 50-example held-out benchmark
|
| 178 |
* successful local fine-tuning of a code-focused language model using an **NVIDIA GeForce RTX 3050**
|
| 179 |
|
| 180 |
+
## Imports:
|
| 181 |
+
```python
|
| 182 |
+
from peft import PeftModel
|
| 183 |
+
from transformers import AutoModelForCausalLM
|
| 184 |
+
|
| 185 |
+
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-0.5B-Instruct")
|
| 186 |
+
model = PeftModel.from_pretrained(base_model, "AaronTekle/SQLQwen")
|
| 187 |
+
```
|
| 188 |
+
|
| 189 |
## References:
|
| 190 |
- Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. *LoRA: Low-Rank Adaptation of Large Language Models*. arXiv:2106.09685, 2021.](https://arxiv.org/abs/2106.09685)
|
| 191 |
|