Text Generation
PEFT
Safetensors
English
pyspark
apache-spark
qwen2.5-coder
qlora
lora
code-generation
data-engineering
fine-tuned
Instructions to use AaronTekle/PySparkQwen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use AaronTekle/PySparkQwen with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-1.5B-Instruct") model = PeftModel.from_pretrained(base_model, "AaronTekle/PySparkQwen") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -113,6 +113,7 @@ The original Qwen2.5-Coder model and the fine-tuned adapter were evaluated on th
|
|
| 113 |
|
| 114 |
|
| 115 |
```python
|
|
|
|
| 116 |
import torch
|
| 117 |
from peft import PeftModel
|
| 118 |
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
|
|
@@ -215,6 +216,7 @@ generated_code = tokenizer.decode(
|
|
| 215 |
|
| 216 |
print("Generated PySpark Code:")
|
| 217 |
print(generated_code)
|
|
|
|
| 218 |
```
|
| 219 |
|
| 220 |
|
|
|
|
| 113 |
|
| 114 |
|
| 115 |
```python
|
| 116 |
+
|
| 117 |
import torch
|
| 118 |
from peft import PeftModel
|
| 119 |
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
|
|
|
|
| 216 |
|
| 217 |
print("Generated PySpark Code:")
|
| 218 |
print(generated_code)
|
| 219 |
+
|
| 220 |
```
|
| 221 |
|
| 222 |
|