PEFT
Safetensors
English
code
python
lora
qwen2
code-generation
SathishKumar89 commited on
Commit
5be539f
·
verified ·
1 Parent(s): c7ace90

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -49
README.md CHANGED
@@ -1,58 +1,26 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
3
- library_name: transformers
4
- model_name: my-python-coder
5
  tags:
6
- - generated_from_trainer
7
- - sft
8
- - trl
9
- licence: license
10
  ---
11
 
12
- # Model Card for my-python-coder
13
 
14
- This model is a fine-tuned version of [Qwen/Qwen2.5-Coder-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct).
15
- It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
- ## Quick start
 
 
 
 
 
18
 
19
- ```python
20
- from transformers import pipeline
21
 
22
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
- generator = pipeline("text-generation", model="SathishKumar89/my-python-coder", device="cuda")
24
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
- print(output["generated_text"])
26
- ```
27
-
28
- ## Training procedure
29
-
30
-
31
-
32
-
33
-
34
- This model was trained with SFT.
35
-
36
- ### Framework versions
37
-
38
- - TRL: 1.13.0
39
- - Transformers: 5.16.1
40
- - Pytorch: 2.11.0+cu128
41
- - Datasets: 4.8.5
42
- - Tokenizers: 0.23.1
43
-
44
- ## Citations
45
-
46
-
47
-
48
- Cite TRL as:
49
-
50
- ```bibtex
51
- @software{vonwerra2020trl,
52
- title = {{TRL: Transformers Reinforcement Learning}},
53
- author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
54
- license = {Apache-2.0},
55
- url = {https://github.com/huggingface/trl},
56
- year = {2020}
57
- }
58
- ```
 
1
  ---
2
  base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
3
+ library_name: peft
 
4
  tags:
5
+ - code
6
+ - python
7
+ - lora
8
+ - qwen
9
  ---
10
 
11
+ # my-python-coder
12
 
13
+ A LoRA fine-tune of Qwen2.5-Coder-1.5B-Instruct specialized for Python code generation.
 
14
 
15
+ ## Training Details
16
+ - **Base model:** Qwen/Qwen2.5-Coder-1.5B-Instruct
17
+ - **Dataset:** iamtarun/python_code_instructions_18k_alpaca (first 1,500 examples)
18
+ - **Method:** LoRA (r=16, alpha=32, target_modules=all-linear)
19
+ - **Steps:** 200
20
+ - **Hardware:** Google Colab T4
21
 
22
+ ## Usage
23
+ [insert example code snippet]
24
 
25
+ ## Limitations
26
+ Trained on a small subset; may not generalize to all Python tasks.