675uj commited on
Commit
f00a98b
·
verified ·
1 Parent(s): 0f91183

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -12
README.md CHANGED
@@ -1,21 +1,38 @@
1
  ---
2
- base_model: unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen2
8
  license: apache-2.0
 
 
 
9
  language:
10
  - en
 
 
 
 
 
 
11
  ---
12
 
13
- # Uploaded finetuned model
 
 
 
 
 
 
 
 
 
 
 
14
 
15
- - **Developed by:** 675uj
16
- - **License:** apache-2.0
17
- - **Finetuned from model :** unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit
 
 
18
 
19
- This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
1
  ---
 
 
 
 
 
 
2
  license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
4
+ datasets:
5
+ - ise-uiuc/Magicoder-OSS-Instruct-75K
6
  language:
7
  - en
8
+ - pl
9
+ tags:
10
+ - code
11
+ - qwen2
12
+ - unsloth
13
+ pipeline_tag: text-generation
14
  ---
15
 
16
+ # Kyllix-Coder
17
+
18
+ **Kyllix-Coder** is an AI coding assistant created by **Kyllix**.
19
+ It writes, explains, reviews and debugs code in many programming languages.
20
+
21
+ ## Usage with Ollama
22
+
23
+ ```bash
24
+ ollama run hf.co/675uj/Kyllix-Coder-GGUF:Q4_K_M
25
+ ```
26
+
27
+ ## Model details
28
 
29
+ - **Base model:** [Qwen/Qwen2.5-Coder-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct) by Alibaba Cloud
30
+ - **Fine-tuning:** LoRA (r=16) with [Unsloth](https://github.com/unslothai/unsloth), 600 steps
31
+ - **Training data:** 10000 examples from [ise-uiuc/Magicoder-OSS-Instruct-75K](https://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K) plus identity examples
32
+ - **Parameters:** ~1.5B
33
+ - **Context length used in training:** 2048 tokens
34
 
35
+ ## License
36
 
37
+ Released under the [Apache 2.0 license](https://www.apache.org/licenses/LICENSE-2.0), the same license as the base model.
38
+ This model is a derivative of Qwen2.5-Coder-1.5B-Instruct, Copyright (c) Alibaba Cloud.