devaloper commited on
Commit
64a3d35
·
verified ·
1 Parent(s): 7e6ab14

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -15
README.md CHANGED
@@ -1,12 +1,13 @@
1
  ---
2
  license: apache-2.0
3
- library_name: transformers
4
  base_model: Qwen/Qwen3-14B
5
  tags:
6
  - code
7
  - qwen3
8
  - gguf
9
  - fine-tuned
 
10
  model-index:
11
  - name: Codeas Model
12
  results: []
@@ -61,23 +62,30 @@ A fine-tuned **Qwen3-14B** model optimized for code generation and reasoning tas
61
 
62
  ### Ollama
63
 
64
- ```bash
65
- ollama create codeas -f Modelfile
66
- ollama run codeas
67
- ```
68
 
69
- ### Transformers (safetensors)
 
 
70
 
71
- ```python
72
- from transformers import AutoModelForCausalLM, AutoTokenizer
 
 
 
 
73
 
74
- model = AutoModelForCausalLM.from_pretrained("devaloper/thinkncode", torch_dtype="bfloat16", device_map="auto")
75
- tokenizer = AutoTokenizer.from_pretrained("devaloper/thinkncode")
 
 
76
 
77
- messages = [{"role": "user", "content": "Write a binary search in Rust"}]
78
- inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
79
- outputs = model.generate(inputs, max_new_tokens=1024)
80
- print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))
81
  ```
82
 
83
  ## Hardware Requirements
@@ -85,7 +93,6 @@ print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))
85
  | Format | VRAM / RAM |
86
  |--------|-----------|
87
  | Q6_K GGUF | ~14 GB |
88
- | BF16 (full) | ~30 GB |
89
 
90
  ## Training
91
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: gguf
4
  base_model: Qwen/Qwen3-14B
5
  tags:
6
  - code
7
  - qwen3
8
  - gguf
9
  - fine-tuned
10
+ - conversational
11
  model-index:
12
  - name: Codeas Model
13
  results: []
 
62
 
63
  ### Ollama
64
 
65
+ Create a `Modelfile` with the following content:
66
+
67
+ ```dockerfile
68
+ FROM ./codeas-model-Q6_K.gguf
69
 
70
+ PARAMETER temperature 0.6
71
+ PARAMETER top_p 0.95
72
+ PARAMETER top_k 20
73
 
74
+ TEMPLATE """{{- if .System }}<|im_start|>system
75
+ {{ .System }}<|im_end|>
76
+ {{ end }}<|im_start|>user
77
+ {{ .Prompt }}<|im_end|>
78
+ <|im_start|>assistant
79
+ """
80
 
81
+ SYSTEM "You are Codeas, a helpful coding assistant."
82
+ ```
83
+
84
+ Then run:
85
 
86
+ ```bash
87
+ ollama create codeas -f Modelfile
88
+ ollama run codeas
 
89
  ```
90
 
91
  ## Hardware Requirements
 
93
  | Format | VRAM / RAM |
94
  |--------|-----------|
95
  | Q6_K GGUF | ~14 GB |
 
96
 
97
  ## Training
98