Hugging Face's logo

kon171verma
/
intent-classifier-experiments

Text Classification
PEFT
Safetensors
lora
dora
lora+
dora+
adalora
qlora
intent-classification
Model card Files
xet
 Community
Konark Verma commited on
Commit
ffb066f
·
verified ·
1 Parent(s): 4b0f221

Add AdaLoRA adapter: llama3.2-1b_B_1k [20260827-180231]

Browse files
Files changed (7) hide show
  1. .gitattributes +1 -0
  2. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/README.md +208 -0
  3. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/adapter_config.json +1721 -0
  4. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/adapter_model.safetensors +3 -0
  5. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/chat_template.jinja +93 -0
  6. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/tokenizer.json +3 -0
  7. v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/tokenizer_config.json +15 -0
.gitattributes CHANGED
@@ -103,3 +103,4 @@ v2.0/llama3.2-1b_QLoRA_B_1k_20260827-022811/tokenizer.json filter=lfs diff=lfs m
103
  v2.0/qwen3-0.6b_AdaLoRA_D_1k_20260827-024250/tokenizer.json filter=lfs diff=lfs merge=lfs -text
104
  v2.0/llama3.2-1b_QLoRA_C_1k_20260827-173442/tokenizer.json filter=lfs diff=lfs merge=lfs -text
105
  v2.0/llama3.2-1b_AdaLoRA_A_1k_20260827-173745/tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
103
  v2.0/qwen3-0.6b_AdaLoRA_D_1k_20260827-024250/tokenizer.json filter=lfs diff=lfs merge=lfs -text
104
  v2.0/llama3.2-1b_QLoRA_C_1k_20260827-173442/tokenizer.json filter=lfs diff=lfs merge=lfs -text
105
  v2.0/llama3.2-1b_AdaLoRA_A_1k_20260827-173745/tokenizer.json filter=lfs diff=lfs merge=lfs -text
106
+ v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/tokenizer.json filter=lfs diff=lfs merge=lfs -text
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/README.md ADDED
@@ -0,0 +1,208 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: meta-llama/Llama-3.2-1B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:meta-llama/Llama-3.2-1B-Instruct
7
+ - sft
8
+ - transformers
9
+ - trl
10
+ ---
11
+
12
+ # Model Card for Model ID
13
+
14
+ <!-- Provide a quick summary of what the model is/does. -->
15
+
16
+
17
+
18
+ ## Model Details
19
+
20
+ ### Model Description
21
+
22
+ <!-- Provide a longer summary of what this model is. -->
23
+
24
+
25
+
26
+ - **Developed by:** [More Information Needed]
27
+ - **Funded by [optional]:** [More Information Needed]
28
+ - **Shared by [optional]:** [More Information Needed]
29
+ - **Model type:** [More Information Needed]
30
+ - **Language(s) (NLP):** [More Information Needed]
31
+ - **License:** [More Information Needed]
32
+ - **Finetuned from model [optional]:** [More Information Needed]
33
+
34
+ ### Model Sources [optional]
35
+
36
+ <!-- Provide the basic links for the model. -->
37
+
38
+ - **Repository:** [More Information Needed]
39
+ - **Paper [optional]:** [More Information Needed]
40
+ - **Demo [optional]:** [More Information Needed]
41
+
42
+ ## Uses
43
+
44
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
45
+
46
+ ### Direct Use
47
+
48
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Downstream Use [optional]
53
+
54
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
55
+
56
+ [More Information Needed]
57
+
58
+ ### Out-of-Scope Use
59
+
60
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ## Bias, Risks, and Limitations
65
+
66
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
67
+
68
+ [More Information Needed]
69
+
70
+ ### Recommendations
71
+
72
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
73
+
74
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
75
+
76
+ ## How to Get Started with the Model
77
+
78
+ Use the code below to get started with the model.
79
+
80
+ [More Information Needed]
81
+
82
+ ## Training Details
83
+
84
+ ### Training Data
85
+
86
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
87
+
88
+ [More Information Needed]
89
+
90
+ ### Training Procedure
91
+
92
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
93
+
94
+ #### Preprocessing [optional]
95
+
96
+ [More Information Needed]
97
+
98
+
99
+ #### Training Hyperparameters
100
+
101
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
102
+
103
+ #### Speeds, Sizes, Times [optional]
104
+
105
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
106
+
107
+ [More Information Needed]
108
+
109
+ ## Evaluation
110
+
111
+ <!-- This section describes the evaluation protocols and provides the results. -->
112
+
113
+ ### Testing Data, Factors & Metrics
114
+
115
+ #### Testing Data
116
+
117
+ <!-- This should link to a Dataset Card if possible. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Factors
122
+
123
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
124
+
125
+ [More Information Needed]
126
+
127
+ #### Metrics
128
+
129
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
130
+
131
+ [More Information Needed]
132
+
133
+ ### Results
134
+
135
+ [More Information Needed]
136
+
137
+ #### Summary
138
+
139
+
140
+
141
+ ## Model Examination [optional]
142
+
143
+ <!-- Relevant interpretability work for the model goes here -->
144
+
145
+ [More Information Needed]
146
+
147
+ ## Environmental Impact
148
+
149
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
150
+
151
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
152
+
153
+ - **Hardware Type:** [More Information Needed]
154
+ - **Hours used:** [More Information Needed]
155
+ - **Cloud Provider:** [More Information Needed]
156
+ - **Compute Region:** [More Information Needed]
157
+ - **Carbon Emitted:** [More Information Needed]
158
+
159
+ ## Technical Specifications [optional]
160
+
161
+ ### Model Architecture and Objective
162
+
163
+ [More Information Needed]
164
+
165
+ ### Compute Infrastructure
166
+
167
+ [More Information Needed]
168
+
169
+ #### Hardware
170
+
171
+ [More Information Needed]
172
+
173
+ #### Software
174
+
175
+ [More Information Needed]
176
+
177
+ ## Citation [optional]
178
+
179
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
180
+
181
+ **BibTeX:**
182
+
183
+ [More Information Needed]
184
+
185
+ **APA:**
186
+
187
+ [More Information Needed]
188
+
189
+ ## Glossary [optional]
190
+
191
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
192
+
193
+ [More Information Needed]
194
+
195
+ ## More Information [optional]
196
+
197
+ [More Information Needed]
198
+
199
+ ## Model Card Authors [optional]
200
+
201
+ [More Information Needed]
202
+
203
+ ## Model Card Contact
204
+
205
+ [More Information Needed]
206
+ ### Framework versions
207
+
208
+ - PEFT 0.20.0
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/adapter_config.json ADDED
@@ -0,0 +1,1721 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "meta-llama/Llama-3.2-1B-Instruct",
7
+ "beta1": 0.85,
8
+ "beta2": 0.85,
9
+ "bias": "none",
10
+ "corda_config": null,
11
+ "deltaT": 10,
12
+ "ensure_weight_tying": false,
13
+ "eva_config": null,
14
+ "exclude_modules": null,
15
+ "fan_in_fan_out": false,
16
+ "inference_mode": true,
17
+ "init_lora_weights": true,
18
+ "init_r": 24,
19
+ "layer_replication": null,
20
+ "layers_pattern": null,
21
+ "layers_to_transform": null,
22
+ "loftq_config": {},
23
+ "lora_alpha": 48,
24
+ "lora_bias": false,
25
+ "lora_dropout": 0.0,
26
+ "lora_ga_config": null,
27
+ "megatron_config": null,
28
+ "megatron_core": "megatron.core",
29
+ "modules_to_save": null,
30
+ "monteclora_config": null,
31
+ "orth_reg_weight": 0.1,
32
+ "peft_type": "ADALORA",
33
+ "peft_version": "0.20.0",
34
+ "qalora_group_size": 16,
35
+ "r": 8,
36
+ "rank_pattern": {
37
+ "model.layers.0.self_attn.k_proj.lora_E": [
38
+ false,
39
+ false,
40
+ false,
41
+ false,
42
+ false,
43
+ false,
44
+ false,
45
+ false,
46
+ false,
47
+ false,
48
+ false,
49
+ false,
50
+ false,
51
+ false,
52
+ false,
53
+ false,
54
+ false,
55
+ false,
56
+ false,
57
+ false,
58
+ false,
59
+ false,
60
+ false,
61
+ false
62
+ ],
63
+ "model.layers.0.self_attn.o_proj.lora_E": [
64
+ false,
65
+ false,
66
+ false,
67
+ true,
68
+ false,
69
+ true,
70
+ true,
71
+ true,
72
+ true,
73
+ true,
74
+ true,
75
+ false,
76
+ true,
77
+ true,
78
+ true,
79
+ false,
80
+ true,
81
+ true,
82
+ true,
83
+ true,
84
+ true,
85
+ false,
86
+ true,
87
+ true
88
+ ],
89
+ "model.layers.0.self_attn.q_proj.lora_E": [
90
+ false,
91
+ false,
92
+ false,
93
+ false,
94
+ false,
95
+ false,
96
+ false,
97
+ false,
98
+ false,
99
+ false,
100
+ false,
101
+ false,
102
+ false,
103
+ false,
104
+ false,
105
+ false,
106
+ false,
107
+ false,
108
+ false,
109
+ false,
110
+ false,
111
+ false,
112
+ false,
113
+ false
114
+ ],
115
+ "model.layers.0.self_attn.v_proj.lora_E": [
116
+ true,
117
+ false,
118
+ true,
119
+ false,
120
+ false,
121
+ false,
122
+ true,
123
+ true,
124
+ true,
125
+ false,
126
+ true,
127
+ false,
128
+ false,
129
+ false,
130
+ true,
131
+ true,
132
+ false,
133
+ true,
134
+ false,
135
+ false,
136
+ false,
137
+ false,
138
+ true,
139
+ true
140
+ ],
141
+ "model.layers.1.self_attn.k_proj.lora_E": [
142
+ false,
143
+ false,
144
+ false,
145
+ true,
146
+ false,
147
+ false,
148
+ false,
149
+ false,
150
+ false,
151
+ false,
152
+ false,
153
+ false,
154
+ false,
155
+ false,
156
+ false,
157
+ false,
158
+ false,
159
+ false,
160
+ true,
161
+ false,
162
+ false,
163
+ true,
164
+ false,
165
+ false
166
+ ],
167
+ "model.layers.1.self_attn.o_proj.lora_E": [
168
+ true,
169
+ true,
170
+ false,
171
+ false,
172
+ true,
173
+ true,
174
+ true,
175
+ false,
176
+ true,
177
+ true,
178
+ false,
179
+ false,
180
+ false,
181
+ true,
182
+ true,
183
+ false,
184
+ false,
185
+ true,
186
+ true,
187
+ false,
188
+ true,
189
+ false,
190
+ false,
191
+ false
192
+ ],
193
+ "model.layers.1.self_attn.q_proj.lora_E": [
194
+ true,
195
+ true,
196
+ false,
197
+ false,
198
+ false,
199
+ false,
200
+ false,
201
+ false,
202
+ true,
203
+ true,
204
+ false,
205
+ false,
206
+ false,
207
+ false,
208
+ false,
209
+ false,
210
+ false,
211
+ true,
212
+ true,
213
+ false,
214
+ false,
215
+ false,
216
+ false,
217
+ true
218
+ ],
219
+ "model.layers.1.self_attn.v_proj.lora_E": [
220
+ true,
221
+ true,
222
+ true,
223
+ true,
224
+ true,
225
+ false,
226
+ true,
227
+ true,
228
+ true,
229
+ true,
230
+ true,
231
+ false,
232
+ true,
233
+ true,
234
+ true,
235
+ true,
236
+ true,
237
+ false,
238
+ true,
239
+ false,
240
+ true,
241
+ false,
242
+ true,
243
+ true
244
+ ],
245
+ "model.layers.10.self_attn.k_proj.lora_E": [
246
+ false,
247
+ false,
248
+ false,
249
+ false,
250
+ false,
251
+ false,
252
+ false,
253
+ false,
254
+ false,
255
+ false,
256
+ true,
257
+ false,
258
+ false,
259
+ false,
260
+ false,
261
+ false,
262
+ false,
263
+ false,
264
+ false,
265
+ false,
266
+ false,
267
+ false,
268
+ false,
269
+ false
270
+ ],
271
+ "model.layers.10.self_attn.o_proj.lora_E": [
272
+ false,
273
+ true,
274
+ false,
275
+ true,
276
+ false,
277
+ true,
278
+ true,
279
+ true,
280
+ true,
281
+ false,
282
+ true,
283
+ true,
284
+ true,
285
+ true,
286
+ false,
287
+ true,
288
+ true,
289
+ true,
290
+ true,
291
+ true,
292
+ false,
293
+ true,
294
+ true,
295
+ true
296
+ ],
297
+ "model.layers.10.self_attn.q_proj.lora_E": [
298
+ true,
299
+ false,
300
+ true,
301
+ false,
302
+ false,
303
+ true,
304
+ true,
305
+ false,
306
+ true,
307
+ true,
308
+ false,
309
+ true,
310
+ true,
311
+ true,
312
+ false,
313
+ true,
314
+ true,
315
+ false,
316
+ false,
317
+ false,
318
+ false,
319
+ false,
320
+ false,
321
+ true
322
+ ],
323
+ "model.layers.10.self_attn.v_proj.lora_E": [
324
+ false,
325
+ false,
326
+ false,
327
+ false,
328
+ false,
329
+ true,
330
+ true,
331
+ false,
332
+ false,
333
+ false,
334
+ false,
335
+ false,
336
+ false,
337
+ true,
338
+ false,
339
+ false,
340
+ false,
341
+ false,
342
+ false,
343
+ false,
344
+ false,
345
+ false,
346
+ false,
347
+ true
348
+ ],
349
+ "model.layers.11.self_attn.k_proj.lora_E": [
350
+ false,
351
+ false,
352
+ false,
353
+ false,
354
+ false,
355
+ false,
356
+ false,
357
+ false,
358
+ false,
359
+ false,
360
+ false,
361
+ false,
362
+ false,
363
+ false,
364
+ false,
365
+ false,
366
+ false,
367
+ false,
368
+ false,
369
+ false,
370
+ false,
371
+ false,
372
+ false,
373
+ false
374
+ ],
375
+ "model.layers.11.self_attn.o_proj.lora_E": [
376
+ false,
377
+ false,
378
+ false,
379
+ true,
380
+ true,
381
+ true,
382
+ true,
383
+ true,
384
+ false,
385
+ false,
386
+ true,
387
+ false,
388
+ true,
389
+ true,
390
+ true,
391
+ true,
392
+ true,
393
+ false,
394
+ false,
395
+ true,
396
+ false,
397
+ true,
398
+ false,
399
+ true
400
+ ],
401
+ "model.layers.11.self_attn.q_proj.lora_E": [
402
+ false,
403
+ false,
404
+ false,
405
+ false,
406
+ false,
407
+ false,
408
+ false,
409
+ false,
410
+ false,
411
+ false,
412
+ false,
413
+ false,
414
+ false,
415
+ false,
416
+ false,
417
+ false,
418
+ false,
419
+ false,
420
+ false,
421
+ false,
422
+ false,
423
+ false,
424
+ false,
425
+ false
426
+ ],
427
+ "model.layers.11.self_attn.v_proj.lora_E": [
428
+ false,
429
+ true,
430
+ false,
431
+ false,
432
+ false,
433
+ false,
434
+ false,
435
+ false,
436
+ false,
437
+ false,
438
+ false,
439
+ true,
440
+ false,
441
+ false,
442
+ true,
443
+ true,
444
+ false,
445
+ false,
446
+ false,
447
+ false,
448
+ false,
449
+ true,
450
+ true,
451
+ true
452
+ ],
453
+ "model.layers.12.self_attn.k_proj.lora_E": [
454
+ false,
455
+ false,
456
+ false,
457
+ false,
458
+ false,
459
+ false,
460
+ false,
461
+ false,
462
+ false,
463
+ false,
464
+ false,
465
+ false,
466
+ false,
467
+ false,
468
+ false,
469
+ false,
470
+ false,
471
+ false,
472
+ false,
473
+ false,
474
+ false,
475
+ false,
476
+ false,
477
+ false
478
+ ],
479
+ "model.layers.12.self_attn.o_proj.lora_E": [
480
+ true,
481
+ true,
482
+ false,
483
+ false,
484
+ false,
485
+ false,
486
+ true,
487
+ false,
488
+ true,
489
+ false,
490
+ true,
491
+ true,
492
+ false,
493
+ false,
494
+ false,
495
+ false,
496
+ false,
497
+ false,
498
+ true,
499
+ true,
500
+ false,
501
+ true,
502
+ true,
503
+ false
504
+ ],
505
+ "model.layers.12.self_attn.q_proj.lora_E": [
506
+ false,
507
+ false,
508
+ false,
509
+ false,
510
+ false,
511
+ false,
512
+ false,
513
+ false,
514
+ false,
515
+ false,
516
+ false,
517
+ false,
518
+ false,
519
+ false,
520
+ false,
521
+ false,
522
+ false,
523
+ false,
524
+ false,
525
+ false,
526
+ false,
527
+ false,
528
+ false,
529
+ false
530
+ ],
531
+ "model.layers.12.self_attn.v_proj.lora_E": [
532
+ false,
533
+ false,
534
+ false,
535
+ false,
536
+ false,
537
+ false,
538
+ true,
539
+ false,
540
+ false,
541
+ false,
542
+ false,
543
+ true,
544
+ false,
545
+ false,
546
+ true,
547
+ false,
548
+ true,
549
+ false,
550
+ false,
551
+ false,
552
+ false,
553
+ true,
554
+ false,
555
+ false
556
+ ],
557
+ "model.layers.13.self_attn.k_proj.lora_E": [
558
+ false,
559
+ false,
560
+ false,
561
+ false,
562
+ false,
563
+ false,
564
+ false,
565
+ false,
566
+ false,
567
+ false,
568
+ false,
569
+ false,
570
+ false,
571
+ false,
572
+ false,
573
+ false,
574
+ false,
575
+ false,
576
+ false,
577
+ false,
578
+ false,
579
+ false,
580
+ false,
581
+ false
582
+ ],
583
+ "model.layers.13.self_attn.o_proj.lora_E": [
584
+ false,
585
+ false,
586
+ false,
587
+ false,
588
+ false,
589
+ false,
590
+ true,
591
+ true,
592
+ true,
593
+ true,
594
+ false,
595
+ true,
596
+ true,
597
+ false,
598
+ false,
599
+ false,
600
+ false,
601
+ true,
602
+ false,
603
+ false,
604
+ false,
605
+ true,
606
+ false,
607
+ false
608
+ ],
609
+ "model.layers.13.self_attn.q_proj.lora_E": [
610
+ false,
611
+ false,
612
+ false,
613
+ false,
614
+ false,
615
+ false,
616
+ false,
617
+ false,
618
+ false,
619
+ false,
620
+ false,
621
+ false,
622
+ false,
623
+ false,
624
+ false,
625
+ false,
626
+ true,
627
+ false,
628
+ false,
629
+ false,
630
+ false,
631
+ false,
632
+ false,
633
+ false
634
+ ],
635
+ "model.layers.13.self_attn.v_proj.lora_E": [
636
+ false,
637
+ false,
638
+ false,
639
+ false,
640
+ false,
641
+ false,
642
+ false,
643
+ false,
644
+ false,
645
+ false,
646
+ true,
647
+ false,
648
+ false,
649
+ false,
650
+ false,
651
+ false,
652
+ false,
653
+ false,
654
+ false,
655
+ false,
656
+ false,
657
+ false,
658
+ false,
659
+ false
660
+ ],
661
+ "model.layers.14.self_attn.k_proj.lora_E": [
662
+ false,
663
+ false,
664
+ false,
665
+ false,
666
+ false,
667
+ false,
668
+ false,
669
+ false,
670
+ false,
671
+ false,
672
+ false,
673
+ false,
674
+ false,
675
+ false,
676
+ false,
677
+ false,
678
+ false,
679
+ false,
680
+ false,
681
+ false,
682
+ false,
683
+ false,
684
+ false,
685
+ false
686
+ ],
687
+ "model.layers.14.self_attn.o_proj.lora_E": [
688
+ false,
689
+ true,
690
+ true,
691
+ true,
692
+ false,
693
+ false,
694
+ true,
695
+ false,
696
+ true,
697
+ true,
698
+ false,
699
+ false,
700
+ false,
701
+ false,
702
+ false,
703
+ false,
704
+ false,
705
+ false,
706
+ false,
707
+ false,
708
+ false,
709
+ false,
710
+ true,
711
+ true
712
+ ],
713
+ "model.layers.14.self_attn.q_proj.lora_E": [
714
+ false,
715
+ false,
716
+ false,
717
+ false,
718
+ false,
719
+ false,
720
+ false,
721
+ false,
722
+ false,
723
+ false,
724
+ false,
725
+ false,
726
+ false,
727
+ false,
728
+ false,
729
+ false,
730
+ false,
731
+ false,
732
+ false,
733
+ false,
734
+ false,
735
+ false,
736
+ false,
737
+ false
738
+ ],
739
+ "model.layers.14.self_attn.v_proj.lora_E": [
740
+ false,
741
+ false,
742
+ false,
743
+ false,
744
+ false,
745
+ false,
746
+ false,
747
+ false,
748
+ false,
749
+ false,
750
+ false,
751
+ true,
752
+ false,
753
+ false,
754
+ false,
755
+ false,
756
+ false,
757
+ false,
758
+ false,
759
+ false,
760
+ false,
761
+ false,
762
+ false,
763
+ false
764
+ ],
765
+ "model.layers.15.self_attn.k_proj.lora_E": [
766
+ false,
767
+ false,
768
+ false,
769
+ false,
770
+ false,
771
+ false,
772
+ false,
773
+ false,
774
+ false,
775
+ false,
776
+ false,
777
+ false,
778
+ false,
779
+ false,
780
+ false,
781
+ false,
782
+ false,
783
+ false,
784
+ false,
785
+ false,
786
+ false,
787
+ false,
788
+ false,
789
+ false
790
+ ],
791
+ "model.layers.15.self_attn.o_proj.lora_E": [
792
+ false,
793
+ false,
794
+ false,
795
+ false,
796
+ false,
797
+ false,
798
+ false,
799
+ false,
800
+ false,
801
+ false,
802
+ false,
803
+ false,
804
+ false,
805
+ false,
806
+ true,
807
+ true,
808
+ false,
809
+ false,
810
+ false,
811
+ true,
812
+ false,
813
+ false,
814
+ false,
815
+ false
816
+ ],
817
+ "model.layers.15.self_attn.q_proj.lora_E": [
818
+ false,
819
+ false,
820
+ false,
821
+ false,
822
+ false,
823
+ false,
824
+ false,
825
+ false,
826
+ false,
827
+ false,
828
+ false,
829
+ false,
830
+ false,
831
+ true,
832
+ false,
833
+ false,
834
+ false,
835
+ false,
836
+ true,
837
+ false,
838
+ false,
839
+ false,
840
+ false,
841
+ true
842
+ ],
843
+ "model.layers.15.self_attn.v_proj.lora_E": [
844
+ false,
845
+ false,
846
+ false,
847
+ false,
848
+ false,
849
+ false,
850
+ false,
851
+ false,
852
+ false,
853
+ false,
854
+ false,
855
+ false,
856
+ false,
857
+ false,
858
+ false,
859
+ false,
860
+ false,
861
+ false,
862
+ false,
863
+ false,
864
+ false,
865
+ false,
866
+ false,
867
+ false
868
+ ],
869
+ "model.layers.2.self_attn.k_proj.lora_E": [
870
+ false,
871
+ false,
872
+ false,
873
+ false,
874
+ false,
875
+ false,
876
+ false,
877
+ false,
878
+ true,
879
+ true,
880
+ false,
881
+ false,
882
+ false,
883
+ false,
884
+ false,
885
+ false,
886
+ true,
887
+ false,
888
+ false,
889
+ false,
890
+ false,
891
+ true,
892
+ true,
893
+ false
894
+ ],
895
+ "model.layers.2.self_attn.o_proj.lora_E": [
896
+ true,
897
+ false,
898
+ true,
899
+ true,
900
+ true,
901
+ false,
902
+ true,
903
+ true,
904
+ false,
905
+ true,
906
+ true,
907
+ true,
908
+ true,
909
+ true,
910
+ true,
911
+ true,
912
+ false,
913
+ true,
914
+ true,
915
+ true,
916
+ true,
917
+ true,
918
+ true,
919
+ true
920
+ ],
921
+ "model.layers.2.self_attn.q_proj.lora_E": [
922
+ true,
923
+ false,
924
+ false,
925
+ false,
926
+ true,
927
+ false,
928
+ true,
929
+ false,
930
+ false,
931
+ true,
932
+ false,
933
+ false,
934
+ true,
935
+ true,
936
+ false,
937
+ false,
938
+ false,
939
+ false,
940
+ false,
941
+ false,
942
+ true,
943
+ false,
944
+ true,
945
+ false
946
+ ],
947
+ "model.layers.2.self_attn.v_proj.lora_E": [
948
+ true,
949
+ true,
950
+ true,
951
+ true,
952
+ true,
953
+ true,
954
+ true,
955
+ true,
956
+ true,
957
+ true,
958
+ true,
959
+ false,
960
+ true,
961
+ false,
962
+ false,
963
+ false,
964
+ true,
965
+ false,
966
+ true,
967
+ true,
968
+ false,
969
+ true,
970
+ false,
971
+ false
972
+ ],
973
+ "model.layers.3.self_attn.k_proj.lora_E": [
974
+ false,
975
+ false,
976
+ false,
977
+ false,
978
+ false,
979
+ false,
980
+ false,
981
+ false,
982
+ false,
983
+ false,
984
+ false,
985
+ false,
986
+ false,
987
+ false,
988
+ false,
989
+ false,
990
+ false,
991
+ false,
992
+ false,
993
+ false,
994
+ false,
995
+ false,
996
+ false,
997
+ false
998
+ ],
999
+ "model.layers.3.self_attn.o_proj.lora_E": [
1000
+ true,
1001
+ false,
1002
+ true,
1003
+ true,
1004
+ true,
1005
+ false,
1006
+ false,
1007
+ true,
1008
+ true,
1009
+ true,
1010
+ true,
1011
+ true,
1012
+ true,
1013
+ false,
1014
+ false,
1015
+ true,
1016
+ true,
1017
+ true,
1018
+ false,
1019
+ true,
1020
+ true,
1021
+ false,
1022
+ true,
1023
+ true
1024
+ ],
1025
+ "model.layers.3.self_attn.q_proj.lora_E": [
1026
+ false,
1027
+ false,
1028
+ false,
1029
+ false,
1030
+ false,
1031
+ false,
1032
+ false,
1033
+ false,
1034
+ false,
1035
+ false,
1036
+ false,
1037
+ false,
1038
+ false,
1039
+ false,
1040
+ false,
1041
+ false,
1042
+ true,
1043
+ false,
1044
+ false,
1045
+ false,
1046
+ false,
1047
+ false,
1048
+ false,
1049
+ false
1050
+ ],
1051
+ "model.layers.3.self_attn.v_proj.lora_E": [
1052
+ true,
1053
+ true,
1054
+ true,
1055
+ true,
1056
+ true,
1057
+ false,
1058
+ false,
1059
+ false,
1060
+ true,
1061
+ false,
1062
+ true,
1063
+ true,
1064
+ true,
1065
+ true,
1066
+ false,
1067
+ false,
1068
+ false,
1069
+ true,
1070
+ false,
1071
+ false,
1072
+ false,
1073
+ true,
1074
+ false,
1075
+ false
1076
+ ],
1077
+ "model.layers.4.self_attn.k_proj.lora_E": [
1078
+ false,
1079
+ false,
1080
+ false,
1081
+ false,
1082
+ false,
1083
+ false,
1084
+ false,
1085
+ false,
1086
+ false,
1087
+ false,
1088
+ false,
1089
+ false,
1090
+ false,
1091
+ false,
1092
+ false,
1093
+ false,
1094
+ false,
1095
+ false,
1096
+ false,
1097
+ true,
1098
+ false,
1099
+ false,
1100
+ false,
1101
+ false
1102
+ ],
1103
+ "model.layers.4.self_attn.o_proj.lora_E": [
1104
+ true,
1105
+ false,
1106
+ true,
1107
+ false,
1108
+ true,
1109
+ true,
1110
+ true,
1111
+ true,
1112
+ true,
1113
+ true,
1114
+ true,
1115
+ true,
1116
+ true,
1117
+ true,
1118
+ true,
1119
+ false,
1120
+ false,
1121
+ true,
1122
+ true,
1123
+ true,
1124
+ true,
1125
+ true,
1126
+ true,
1127
+ true
1128
+ ],
1129
+ "model.layers.4.self_attn.q_proj.lora_E": [
1130
+ false,
1131
+ true,
1132
+ false,
1133
+ false,
1134
+ false,
1135
+ true,
1136
+ false,
1137
+ false,
1138
+ false,
1139
+ false,
1140
+ true,
1141
+ true,
1142
+ false,
1143
+ true,
1144
+ true,
1145
+ false,
1146
+ true,
1147
+ false,
1148
+ false,
1149
+ false,
1150
+ false,
1151
+ false,
1152
+ false,
1153
+ false
1154
+ ],
1155
+ "model.layers.4.self_attn.v_proj.lora_E": [
1156
+ false,
1157
+ false,
1158
+ true,
1159
+ true,
1160
+ false,
1161
+ true,
1162
+ true,
1163
+ false,
1164
+ true,
1165
+ true,
1166
+ true,
1167
+ true,
1168
+ false,
1169
+ true,
1170
+ true,
1171
+ true,
1172
+ true,
1173
+ true,
1174
+ true,
1175
+ true,
1176
+ true,
1177
+ false,
1178
+ true,
1179
+ false
1180
+ ],
1181
+ "model.layers.5.self_attn.k_proj.lora_E": [
1182
+ false,
1183
+ false,
1184
+ false,
1185
+ false,
1186
+ false,
1187
+ false,
1188
+ false,
1189
+ false,
1190
+ false,
1191
+ false,
1192
+ false,
1193
+ false,
1194
+ false,
1195
+ false,
1196
+ false,
1197
+ false,
1198
+ false,
1199
+ false,
1200
+ false,
1201
+ false,
1202
+ false,
1203
+ false,
1204
+ false,
1205
+ false
1206
+ ],
1207
+ "model.layers.5.self_attn.o_proj.lora_E": [
1208
+ true,
1209
+ true,
1210
+ true,
1211
+ true,
1212
+ true,
1213
+ true,
1214
+ true,
1215
+ true,
1216
+ true,
1217
+ true,
1218
+ true,
1219
+ true,
1220
+ true,
1221
+ true,
1222
+ true,
1223
+ true,
1224
+ true,
1225
+ true,
1226
+ true,
1227
+ true,
1228
+ true,
1229
+ true,
1230
+ true,
1231
+ false
1232
+ ],
1233
+ "model.layers.5.self_attn.q_proj.lora_E": [
1234
+ true,
1235
+ false,
1236
+ false,
1237
+ false,
1238
+ false,
1239
+ false,
1240
+ false,
1241
+ true,
1242
+ false,
1243
+ true,
1244
+ true,
1245
+ true,
1246
+ false,
1247
+ false,
1248
+ true,
1249
+ true,
1250
+ false,
1251
+ false,
1252
+ true,
1253
+ false,
1254
+ false,
1255
+ true,
1256
+ true,
1257
+ false
1258
+ ],
1259
+ "model.layers.5.self_attn.v_proj.lora_E": [
1260
+ true,
1261
+ false,
1262
+ true,
1263
+ false,
1264
+ false,
1265
+ true,
1266
+ true,
1267
+ false,
1268
+ true,
1269
+ true,
1270
+ true,
1271
+ true,
1272
+ true,
1273
+ false,
1274
+ true,
1275
+ false,
1276
+ true,
1277
+ false,
1278
+ true,
1279
+ true,
1280
+ false,
1281
+ true,
1282
+ false,
1283
+ true
1284
+ ],
1285
+ "model.layers.6.self_attn.k_proj.lora_E": [
1286
+ false,
1287
+ true,
1288
+ false,
1289
+ false,
1290
+ false,
1291
+ false,
1292
+ false,
1293
+ false,
1294
+ false,
1295
+ false,
1296
+ false,
1297
+ false,
1298
+ false,
1299
+ false,
1300
+ false,
1301
+ false,
1302
+ false,
1303
+ false,
1304
+ false,
1305
+ false,
1306
+ false,
1307
+ false,
1308
+ false,
1309
+ false
1310
+ ],
1311
+ "model.layers.6.self_attn.o_proj.lora_E": [
1312
+ false,
1313
+ false,
1314
+ true,
1315
+ true,
1316
+ true,
1317
+ true,
1318
+ false,
1319
+ true,
1320
+ true,
1321
+ true,
1322
+ true,
1323
+ true,
1324
+ true,
1325
+ true,
1326
+ true,
1327
+ true,
1328
+ true,
1329
+ true,
1330
+ true,
1331
+ true,
1332
+ true,
1333
+ true,
1334
+ true,
1335
+ true
1336
+ ],
1337
+ "model.layers.6.self_attn.q_proj.lora_E": [
1338
+ false,
1339
+ false,
1340
+ true,
1341
+ true,
1342
+ false,
1343
+ true,
1344
+ false,
1345
+ true,
1346
+ true,
1347
+ false,
1348
+ false,
1349
+ true,
1350
+ true,
1351
+ false,
1352
+ true,
1353
+ false,
1354
+ false,
1355
+ true,
1356
+ true,
1357
+ true,
1358
+ false,
1359
+ true,
1360
+ true,
1361
+ false
1362
+ ],
1363
+ "model.layers.6.self_attn.v_proj.lora_E": [
1364
+ true,
1365
+ false,
1366
+ false,
1367
+ true,
1368
+ false,
1369
+ true,
1370
+ false,
1371
+ false,
1372
+ true,
1373
+ false,
1374
+ true,
1375
+ true,
1376
+ false,
1377
+ false,
1378
+ false,
1379
+ false,
1380
+ false,
1381
+ false,
1382
+ true,
1383
+ false,
1384
+ true,
1385
+ true,
1386
+ true,
1387
+ true
1388
+ ],
1389
+ "model.layers.7.self_attn.k_proj.lora_E": [
1390
+ false,
1391
+ true,
1392
+ false,
1393
+ false,
1394
+ false,
1395
+ false,
1396
+ true,
1397
+ false,
1398
+ false,
1399
+ false,
1400
+ false,
1401
+ false,
1402
+ false,
1403
+ false,
1404
+ false,
1405
+ false,
1406
+ true,
1407
+ false,
1408
+ false,
1409
+ false,
1410
+ false,
1411
+ false,
1412
+ false,
1413
+ false
1414
+ ],
1415
+ "model.layers.7.self_attn.o_proj.lora_E": [
1416
+ true,
1417
+ true,
1418
+ false,
1419
+ true,
1420
+ false,
1421
+ false,
1422
+ true,
1423
+ true,
1424
+ true,
1425
+ true,
1426
+ true,
1427
+ true,
1428
+ true,
1429
+ true,
1430
+ true,
1431
+ true,
1432
+ true,
1433
+ true,
1434
+ true,
1435
+ false,
1436
+ true,
1437
+ true,
1438
+ true,
1439
+ true
1440
+ ],
1441
+ "model.layers.7.self_attn.q_proj.lora_E": [
1442
+ false,
1443
+ true,
1444
+ false,
1445
+ false,
1446
+ true,
1447
+ false,
1448
+ false,
1449
+ true,
1450
+ true,
1451
+ true,
1452
+ false,
1453
+ false,
1454
+ false,
1455
+ false,
1456
+ true,
1457
+ false,
1458
+ false,
1459
+ true,
1460
+ true,
1461
+ true,
1462
+ true,
1463
+ false,
1464
+ false,
1465
+ false
1466
+ ],
1467
+ "model.layers.7.self_attn.v_proj.lora_E": [
1468
+ false,
1469
+ true,
1470
+ true,
1471
+ true,
1472
+ false,
1473
+ true,
1474
+ true,
1475
+ false,
1476
+ true,
1477
+ true,
1478
+ true,
1479
+ true,
1480
+ true,
1481
+ false,
1482
+ true,
1483
+ false,
1484
+ false,
1485
+ false,
1486
+ true,
1487
+ false,
1488
+ false,
1489
+ true,
1490
+ true,
1491
+ false
1492
+ ],
1493
+ "model.layers.8.self_attn.k_proj.lora_E": [
1494
+ false,
1495
+ false,
1496
+ false,
1497
+ false,
1498
+ false,
1499
+ false,
1500
+ false,
1501
+ false,
1502
+ false,
1503
+ false,
1504
+ false,
1505
+ false,
1506
+ false,
1507
+ false,
1508
+ false,
1509
+ false,
1510
+ false,
1511
+ false,
1512
+ false,
1513
+ false,
1514
+ false,
1515
+ false,
1516
+ false,
1517
+ false
1518
+ ],
1519
+ "model.layers.8.self_attn.o_proj.lora_E": [
1520
+ true,
1521
+ true,
1522
+ true,
1523
+ true,
1524
+ true,
1525
+ true,
1526
+ true,
1527
+ true,
1528
+ true,
1529
+ false,
1530
+ true,
1531
+ true,
1532
+ true,
1533
+ true,
1534
+ true,
1535
+ true,
1536
+ true,
1537
+ true,
1538
+ true,
1539
+ false,
1540
+ true,
1541
+ true,
1542
+ false,
1543
+ true
1544
+ ],
1545
+ "model.layers.8.self_attn.q_proj.lora_E": [
1546
+ false,
1547
+ true,
1548
+ true,
1549
+ true,
1550
+ true,
1551
+ true,
1552
+ false,
1553
+ false,
1554
+ true,
1555
+ false,
1556
+ false,
1557
+ true,
1558
+ true,
1559
+ false,
1560
+ false,
1561
+ true,
1562
+ false,
1563
+ false,
1564
+ false,
1565
+ true,
1566
+ true,
1567
+ true,
1568
+ false,
1569
+ false
1570
+ ],
1571
+ "model.layers.8.self_attn.v_proj.lora_E": [
1572
+ true,
1573
+ true,
1574
+ true,
1575
+ false,
1576
+ true,
1577
+ false,
1578
+ true,
1579
+ true,
1580
+ false,
1581
+ false,
1582
+ false,
1583
+ false,
1584
+ true,
1585
+ true,
1586
+ true,
1587
+ true,
1588
+ false,
1589
+ true,
1590
+ false,
1591
+ true,
1592
+ true,
1593
+ true,
1594
+ false,
1595
+ false
1596
+ ],
1597
+ "model.layers.9.self_attn.k_proj.lora_E": [
1598
+ false,
1599
+ false,
1600
+ false,
1601
+ false,
1602
+ false,
1603
+ false,
1604
+ false,
1605
+ false,
1606
+ false,
1607
+ false,
1608
+ false,
1609
+ false,
1610
+ false,
1611
+ false,
1612
+ false,
1613
+ false,
1614
+ true,
1615
+ false,
1616
+ false,
1617
+ false,
1618
+ false,
1619
+ false,
1620
+ false,
1621
+ false
1622
+ ],
1623
+ "model.layers.9.self_attn.o_proj.lora_E": [
1624
+ true,
1625
+ true,
1626
+ false,
1627
+ true,
1628
+ false,
1629
+ true,
1630
+ true,
1631
+ false,
1632
+ true,
1633
+ true,
1634
+ true,
1635
+ true,
1636
+ false,
1637
+ true,
1638
+ false,
1639
+ true,
1640
+ true,
1641
+ true,
1642
+ true,
1643
+ true,
1644
+ true,
1645
+ true,
1646
+ true,
1647
+ true
1648
+ ],
1649
+ "model.layers.9.self_attn.q_proj.lora_E": [
1650
+ false,
1651
+ false,
1652
+ false,
1653
+ false,
1654
+ false,
1655
+ false,
1656
+ false,
1657
+ false,
1658
+ true,
1659
+ false,
1660
+ false,
1661
+ true,
1662
+ false,
1663
+ true,
1664
+ false,
1665
+ false,
1666
+ true,
1667
+ true,
1668
+ false,
1669
+ false,
1670
+ false,
1671
+ true,
1672
+ false,
1673
+ false
1674
+ ],
1675
+ "model.layers.9.self_attn.v_proj.lora_E": [
1676
+ true,
1677
+ false,
1678
+ false,
1679
+ true,
1680
+ false,
1681
+ false,
1682
+ false,
1683
+ false,
1684
+ true,
1685
+ false,
1686
+ false,
1687
+ true,
1688
+ true,
1689
+ false,
1690
+ true,
1691
+ false,
1692
+ false,
1693
+ true,
1694
+ false,
1695
+ true,
1696
+ false,
1697
+ false,
1698
+ true,
1699
+ false
1700
+ ]
1701
+ },
1702
+ "revision": null,
1703
+ "target_modules": [
1704
+ "q_proj",
1705
+ "v_proj",
1706
+ "o_proj",
1707
+ "k_proj"
1708
+ ],
1709
+ "target_parameters": null,
1710
+ "target_r": 8,
1711
+ "task_type": "CAUSAL_LM",
1712
+ "tfinal": 50,
1713
+ "tinit": 50,
1714
+ "total_step": 500,
1715
+ "trainable_token_indices": null,
1716
+ "use_bdlora": null,
1717
+ "use_dora": false,
1718
+ "use_qalora": false,
1719
+ "use_rslora": false,
1720
+ "velora_config": null
1721
+ }
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9fb7cdba2d55c30fcbb4cf64f304e4c992232a25d69569f17c3dacddb04a8ef
3
+ size 7363720
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/chat_template.jinja ADDED
@@ -0,0 +1,93 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {{- bos_token }}
2
+ {%- if custom_tools is defined %}
3
+ {%- set tools = custom_tools %}
4
+ {%- endif %}
5
+ {%- if not tools_in_user_message is defined %}
6
+ {%- set tools_in_user_message = true %}
7
+ {%- endif %}
8
+ {%- if not date_string is defined %}
9
+ {%- if strftime_now is defined %}
10
+ {%- set date_string = strftime_now("%d %b %Y") %}
11
+ {%- else %}
12
+ {%- set date_string = "26 Jul 2024" %}
13
+ {%- endif %}
14
+ {%- endif %}
15
+ {%- if not tools is defined %}
16
+ {%- set tools = none %}
17
+ {%- endif %}
18
+
19
+ {#- This block extracts the system message, so we can slot it into the right place. #}
20
+ {%- if messages[0]['role'] == 'system' %}
21
+ {%- set system_message = messages[0]['content']|trim %}
22
+ {%- set messages = messages[1:] %}
23
+ {%- else %}
24
+ {%- set system_message = "" %}
25
+ {%- endif %}
26
+
27
+ {#- System message #}
28
+ {{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
29
+ {%- if tools is not none %}
30
+ {{- "Environment: ipython\n" }}
31
+ {%- endif %}
32
+ {{- "Cutting Knowledge Date: December 2023\n" }}
33
+ {{- "Today Date: " + date_string + "\n\n" }}
34
+ {%- if tools is not none and not tools_in_user_message %}
35
+ {{- "You have access to the following functions. To call a function, please respond with JSON for a function call." }}
36
+ {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
37
+ {{- "Do not use variables.\n\n" }}
38
+ {%- for t in tools %}
39
+ {{- t | tojson(indent=4) }}
40
+ {{- "\n\n" }}
41
+ {%- endfor %}
42
+ {%- endif %}
43
+ {{- system_message }}
44
+ {{- "<|eot_id|>" }}
45
+
46
+ {#- Custom tools are passed in a user message with some extra guidance #}
47
+ {%- if tools_in_user_message and not tools is none %}
48
+ {#- Extract the first user message so we can plug it in here #}
49
+ {%- if messages | length != 0 %}
50
+ {%- set first_user_message = messages[0]['content']|trim %}
51
+ {%- set messages = messages[1:] %}
52
+ {%- else %}
53
+ {{- raise_exception("Cannot put tools in the first user message when there's no first user message!") }}
54
+ {%- endif %}
55
+ {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}
56
+ {{- "Given the following functions, please respond with a JSON for a function call " }}
57
+ {{- "with its proper arguments that best answers the given prompt.\n\n" }}
58
+ {{- 'Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}.' }}
59
+ {{- "Do not use variables.\n\n" }}
60
+ {%- for t in tools %}
61
+ {{- t | tojson(indent=4) }}
62
+ {{- "\n\n" }}
63
+ {%- endfor %}
64
+ {{- first_user_message + "<|eot_id|>"}}
65
+ {%- endif %}
66
+
67
+ {%- for message in messages %}
68
+ {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}
69
+ {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}
70
+ {%- elif 'tool_calls' in message %}
71
+ {%- if not message.tool_calls|length == 1 %}
72
+ {{- raise_exception("This model only supports single tool-calls at once!") }}
73
+ {%- endif %}
74
+ {%- set tool_call = message.tool_calls[0].function %}
75
+ {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}
76
+ {{- '{"name": "' + tool_call.name + '", ' }}
77
+ {{- '"parameters": ' }}
78
+ {{- tool_call.arguments | tojson }}
79
+ {{- "}" }}
80
+ {{- "<|eot_id|>" }}
81
+ {%- elif message.role == "tool" or message.role == "ipython" %}
82
+ {{- "<|start_header_id|>ipython<|end_header_id|>\n\n" }}
83
+ {%- if message.content is mapping or message.content is iterable %}
84
+ {{- message.content | tojson }}
85
+ {%- else %}
86
+ {{- message.content }}
87
+ {%- endif %}
88
+ {{- "<|eot_id|>" }}
89
+ {%- endif %}
90
+ {%- endfor %}
91
+ {%- if add_generation_prompt %}
92
+ {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
93
+ {%- endif %}
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
3
+ size 17209920
v2.0/llama3.2-1b_AdaLoRA_B_1k_20260827-180231/tokenizer_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "backend": "tokenizers",
3
+ "bos_token": "<|begin_of_text|>",
4
+ "clean_up_tokenization_spaces": true,
5
+ "eos_token": "<|eot_id|>",
6
+ "is_local": false,
7
+ "local_files_only": false,
8
+ "model_input_names": [
9
+ "input_ids",
10
+ "attention_mask"
11
+ ],
12
+ "model_max_length": 131072,
13
+ "pad_token": "<|eot_id|>",
14
+ "tokenizer_class": "TokenizersBackend"
15
+ }