Text Generation
PEFT
PyTorch
English
llama
lonestar108 commited on
Commit
9ef71c3
·
1 Parent(s): ab2f533

Upload model

Browse files
Files changed (2) hide show
  1. README.md +61 -9
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -1,13 +1,5 @@
1
  ---
2
  library_name: peft
3
- license: openrail
4
- datasets:
5
- - lonestar108/plenumvideos
6
- language:
7
- - en
8
- metrics:
9
- - accuracy
10
- pipeline_tag: text-generation
11
  ---
12
  ## Training procedure
13
 
@@ -23,6 +15,66 @@ The following `bitsandbytes` quantization config was used during training:
23
  - bnb_4bit_use_double_quant: False
24
  - bnb_4bit_compute_dtype: float16
25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
  ### Framework versions
27
 
28
- - PEFT 0.4.0
 
 
 
 
 
 
 
1
  ---
2
  library_name: peft
 
 
 
 
 
 
 
 
3
  ---
4
  ## Training procedure
5
 
 
15
  - bnb_4bit_use_double_quant: False
16
  - bnb_4bit_compute_dtype: float16
17
 
18
+ The following `bitsandbytes` quantization config was used during training:
19
+ - load_in_8bit: False
20
+ - load_in_4bit: True
21
+ - llm_int8_threshold: 6.0
22
+ - llm_int8_skip_modules: None
23
+ - llm_int8_enable_fp32_cpu_offload: False
24
+ - llm_int8_has_fp16_weight: False
25
+ - bnb_4bit_quant_type: nf4
26
+ - bnb_4bit_use_double_quant: False
27
+ - bnb_4bit_compute_dtype: float16
28
+
29
+ The following `bitsandbytes` quantization config was used during training:
30
+ - load_in_8bit: False
31
+ - load_in_4bit: True
32
+ - llm_int8_threshold: 6.0
33
+ - llm_int8_skip_modules: None
34
+ - llm_int8_enable_fp32_cpu_offload: False
35
+ - llm_int8_has_fp16_weight: False
36
+ - bnb_4bit_quant_type: nf4
37
+ - bnb_4bit_use_double_quant: False
38
+ - bnb_4bit_compute_dtype: float16
39
+
40
+ The following `bitsandbytes` quantization config was used during training:
41
+ - load_in_8bit: False
42
+ - load_in_4bit: True
43
+ - llm_int8_threshold: 6.0
44
+ - llm_int8_skip_modules: None
45
+ - llm_int8_enable_fp32_cpu_offload: False
46
+ - llm_int8_has_fp16_weight: False
47
+ - bnb_4bit_quant_type: nf4
48
+ - bnb_4bit_use_double_quant: False
49
+ - bnb_4bit_compute_dtype: float16
50
+
51
+ The following `bitsandbytes` quantization config was used during training:
52
+ - load_in_8bit: False
53
+ - load_in_4bit: True
54
+ - llm_int8_threshold: 6.0
55
+ - llm_int8_skip_modules: None
56
+ - llm_int8_enable_fp32_cpu_offload: False
57
+ - llm_int8_has_fp16_weight: False
58
+ - bnb_4bit_quant_type: nf4
59
+ - bnb_4bit_use_double_quant: False
60
+ - bnb_4bit_compute_dtype: float16
61
+
62
+ The following `bitsandbytes` quantization config was used during training:
63
+ - load_in_8bit: False
64
+ - load_in_4bit: True
65
+ - llm_int8_threshold: 6.0
66
+ - llm_int8_skip_modules: None
67
+ - llm_int8_enable_fp32_cpu_offload: False
68
+ - llm_int8_has_fp16_weight: False
69
+ - bnb_4bit_quant_type: nf4
70
+ - bnb_4bit_use_double_quant: False
71
+ - bnb_4bit_compute_dtype: float16
72
  ### Framework versions
73
 
74
+ - PEFT 0.4.0
75
+ - PEFT 0.4.0
76
+ - PEFT 0.4.0
77
+ - PEFT 0.4.0
78
+ - PEFT 0.4.0
79
+
80
+ - PEFT 0.4.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4edf1f60264d5b162991496b39f1e6c9a02b6ba320933bcec9fba76df43d68f
3
  size 134263757
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a3ac971847746f51aa3fe821728819183f3362fd3bc4e99ac23d3c646eb82cd
3
  size 134263757