Hugging Face's logo

moneim
/
models-moved

Text Generation
Transformers
PyTorch
llama
Generated from Trainer
text-generation-inference
Model card Files
xet
 Community
1
moneim commited on
Commit
f399f30
·
1 Parent(s): 1b08350

moneim/fine-tuned

Browse files
Files changed (3) hide show
  1. README.md +13 -0
  2. adapter_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -5,6 +5,7 @@ tags:
5
  model-index:
6
  - name: models
7
  results: []
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -28,6 +29,17 @@ More information needed
28
 
29
  ## Training procedure
30
 
 
 
 
 
 
 
 
 
 
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
@@ -48,6 +60,7 @@ The following hyperparameters were used during training:
48
 
49
  ### Framework versions
50
 
 
51
  - Transformers 4.31.0
52
  - Pytorch 2.2.0+cu121
53
  - Datasets 2.18.0
 
5
  model-index:
6
  - name: models
7
  results: []
8
+ library_name: peft
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
29
 
30
  ## Training procedure
31
 
32
+
33
+ The following `bitsandbytes` quantization config was used during training:
34
+ - load_in_8bit: False
35
+ - load_in_4bit: True
36
+ - llm_int8_threshold: 6.0
37
+ - llm_int8_skip_modules: None
38
+ - llm_int8_enable_fp32_cpu_offload: False
39
+ - llm_int8_has_fp16_weight: False
40
+ - bnb_4bit_quant_type: nf4
41
+ - bnb_4bit_use_double_quant: False
42
+ - bnb_4bit_compute_dtype: float16
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
 
60
 
61
  ### Framework versions
62
 
63
+ - PEFT 0.4.0
64
  - Transformers 4.31.0
65
  - Pytorch 2.2.0+cu121
66
  - Datasets 2.18.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9b1190125de0429e9dfa574b2607b17f5713cd62c45acebefcd3a4d5b87ef85
3
  size 104915722
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75e2b563dc8d975726d816211cbd339799530f463165b155480c166c7dd64970
3
  size 104915722
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4ee2d07a3ae6a78947dbf383561a4f3ca9f4446c75eefca7492fb2741d65191
3
  size 4408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f7cb7c7075d231f31f99ee6f98e03e86f99f0fd56a20cf948896f2effc4660a
3
  size 4408