properexit commited on
Commit
15c5cd3
·
verified ·
1 Parent(s): 1b240cd

Update README

Browse files
Files changed (1) hide show
  1. README.md +33 -11
README.md CHANGED
@@ -2,23 +2,45 @@
2
  license: apache-2.0
3
  base_model: Qwen/Qwen2.5-1.5B-Instruct
4
  library_name: peft
5
- tags:
6
- - argument-mining
7
- - fact-checking
8
- - lora
9
- - qwen
10
  language: [en]
11
  pipeline_tag: text-generation
12
  ---
13
 
14
- # ArgRAG argrag-phase2beta-v2
15
 
16
- **Placeholder — full model card coming.**
 
 
 
17
 
18
- v2: LoRA r=16 on 4 gold corpora (AAEC/AbstRCT/CDCP/PERSPECTRUM/Microtext), fresh
 
 
 
 
 
 
 
 
 
 
19
 
20
  - Base: `Qwen/Qwen2.5-1.5B-Instruct`
21
- - Method: LoRA r=16, alpha=32, target `q_proj,k_proj,v_proj,o_proj`
22
- - Repository: (link to be added)
 
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
- Detailed evaluation, usage, and limitations to be added.
 
2
  license: apache-2.0
3
  base_model: Qwen/Qwen2.5-1.5B-Instruct
4
  library_name: peft
5
+ tags: [argument-mining, fact-checking, lora, qwen]
 
 
 
 
6
  language: [en]
7
  pipeline_tag: text-generation
8
  ---
9
 
10
+ # ArgParser-v2
11
 
12
+ Same training data as v1 (four argument-mining corpora, 1,494 records)
13
+ but a larger base and LoRA instead of full fine-tune. Qwen-1.5B with
14
+ LoRA r=16 (α=32, dropout 0.05, target `q_proj,k_proj,v_proj,o_proj`).
15
+ 3 epochs, about 13.5 hours on a GTX 1080 Ti.
16
 
17
+ Held-out component-F1: **0.219** — roughly double v1. Microtext premise
18
+ F1 went from 0.000 to 0.680. AbstRCT empty rate 75% → 50%. Scale plus
19
+ LoRA plus longer training context are the dominant levers, and this
20
+ was the run that made that obvious.
21
+
22
+ Not the best model in the series. For actual use pick
23
+ [ArgParser-v4](https://huggingface.co/properexit/ArgParser-v4) instead — it adds cross-domain transfer to
24
+ LIARArg-style political claims, which is what most people probably
25
+ care about.
26
+
27
+ ## Config
28
 
29
  - Base: `Qwen/Qwen2.5-1.5B-Instruct`
30
+ - Method: LoRA r=16 (4.4M trainable params)
31
+ - Data: 4 gold corpora, 1,494 records
32
+ - Epochs: 3
33
+ - Wall clock: 13.5 h
34
+
35
+ ## Usage
36
+
37
+ ```python
38
+ from peft import PeftModel
39
+ from transformers import AutoModelForCausalLM
40
+ base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct")
41
+ model = PeftModel.from_pretrained(base, "properexit/ArgParser-v2")
42
+ ```
43
+
44
+ ## License
45
 
46
+ Apache 2.0.