Instructions to use properexit/ArgParser-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use properexit/ArgParser-v2 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct") model = PeftModel.from_pretrained(base_model, "properexit/ArgParser-v2") - Notebooks
- Google Colab
- Kaggle
Update README
Browse files
README.md
CHANGED
|
@@ -2,23 +2,45 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: Qwen/Qwen2.5-1.5B-Instruct
|
| 4 |
library_name: peft
|
| 5 |
-
tags:
|
| 6 |
-
- argument-mining
|
| 7 |
-
- fact-checking
|
| 8 |
-
- lora
|
| 9 |
-
- qwen
|
| 10 |
language: [en]
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
---
|
| 13 |
|
| 14 |
-
#
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
- Base: `Qwen/Qwen2.5-1.5B-Instruct`
|
| 21 |
-
- Method: LoRA r=16
|
| 22 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
-
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
base_model: Qwen/Qwen2.5-1.5B-Instruct
|
| 4 |
library_name: peft
|
| 5 |
+
tags: [argument-mining, fact-checking, lora, qwen]
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
language: [en]
|
| 7 |
pipeline_tag: text-generation
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# ArgParser-v2
|
| 11 |
|
| 12 |
+
Same training data as v1 (four argument-mining corpora, 1,494 records)
|
| 13 |
+
but a larger base and LoRA instead of full fine-tune. Qwen-1.5B with
|
| 14 |
+
LoRA r=16 (α=32, dropout 0.05, target `q_proj,k_proj,v_proj,o_proj`).
|
| 15 |
+
3 epochs, about 13.5 hours on a GTX 1080 Ti.
|
| 16 |
|
| 17 |
+
Held-out component-F1: **0.219** — roughly double v1. Microtext premise
|
| 18 |
+
F1 went from 0.000 to 0.680. AbstRCT empty rate 75% → 50%. Scale plus
|
| 19 |
+
LoRA plus longer training context are the dominant levers, and this
|
| 20 |
+
was the run that made that obvious.
|
| 21 |
+
|
| 22 |
+
Not the best model in the series. For actual use pick
|
| 23 |
+
[ArgParser-v4](https://huggingface.co/properexit/ArgParser-v4) instead — it adds cross-domain transfer to
|
| 24 |
+
LIARArg-style political claims, which is what most people probably
|
| 25 |
+
care about.
|
| 26 |
+
|
| 27 |
+
## Config
|
| 28 |
|
| 29 |
- Base: `Qwen/Qwen2.5-1.5B-Instruct`
|
| 30 |
+
- Method: LoRA r=16 (4.4M trainable params)
|
| 31 |
+
- Data: 4 gold corpora, 1,494 records
|
| 32 |
+
- Epochs: 3
|
| 33 |
+
- Wall clock: 13.5 h
|
| 34 |
+
|
| 35 |
+
## Usage
|
| 36 |
+
|
| 37 |
+
```python
|
| 38 |
+
from peft import PeftModel
|
| 39 |
+
from transformers import AutoModelForCausalLM
|
| 40 |
+
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct")
|
| 41 |
+
model = PeftModel.from_pretrained(base, "properexit/ArgParser-v2")
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## License
|
| 45 |
|
| 46 |
+
Apache 2.0.
|