Safetensors
English
Portuguese
legal
wandemberg-eld commited on
Commit
bb0f109
·
verified ·
1 Parent(s): 8cbff98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -3
README.md CHANGED
@@ -1,3 +1,51 @@
1
- ---
2
- license: llama3
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3
3
+ datasets:
4
+ - ai-eldorado/Brazilian_CLT_preferences
5
+ language:
6
+ - en
7
+ - pt
8
+ base_model:
9
+ - meta-llama/Llama-3.1-8B-Instruct
10
+ tags:
11
+ - legal
12
+ ---
13
+
14
+ ### ✅ **Model Card for `ai-eldorado/Brazilian_CLT_lora`**
15
+ **Model Description**
16
+ This repository provides a **LoRA adapter** trained on the same human-preference dataset used for the DPO model. It enables efficient fine-tuning of **LLaMA-3 8B Instruct (4-bit)** for Brazilian labor law applications without requiring full model retraining.
17
+
18
+ **Intended Use**
19
+ The LoRA adapter is intended for developers and researchers who want to **adapt LLaMA-3 models for CLT-related tasks** while minimizing computational costs. It is particularly useful for **resource-constrained environments** or for integrating into **multi-agent legal assistant systems**.
20
+
21
+ **Training Details**
22
+ - **Base Model:** LLaMA-3 8B (4-bit quantized)
23
+ - **Method:** LoRA fine-tuning with DPO-aligned dataset
24
+ - **Dataset:** 736 human-preference entries on CLT-related questions
25
+ - **Hyperparameters:** Same as the DPO model
26
+
27
+ **Performance Summary**
28
+ When merged with the base model, the LoRA adapter reproduces the improvements observed in the full DPO model:
29
+ - Increased factual accuracy
30
+ - Better semantic alignment with CLT regulations
31
+
32
+
33
+ #### **Ethical Considerations**
34
+ - **Legal Disclaimer:** Not a substitute for professional legal advice.
35
+ - **Risk of Misuse:** Incorrect merging or use outside intended domain may lead to inaccurate outputs.
36
+ - **Data Privacy:** No personal data was used in training.
37
+
38
+
39
+ #### **Bias and Fairness**
40
+ - Same considerations as the DPO model:
41
+ - Regional and interpretation biases may exist.
42
+ - Limited dataset size could affect fairness in edge cases.
43
+
44
+
45
+ #### **Limitations**
46
+ - Requires merging with the base LLaMA-3 model for inference.
47
+ - Domain-specific; not suitable for general-purpose legal reasoning.
48
+
49
+
50
+ #### **Citation**
51
+ soon