| ================================================================================ |
| 🏛️ LEGAL-BERT EVALUATION REPORT |
| ================================================================================ |
|
|
| 📊 RISK CLASSIFICATION PERFORMANCE |
| -------------------------------------------------- |
| Accuracy: 0.7803 |
| Precision: 0.7871 |
| Recall: 0.7803 |
| F1-Score: 0.7816 |
| Average Confidence: 0.7772 |
|
|
| 📈 REGRESSION PERFORMANCE |
| -------------------------------------------------- |
| Severity Prediction: |
| MSE: 1.2372 |
| MAE: 0.6903 |
| R²: 0.7388 |
| Importance Prediction: |
| MSE: 0.8753 |
| MAE: 0.4454 |
| R²: 0.9423 |
|
|
| 🔍 DISCOVERED RISK PATTERNS |
| -------------------------------------------------- |
| Pattern Distribution (True vs Predicted): |
| 2: 244 → 279 |
| 6: 248 → 223 |
| 5: 457 → 441 |
| 4: 574 → 552 |
| 1: 579 → 580 |
| 0: 534 → 491 |
| 3: 172 → 242 |
|
|
| Pattern-Specific Performance: |
| 0: |
| Precision: 0.7658 |
| Recall: 0.7041 |
| F1-Score: 0.7337 |
| Support: 534 |
| 1: |
| Precision: 0.7655 |
| Recall: 0.7668 |
| F1-Score: 0.7662 |
| Support: 579 |
| 2: |
| Precision: 0.6882 |
| Recall: 0.7869 |
| F1-Score: 0.7342 |
| Support: 244 |
| 3: |
| Precision: 0.6157 |
| Recall: 0.8663 |
| F1-Score: 0.7198 |
| Support: 172 |
| 4: |
| Precision: 0.8967 |
| Recall: 0.8624 |
| F1-Score: 0.8792 |
| Support: 574 |
| 5: |
| Precision: 0.7596 |
| Recall: 0.7330 |
| F1-Score: 0.7461 |
| Support: 457 |
| 6: |
| Precision: 0.8969 |
| Recall: 0.8065 |
| F1-Score: 0.8493 |
| Support: 248 |
|
|
| 🎯 DISCOVERED PATTERN DETAILS |
| -------------------------------------------------- |
|
|
| 0: |
| Clauses: 1428 |
| Top Words: use, license, non, exclusive, grants |
|
|
| 1: |
| Clauses: 2084 |
| Top Words: shall, insurance, product, 000, reasonable |
|
|
| 2: |
| Clauses: 1082 |
| Top Words: party, agreement, shall, consent, written |
|
|
| 3: |
| Clauses: 870 |
| Top Words: party, damages, agreement, section, shall |
|
|
| 4: |
| Clauses: 2033 |
| Top Words: agreement, shall, term, date, termination |
|
|
| 5: |
| Clauses: 1331 |
| Top Words: company, product, shall, products, use |
|
|
| 6: |
| Clauses: 1026 |
| Top Words: agreement, laws, shall, state, governed |
|
|
| ================================================================================ |
