Model card: link to the Turkish Decision Benchmark dataset
Browse files
README.md
CHANGED
|
@@ -42,7 +42,7 @@ and are never used as training labels.
|
|
| 42 |
|---|---|---|---|
|
| 43 |
| Real customer messages (500 held-out, licensed) | 4,500 | 77.4 | **85.6** |
|
| 44 |
| Long customer complaints (500 held-out, licensed) | 4,500 | 81.4 | **88.0** |
|
| 45 |
-
| Turkish Decision Benchmark (2,194 messages) | 19,861 | 88.5 | **92.6** |
|
| 46 |
| Gold test set (759 held-out messages) | 7,015 | 85.5 | **90.4** |
|
| 47 |
| Your own questions (497 messages × 3 ad-hoc questions) | 1,491 | **94.8** | 94.2 |
|
| 48 |
| MASSIVE tr-TR, 60-way intent, zero-shot (human-written Turkish) | 2,974 | **85.3** | 85.2 |
|
|
|
|
| 42 |
|---|---|---|---|
|
| 43 |
| Real customer messages (500 held-out, licensed) | 4,500 | 77.4 | **85.6** |
|
| 44 |
| Long customer complaints (500 held-out, licensed) | 4,500 | 81.4 | **88.0** |
|
| 45 |
+
| [Turkish Decision Benchmark](https://huggingface.co/datasets/hsnsahinhsn/turkish-decision-benchmark) (2,194 messages) | 19,861 | 88.5 | **92.6** |
|
| 46 |
| Gold test set (759 held-out messages) | 7,015 | 85.5 | **90.4** |
|
| 47 |
| Your own questions (497 messages × 3 ad-hoc questions) | 1,491 | **94.8** | 94.2 |
|
| 48 |
| MASSIVE tr-TR, 60-way intent, zero-shot (human-written Turkish) | 2,974 | **85.3** | 85.2 |
|