Spencer Norton commited on
Update categorical breakdown chart and Hard Edge-Case accuracy table
Browse files- README.md +7 -7
- assets/armiger_categorical_breakdown.png +2 -2
README.md
CHANGED
|
@@ -93,16 +93,16 @@ Unlike rule parsers (`GuessIt`, `PTT`, `RTN`, `PTN`, `Anitomy`) that only recogn
|
|
| 93 |
|
| 94 |
| Content Category | Gold Standard (`N=2,835`) Armiger Ultra | Gold Standard (`N=2,835`) Armiger | Gold Standard MIMMO BERT (360M) | Gold Standard Bitmagnet Built-In | Hard Edge-Cases (`N=1,025`) Armiger Ultra | Hard Edge-Cases (`N=1,025`) Armiger | Hard Edge-Cases OpenAI GPT (`gpt-6-luna`) | Hard Edge-Cases Google Gemini (`gemini-3.8-flash-low`) |
|
| 95 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 96 |
-
| **Adult / XXX** | **`99.62%`** | `99.43%` | `95.50%` | `39.37%` | `
|
| 97 |
-
| **Movie** | **`99.13%`** | `98.70%` | `78.85%` | `55.83%` | **`
|
| 98 |
| **Audiobook** | **`98.97%`** | `97.94%` | `0.00%` | `9.47%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | `98.67%` |
|
| 99 |
-
| **TV Show** | **`98.69%`** | `98.36%` | `58.40%` | `28.62%` | `
|
| 100 |
-
| **Software** | **`96.88%`** | **`96.88%`** | `59.38%` | `15.62%` | **`
|
| 101 |
-
| **Game** | **`96.77%`** | `93.55%` | `0.00%` | `0.00%` | `
|
| 102 |
-
| **Comic** | **`96.30%`** | `88.89%` | `0.00%` | `0.00%` | `
|
| 103 |
| **Ebook** | **`95.83%`** | `91.67%` | `80.00%` | `4.00%` | `98.40%` | `98.40%` | `96.80%` | **`99.20%`** |
|
| 104 |
| **Music** | **`94.41%`** | `93.01%` | `77.86%` | `7.86%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** |
|
| 105 |
-
| **Course** | **`93.75%`** | **`93.75%`** | `0.00%` | `0.00%` | `
|
| 106 |
|
| 107 |
---
|
| 108 |
|
|
|
|
| 93 |
|
| 94 |
| Content Category | Gold Standard (`N=2,835`) Armiger Ultra | Gold Standard (`N=2,835`) Armiger | Gold Standard MIMMO BERT (360M) | Gold Standard Bitmagnet Built-In | Hard Edge-Cases (`N=1,025`) Armiger Ultra | Hard Edge-Cases (`N=1,025`) Armiger | Hard Edge-Cases OpenAI GPT (`gpt-6-luna`) | Hard Edge-Cases Google Gemini (`gemini-3.8-flash-low`) |
|
| 95 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 96 |
+
| **Adult / XXX** | **`99.62%`** | `99.43%` | `95.50%` | `39.37%` | **`100.00%`** | `99.39%` | `97.70%` | `98.85%` |
|
| 97 |
+
| **Movie** | **`99.13%`** | `98.70%` | `78.85%` | `55.83%` | **`100.00%`** | `96.97%` | `95.79%` | `95.79%` |
|
| 98 |
| **Audiobook** | **`98.97%`** | `97.94%` | `0.00%` | `9.47%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | `98.67%` |
|
| 99 |
+
| **TV Show** | **`98.69%`** | `98.36%` | `58.40%` | `28.62%` | **`99.27%`** | **`99.27%`** | `99.26%` | `95.59%` |
|
| 100 |
+
| **Software** | **`96.88%`** | **`96.88%`** | `59.38%` | `15.62%` | **`100.00%`** | `97.62%` | `97.30%` | `78.38%` |
|
| 101 |
+
| **Game** | **`96.77%`** | `93.55%` | `0.00%` | `0.00%` | **`100.00%`** | `99.26%` | `99.26%` | `99.26%` |
|
| 102 |
+
| **Comic** | **`96.30%`** | `88.89%` | `0.00%` | `0.00%` | **`99.20%`** | `98.40%` | `99.17%` | `95.83%` |
|
| 103 |
| **Ebook** | **`95.83%`** | `91.67%` | `80.00%` | `4.00%` | `98.40%` | `98.40%` | `96.80%` | **`99.20%`** |
|
| 104 |
| **Music** | **`94.41%`** | `93.01%` | `77.86%` | `7.86%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** |
|
| 105 |
+
| **Course** | **`93.75%`** | **`93.75%`** | `0.00%` | `0.00%` | **`100.00%`** | `97.89%` | `96.00%` | `99.00%` |
|
| 106 |
|
| 107 |
---
|
| 108 |
|
assets/armiger_categorical_breakdown.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|