Spencer Norton commited on
Commit
449fef6
·
verified ·
1 Parent(s): 8b28ffd

Update categorical breakdown chart and Hard Edge-Case accuracy table

Browse files
README.md CHANGED
@@ -93,16 +93,16 @@ Unlike rule parsers (`GuessIt`, `PTT`, `RTN`, `PTN`, `Anitomy`) that only recogn
93
 
94
  | Content Category | Gold Standard (`N=2,835`) Armiger Ultra | Gold Standard (`N=2,835`) Armiger | Gold Standard MIMMO BERT (360M) | Gold Standard Bitmagnet Built-In | Hard Edge-Cases (`N=1,025`) Armiger Ultra | Hard Edge-Cases (`N=1,025`) Armiger | Hard Edge-Cases OpenAI GPT (`gpt-6-luna`) | Hard Edge-Cases Google Gemini (`gemini-3.8-flash-low`) |
95
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
96
- | **Adult / XXX** | **`99.62%`** | `99.43%` | `95.50%` | `39.37%` | `97.55%` | `96.93%` | `97.70%` | **`98.85%`** |
97
- | **Movie** | **`99.13%`** | `98.70%` | `78.85%` | `55.83%` | **`96.97%`** | `93.94%` | `95.79%` | `95.79%` |
98
  | **Audiobook** | **`98.97%`** | `97.94%` | `0.00%` | `9.47%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | `98.67%` |
99
- | **TV Show** | **`98.69%`** | `98.36%` | `58.40%` | `28.62%` | `91.24%` | `90.51%` | **`99.26%`** | `95.59%` |
100
- | **Software** | **`96.88%`** | **`96.88%`** | `59.38%` | `15.62%` | **`97.50%`** | **`97.50%`** | `97.30%` | `78.38%` |
101
- | **Game** | **`96.77%`** | `93.55%` | `0.00%` | `0.00%` | `98.51%` | `97.76%` | **`99.26%`** | **`99.26%`** |
102
- | **Comic** | **`96.30%`** | `88.89%` | `0.00%` | `0.00%` | `96.80%` | `96.00%` | **`99.17%`** | `95.83%` |
103
  | **Ebook** | **`95.83%`** | `91.67%` | `80.00%` | `4.00%` | `98.40%` | `98.40%` | `96.80%` | **`99.20%`** |
104
  | **Music** | **`94.41%`** | `93.01%` | `77.86%` | `7.86%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** |
105
- | **Course** | **`93.75%`** | **`93.75%`** | `0.00%` | `0.00%` | `94.90%` | `93.88%` | `96.00%` | **`99.00%`** |
106
 
107
  ---
108
 
 
93
 
94
  | Content Category | Gold Standard (`N=2,835`) Armiger Ultra | Gold Standard (`N=2,835`) Armiger | Gold Standard MIMMO BERT (360M) | Gold Standard Bitmagnet Built-In | Hard Edge-Cases (`N=1,025`) Armiger Ultra | Hard Edge-Cases (`N=1,025`) Armiger | Hard Edge-Cases OpenAI GPT (`gpt-6-luna`) | Hard Edge-Cases Google Gemini (`gemini-3.8-flash-low`) |
95
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
96
+ | **Adult / XXX** | **`99.62%`** | `99.43%` | `95.50%` | `39.37%` | **`100.00%`** | `99.39%` | `97.70%` | `98.85%` |
97
+ | **Movie** | **`99.13%`** | `98.70%` | `78.85%` | `55.83%` | **`100.00%`** | `96.97%` | `95.79%` | `95.79%` |
98
  | **Audiobook** | **`98.97%`** | `97.94%` | `0.00%` | `9.47%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | `98.67%` |
99
+ | **TV Show** | **`98.69%`** | `98.36%` | `58.40%` | `28.62%` | **`99.27%`** | **`99.27%`** | `99.26%` | `95.59%` |
100
+ | **Software** | **`96.88%`** | **`96.88%`** | `59.38%` | `15.62%` | **`100.00%`** | `97.62%` | `97.30%` | `78.38%` |
101
+ | **Game** | **`96.77%`** | `93.55%` | `0.00%` | `0.00%` | **`100.00%`** | `99.26%` | `99.26%` | `99.26%` |
102
+ | **Comic** | **`96.30%`** | `88.89%` | `0.00%` | `0.00%` | **`99.20%`** | `98.40%` | `99.17%` | `95.83%` |
103
  | **Ebook** | **`95.83%`** | `91.67%` | `80.00%` | `4.00%` | `98.40%` | `98.40%` | `96.80%` | **`99.20%`** |
104
  | **Music** | **`94.41%`** | `93.01%` | `77.86%` | `7.86%` | **`100.00%`** | **`100.00%`** | **`100.00%`** | **`100.00%`** |
105
+ | **Course** | **`93.75%`** | **`93.75%`** | `0.00%` | `0.00%` | **`100.00%`** | `97.89%` | `96.00%` | `99.00%` |
106
 
107
  ---
108
 
assets/armiger_categorical_breakdown.png CHANGED

Git LFS Details

  • SHA256: d5beb5204ade5bf2358f886000879fb4214089c0e39e47fa7834b7a77bfdddde
  • Pointer size: 131 Bytes
  • Size of remote file: 645 kB

Git LFS Details

  • SHA256: e41c41a05870a5db4e106c4cd3c73dabbda7d38fdfa29ffb7679bcf46f319a6b
  • Pointer size: 131 Bytes
  • Size of remote file: 654 kB