cbert33 commited on
Commit
5f284d3
·
verified ·
1 Parent(s): 9ac1506

Use the original LiquidAI baseline and the final census in the JSON table

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -51,10 +51,14 @@ This is a weight-edited version of [LiquidAI/LFM3-1.7B](https://huggingface.co/L
51
 
52
  | Metric | Baseline | Final | Delta |
53
  |---|---:|---:|---:|
54
- | pure JSON | 86.0% | 88.0% | +2.0 pts |
55
- | parseable | 88.0% | 88.0% | 0.0 pts |
56
- | malformed | 10.0% | 12.0% | +2.0 pts |
57
- | mean gen tokens | 2238 | 1951 | -12.8% |
 
 
 
 
58
 
59
  ## Looping behavior
60
 
@@ -72,7 +76,6 @@ This is a weight-edited version of [LiquidAI/LFM3-1.7B](https://huggingface.co/L
72
  | Metric | Baseline | Final | Delta |
73
  |---|---:|---:|---:|
74
  | ramble rate | 72.0% | 64.0% | -8.0 pts |
75
- | median narration words | 693 | 508 | -185 |
76
  | mean gen tokens | 2238 | 1951 | -12.8% |
77
 
78
  ## Files and reproducibility
 
51
 
52
  | Metric | Baseline | Final | Delta |
53
  |---|---:|---:|---:|
54
+ | pure JSON | 42.0% | 88.0% | +46.0 pts |
55
+ | pure antml | 20.0% | 0.0% | -20.0 pts |
56
+ | mixed | 26.7% | 0.0% | -26.7 pts |
57
+ | neither | 11.3% | 12.0% | +0.7 pts |
58
+ | parseable | 68.7% | 88.0% | +19.3 pts |
59
+ | antml present | 46.7% | 0.0% | -46.7 pts |
60
+ | mean gen tokens | 2008 | 1951 | -2.8% |
61
+ | prompts with >=1 parseable | 84% | 88% | +4 pts |
62
 
63
  ## Looping behavior
64
 
 
76
  | Metric | Baseline | Final | Delta |
77
  |---|---:|---:|---:|
78
  | ramble rate | 72.0% | 64.0% | -8.0 pts |
 
79
  | mean gen tokens | 2238 | 1951 | -12.8% |
80
 
81
  ## Files and reproducibility