Upload README.md with huggingface_hub

README.md

@@ -173,6 +173,50 @@ The stage-by-stage path: 20/23 → 22/23 → 23/23 → 23/23, token accuracy 99.
 
 ---
 
+## Known weakness — stated openly
+
+One Bosnian phrasing stays broken in the shipped build:
+
+| Question | Adapter (bf16) | Delivered Q8_0 | Delivered Q6_K |
+|---|---|---|---|
+| *"Mogu li koristiti OpenAmer bez interneta?"* | correct | `Nein. OpenAmer radi lokal, bezieta samo ako stvaraju dionice.` | `Ne. Obrada i zaposleni se OpenAmer ne radi na tvom računaru.` |
+
+Two quantisations, two different corruptions of the same sentence. That is capacity, not
+configuration: 0.6B cannot hold free-form Bosnian reliably, and the same question is
+answered correctly by the 3B and 7.62B tiers. Every other Bosnian probe is clean.
+
+A lower `repeat_penalty` did not help here (it did fix a negation in the 3B tier) — see
+below. If Bosnian matters for your use case, take `OpenAmer-Max-Phone` instead.
+
+---
+
+## How this was measured — and five times the *test* was wrong, not the model
+
+Every published number has a script behind it. When a score dropped, the first question was
+always: "is my checker able to accept the correct answer at all?"
+
+1. **AND vs OR in keyword checks.** `contains("a","b","c")` fails an answer that has two of
+   three correct synonyms. Synonym groups need an OR-checker.
+2. **A rejection counted as a violation.** A safety question was answered with *"I won't give
+   instructions for that"*; the checker searched for the word "Anleitung" and marked the
+   refusal as a breach.
+3. **Diacritics counted as wrong language.** Correct Bosnian was scored as language drift
+   because `č/ć/š/ž/đ` were missing from the normalisation table.
+4. **A forbidden phrase that also appears in the *correct* answer.** *"Nein. OpenAmer kann
+   Musik **nicht** erzeugen"* was rejected because the forbid list contained `"kann musik"`.
+   Forbid entries must describe the false claim (`"ja, openamer kann musik"`), not a word that
+   occurs in a right answer.
+5. **An inverted polarity scored as correct.** *"Šta OpenAmer ne može?"* answered with
+   *"Ne radi na Androidu"* passed, because only the presence of `"ne radi"` was required — the
+   answer was factually inverted. Negations must be checked for *which* object they negate.
+
+**A sixth lesson, from the 3B tier:** `repeat_penalty 1.1` in the Ollama Modelfile flipped a
+negation from *"does not run on iPhone"* to *"does not run on Android"*. The adapter, the
+merged model and the same model with a system prompt all answered correctly — only the build
+with the token penalty failed. All cards now ship `repeat_penalty 1.0`.
+
+---
+
 ## Files
 
 | File | Size | Notes |