Spaces:
Sleeping
Sleeping
Commit History
-
feat: strengthen all detectors and simplify to Indonesia-only
Word Quality - Add _TECH_WHITELIST with 100+ technical/library/algorithm terms to avoid typo false positives - Expand l33tspeak cap from 15 to 25 characters; add SymSpell fallback for long words like "m3ng1mpl3mntasikan" - Pattern 5: detect Jakarta/Betawi -in suffix forms ("nemenin", "bacain") as SLANG, not TYPO - Context-aware reclassification: TYPO confidence < 0.82 becomes SLANG when the sentence contains >= 2 other informal words - Fix _language_for_token: use cross-language frequency comparison with a 10x threshold instead of immediately falling back to the default - Add 16 -in suffix entries to slang_id.tsv - Remove English SymSpell dictionary (_SYMSPELL_DICT_CACHE_EN) Profanity & Responsible - Move English profanity from _BUILTIN_HIGH/_BUILTIN_MEDIUM to _ENGLISH_PROFANITY_BLOCKLIST so it is not shown as a badge - Add "speda" (informal "sepeda") to the whitelist so it is not flagged as profanity - Responsible K1: add 7 self-harm patterns (Indonesian + English) as H…aa16b4b
-
Initial commit
ea3fcbe