Spaces:
Running
Running
Commit History
-
refactor(core): decouple logic from entrypoint and harden local slm constraints
- Extract LLM provider tiering, prompting, and retry logic from app.py into dedicated scripts/ modules. - Implement strict LlamaGrammar enforcement for Qwen2.5-3B local tier to eliminate JSON malformations. - Introduce validation+repair loop catching taboo constraints, word-count limits, and CTA proliferation. - Introduce dynamic budget checks for cloud-tier retries to prevent local starvation. - Fix FEW_SHOT_EXAMPLES substring-matching issue to correctly map all data triggers. - Restore TRIGGER PRIMACY in the local system prompt and configure local temperature (0.2) for optimal variance vs grounding. - Polish README and architecture documentation.c1c5ecb
-
feat: implement 4-tier LLM fail-fast cascade & benchmark-based local 3B selection
e67482e