Spaces:
Sleeping
Sleeping
Commit History
-
feat: ingestion fix
70bc888
-
feat(bots): upgrade ingestion engine to v4.0 multi-source architecture
632e615 -
fix(bots): rewrite all 5 broken bots to World No. 1 standard
BOT #02 — DATA INGESTION (ingest_tor_stealth.py): - CRITICAL: Was writing hardcoded placeholder text for benefits/eligibility - Now navigates to DETAIL PAGES to scrape REAL data - NEVER overwrites AI-enriched records (checks is_verified flag) - Expanded from 5 to 12 categories - Multiple CSS selector fallbacks for resilience - Full audit logging to bot_run_log table BOT #03 — LINK HEALTH (change_detector.py): - Was silently mass-deactivating schemes during site outages - Added safety cap: max 5 deactivations per run - Added outage detection: >50% failure = skip all deactivations - Batched concurrent URL checking (10 at a time) - Full audit logging to bot_run_log BOT #04 — EXPIRY CHECKER (expiry_checker.py): - CRITICAL: Was querying WRONG TABLE (document_chunks instead of schemes) - Fixed to query schemes table with correct deadline_date column - Shows days remaining for expiring schemes - Reports active vs total scheme counts - Full audit logging to bot_run_log BOT #05 — COVERAGE RE…bee80d3
-
fix: resolve automation workflow dependencies and remaining mypy strictness issues
255e41f
-
feat: Enterprise-Grade Ingestion & Advanced Routing (Sprints 13-15)
6399ce4