Spaces:
Sleeping
Sleeping
Commit History
-
feat(rag): switch to rich context judge with reasoning (D3 strategy)
Replace score gap + boolean judge with Gemini Flash rich context judge that returns story names + reasoning. Benchmarked as best strategy: 58% exact match, 90% within ±1 vs ground truth, ~2s latency. Score floor (-9.0) still handles off-topic queries instantly. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>96d78cc -
data: update ChromaDB vector store
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>aa1072f -
tune(rag): calibrate relevance filter for raw logit scores
- GAP_THRESHOLD: 0.3 → 5.0 (raw cross-encoder logits, not normalized) - SCORE_FLOOR: add -9.0 threshold for off-topic detection - Improved LLM judge prompt with archive scope context - Benchmark comparison mode in benchmark_filter.py - Results: recall 0.95, latency P50 777ms (vs ~10s before) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>0110ecb -
feat(api): replace Gemini generation filter with score gap + LLM fallback
Swaps the slow Gemini text generation (~8s) for the adaptive relevance filter using reranker score gaps (~0ms) with LLM-as-judge fallback (~1-2s). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>2025e44 -
feat(eval): add benchmark script to collect Gemini filter ground truth
Runs 30 eval queries through retriever + Gemini generation and records which story UIDs survive the citation filter, establishing ground truth for future filter replacement comparisons. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>e623f4f -
feat(rag): add adaptive relevance filter (score gap + LLM fallback)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>10d159f -
docs: implementation plan for search latency optimization
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>b3f12dd -
docs: spec for search latency optimization (score gap + LLM fallback)
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1094935 -
style(frontend): update logo to SVG and adjust sizing
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>b7aa3f5 -
feat(frontend): add MediaStorm logo SVG
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>844951b -
fix(rag): only rerank semantic queries, skip filter intents
Reranker (ms-marco cross-encoder) improves semantic recall but hurts filter queries (temporal, genre, awards) that rely on metadata matching. Now only applied to semantic intents (general, person, country, recommendation). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1df539f -
fix(test): increase retrieval latency budget to 1000ms for reranker
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>2c36755 -
test: add unit tests for eval/runner.py
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>f4eb869 -
test: add unit tests for rag/prompts.py build_context
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>311089e -
feat: add LRU-cached embed_query to avoid re-embedding repeated searches
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>2bf4d05 -
docs: update CLAUDE.md to reflect current architecture (FastAPI, no Gradio/sync)
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>72d641b -
feat(rag): integrate cross-encoder reranker into hybrid retrieval pipeline
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>2e5ec7a -
chore: add missing __init__.py to all packages
Add empty __init__.py files to src/mediastorm and all subpackages (ingest, enrich, vectorize, rag) for explicit Python package declaration. Ensures proper module discovery and import paths. Test results: 190 passed, 10 failed (pre-existing failures unrelated to imports). All test collection errors resolved. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>485de3e -
chore: remove unused _drop_distant method from retriever
89a77dc -
fix(cli): remove sync and serve commands referencing non-existent modules
b7f7f9a -
feat(frontend): real logo, smooth scroll on results, mosaic gradient
Replace text placeholder with actual MediaStorm logo image. Add smooth scroll to hero when results appear, fluid scroll-up + fade on re-search, and position gradient on mosaic bottom row instead of fixed viewport. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>c299d7d -
feat(eval): add --pipeline flag for full pipeline eval (retriever + Gemini filter)
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>69e1201
-
feat(eval): add cli.py eval command with diff and history
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>a36a4f5 -
feat(eval): include expected IDs and missed UIDs in eval results
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>51fa501 -
feat(eval): add quiet mode to eval_retrieval to avoid duplicate output
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>6d0ebc3 -
feat(eval): add display module for console formatting and diffs
f318b64 -
feat(eval): add runner module for eval orchestration and JSON storage
8647392 -
docs: implementation plan for eval CLI
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>b145b51 -
docs: spec for eval CLI to iterate on retrieval quality
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>72296b0 -
feat: search catalogue UI, data cleanup, router decade detection
- Replace Results.svelte with inline cards below landing search bar - Add gradient overlay, tooltip fix, card placeholder, clear button - Remove 34 non-story items from ChromaDB/BM25 (stubs, forms, meta pages) - Add _EXCLUDED_SLUGS to fetcher.py to prevent re-ingestion - Add decade detection to router (e.g. "2010s" → year range filter) - top_k_final 8 → 6 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>0c9dd38 -
refactor(frontend): pass stories as prop to Landing
f3922a7 -
feat(frontend): wire App to Results view, update StoryCard
696e8a3 -
feat(frontend): add Results.svelte catalogue view
4a88e11 -
refactor(frontend): replace SSE client with sync search, delete chat
31f39f8 -
refactor: remove streaming generator and rewriter
4e4db5e -
feat(api): replace SSE chat with sync POST /api/search
4bb26eb -
docs: search interface implementation plan
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>475c2dd -
docs: search interface design spec
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>5608593 -
feat(ui): view transitions, story grid 2x2, logo links, scroll UX
- Replace fade transition with View Transitions API for smooth search bar morph from landing center to chat bottom - Reduce retriever top_k_final from 5 to 4 for clean 2x2 card grid - Auto-scroll stops at first card instead of bottom of chat - Logo links to mediastorm.com in both landing and chat views - Make full StoryCard clickable, wrap loading/text in bubbles Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>16a41fb -
feat(mosaic): horizontal scrolling rows, random order, click-through links
- Rewrite mosaic as 3 horizontal rows with alternating scroll directions - Each row scrolls at different speeds for organic feel - Images preserve aspect ratio, fade in on load, hidden on error - Click opens story on mediastorm.com (link from nav_config API) - Hover pauses row, shows tooltip with formatted metadata - Randomized query suggestions on landing page - Autofocus on search input - Stats: "100+ Awards" instead of "4 Emmy Awards" Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>e383749 -
fix(mosaic): gate animations behind animationReady, remove loading=lazy
- Animation classes only applied after height measurement completes - Removed loading="lazy" so images load eagerly for accurate scrollHeight Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>75a8f67 -
feat(mosaic): JS orchestration — mount, measure heights, resize handler
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>04aa4fb -
feat(mosaic): masonry CSS with infinite scroll animations and hover pause
3e58fe9 -
feat(mosaic): masonry column template with duplicated content for loop
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>89abb3b -
feat(mosaic): add shuffle, column distribution, and state management
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>70c138d -
docs: mosaic redesign implementation plan
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>5293fe8 -
docs: mosaic redesign spec — masonry, infinite scroll, randomization
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>eb7f6f5
-
fix: pass token_type_ids to ONNX model when expected
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>fe1a174 -
fix: add tokenizer files for ONNX models
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>b285f85 -
chore: add models and ingest cache for HF Spaces build
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>4b3d67d