|
Download README.md from youdotcom/reflex-search: direct link, hf CLI and curl.
- Browser
- Download file 3.73 kB
-
https://huggingface.co/youdotcom/reflex-search/resolve/main/README.md
- Command line
-
hf download hf://youdotcom/reflex-search/README.md
-
curl -L -o README.md https://huggingface.co/youdotcom/reflex-search/resolve/main/README.md
3.73 kB
| license: apache-2.0 | |
| base_model: google/embeddinggemma-2 | |
| library_name: safetensors | |
| pipeline_tag: text-classification | |
| tags: | |
| - search | |
| - reranking | |
| - calibration | |
| - system-1 | |
| - cpu-inference | |
| - embeddinggemma-2 | |
| - mcp | |
| # `youdotcom/reflex-search` (`v0.3.3`) | |
| Initial public release (`v0.3.3`) of `reflex-search` — a compact, CPU-native System 1 search decision and source-ranking model built on the text encoder of [`google/embeddinggemma-2`](https://huggingface.co/google/embeddinggemma-2) (`d = 768`, 24 text layers with hybrid 512-token sliding and global full attention). Vision and audio towers are removed so the text-only `bf16` checkpoint occupies **517 MB on disk** and runs in **~196 MB RSS (`int8`) / ~315 MB RSS (`bf16`)** on commodity CPUs via `s1_eg2cpu` (adapted from `undrgrnd-labs/hunch/eg2cpu`). | |
| It powers the `reflex-search` and `reflex-extract` MCP tools (`/mcp/reflex`): | |
| 1. **Gate 1 (Sub-query preflight):** Scores parallel candidate sub-queries (`noul_query_matches_intent`, `choice_best_query_for_intent`) to filter off-topic hallucinations and rank over-budget queries before spending Search API calls. | |
| 2. **Gate 2 (Unified SERP + Knowledge ranking & routing):** Scores web highlights and licensed knowledge facts (`attribution` + `as_of`) on one unified relevance scale (`choice_best_search_hit` + `score_return_relevance`), estimates counterfactual full-page read gain (`noul_hit_worth_reading`), and scores set-level coverage (`score_evidence_coverage` + `choice_next_step` in `{answer, read, revise, stop}`). | |
| 3. **Parallel Extract Intent Scoring:** Scores BM25-windowed webpage and PDF passages against caller-supplied `document_intent` (`score_extract_relevance` on `doc_kind = "extracted_doc"`). | |
| --- | |
| ## Architecture & Artifact Layout | |
| | File | Format | Size | Contents | | |
| | :--- | :--- | ---: | :--- | | |
| | `model.safetensors` | `BF16` | `517 MB` | Frozen text-only `google/embeddinggemma-2` weights (`language_model.*`; zero vision/audio weights) | | |
| | `heads.safetensors` | `F32` | `58 MB` | Rank-16 LoRA (`layers [17, 20, 21, 22, 23]` + `embedding_projection`, bypassed during prompt embedding for `0.0` retrieval drift) + `ChoiceHead`, `NoulHead`, and `ScoreHead` | | |
| | `heads.json` | JSON | `9.8 KB` | Head dimensions, query templates, LoRA metadata, and post-hoc `(T, b)` calibration tables | | |
| | `calibration.json` | JSON | `2.6 KB` | Single-shot untouched `bar_locked` holdout seal | | |
| | `tokenizer.json` | JSON | `31 MB` | Gemma fast BPE tokenizer | | |
| | `config.json` | JSON | `5.0 KB` | Backbone text configuration | | |
| --- | |
| ## Untouched Holdout Calibration (`bar_locked`, `6,155` Rows) | |
| Trained and calibrated on leak-free search and counterfactual multi-rollout trajectories (`0` root or query overlap with `bar_locked` and downstream evaluation benchmarks): | |
| | Cell | Holdout Rows | Proper Loss (vs. Base Rate) | Accuracy / Conditional RPS | Quantile ECE (Gate `<= 0.045`) | Perturbation JS (Gate `<= 0.005`) | | |
| | :--- | ---: | :--- | :--- | :--- | :--- | | |
| | **`Choice:text`** | `2,024` | `0.1250 < 0.1599` | `49.2%` (`5`-way) | `0.0307` | `0.00079` | | |
| | **`Noul:text`** | `2,040` | `0.1564 < 0.2500` | `77.5%` | `0.0315` | `0.00130` | | |
| | **`Score:text`** | `2,091` | `0.1185 < 0.3340` | `RPS 0.1554 < 0.2004` | `0.0166` | `0.00130` | | |
| | **Combined** | **`6,155`** | **All `3/3` Heads Admitted** | — | **`0.0262 <= 0.040`** | **`0.00113 <= 0.005`** | | |
| --- | |
| ## License & Attribution | |
| - Base weights (`model.safetensors`, `tokenizer.json`, `config.json`) derive from [`google/embeddinggemma-2`](https://huggingface.co/google/embeddinggemma-2) under the **Apache-2.0** license. | |
| - LoRA adapters, calibrated RLCD projection heads, and configuration metadata are released under **Apache-2.0**. | |