Spaces:
Running
Download REPRODUCE.md from Hugdrigo/modelguard-observatory: direct link, hf CLI and curl.
- Browser
- Download file 1.38 kB
-
https://huggingface.co/spaces/Hugdrigo/modelguard-observatory/resolve/main/REPRODUCE.md
- Command line
-
hf download hf://spaces/Hugdrigo/modelguard-observatory/REPRODUCE.md
-
curl -L -o REPRODUCE.md https://huggingface.co/spaces/Hugdrigo/modelguard-observatory/resolve/main/REPRODUCE.md
Reproduction instructions
Requirements: Node.js 18 or later for command-line research scripts; Python plus Playwright and local Chromium only for optional browser integration tests.
node build_artifacts.js
node test_engine.js
python test_browser.py
build_artifacts.js reads source inputs from the same folder. It retrains the deterministic original baseline models on train.json, evaluates on iid_test.json and challenge.json, writes evaluation_snapshots.json, and produces benchmark_manifest.json with SHA-256 digests of the raw inputs and prediction artifact. No Internet connection or libraries are needed for the Node tasks.
After rebuilding, run test_engine.js. Browser testing uses Playwright set_content, and injects a fetch mock with the actual local JSON files because some testing sandboxes block loopback access. It uses bundled source data, not simulated model scores. Adapt the executable_path to your local Chromium installation if needed.
Expected metrics:
| Method | Controlled correct / n | Challenge correct / n |
|---|---|---|
| NB | 130/130 | 40/54 |
| Word TF-IDF | 128/130 | 39/54 |
| Character TF-IDF | 124/130 | 38/54 |
| Hybrid | 127/130 | 42/54 |
Source data: Academic Rhetorical Intent Mini v1.1, CC BY 4.0. No model weights are served or trained by the Hugging Face Static application on initial load.