| --- |
| license: apache-2.0 |
| base_model: google/gemma-4-E2B-it |
| tags: |
| - audio |
| - emotion |
| - sentiment |
| - mps |
| - apple-silicon |
| pipeline_tag: audio-classification |
| --- |
| |
| # monica — System One audio-sentiment heads |
|
|
| Trained decision heads for **monica**, a local non-generative audio-sentiment |
| service. Frozen [Gemma 4 E2B](https://huggingface.co/google/gemma-4-E2B-it) |
| audio tower + these compact heads produce calibrated probabilities for typed |
| questions (noul / choice / score) over one shared audio encoding. No |
| transcription, no generated tokens. |
|
|
| Code/server live in a GitHub repository (private for now; code released alongside this card later). The base model is separate: `hf download google/gemma-4-E2B-it --local-dir data/models/gemma-4-E2B-it` (~10 GB, Apache-2.0). This repo provides only the trained heads and artifacts: |
|
|
| ## Contents |
|
|
| | file | what | |
| |---|---| |
| | `models/head-cremad.pt` | question encoder + window-attention decision heads (80 MB), trained on CREMA-D, speaker-independent splits | |
| | `models/calibration.json` | per-question-type temperature scaling | |
| | `data/selected_layers.json` | audio-tower layer selection `(3, 4, 9, 10)` | |
| | `bench/eval_results.json` | full evaluation (acc, AUC, ECE, Brier, RPS, robustness, latency) | |
| | `bench/bench_results.json` | latency / cold-start / memory benchmark | |
| | `bench/options_comparison.json` | compact question encoder vs Gemma text trunk | |
| | `EVALUATION.md`, `LICENSES.md` | evaluation protocol and data/model licenses | |
|
|
| ## Key numbers (CREMA-D, speaker-independent) |
|
|
| - noul seen words: acc 0.873, AUC 0.850, ECE 0.069; unseen words 0.839 / 0.803 / 0.037 |
| - 6-way emotion choice: acc 0.591 (chance 0.167), macro-F1 0.584, ECE 0.101 |
| - score level-MAE 0.50–0.62 (trained scales) |
| - latency (M3 Ultra, warm): ~150–200 ms per request incl. encode; RTF 0.006 at 30 s audio |
| - warm encode: 30 s audio in ~120 ms, once per request regardless of question count (0–64) |
|
|
| ## Usage |
|
|
| See the GitHub repo README for the `/v1/systemone` request format. Quick start: |
|
|
| ```bash |
| git clone https://github.com/nunez/monica && cd monica |
| uv pip install -e ".[dev]" # or pip install -r requirements.txt |
| # point MONICA_BASE_MODEL at a local Gemma 4 E2B checkout |
| MONICA_BASE_MODEL=/path/to/gemma-4-E2B-it \ |
| python -m uvicorn monica.server:app --host 0.0.0.0 --port 8910 |
| ``` |
|
|
| ## License |
|
|
| Code Apache-2.0. Base model Google Gemma Terms of Use (Apache-2.0). CREMA-D: |
| ODbL/attribution. RAVDESS: research-only (CC BY-NC-SA 4.0) — benchmark only, |
| never trained on. |
|
|
