---
license: apache-2.0
language: en
library_name: transformers
pipeline_tag: text-classification
base_model: distilbert/distilroberta-base
---

# Doc Compass

Routes a plain-language health concern to a kind of doctor to book. It suggests a door to
knock on; it does not diagnose and is not medical advice.

This repo holds the app code (`doccompass/`) and its routers, so the demo notebook can run
without access to the project's GitHub repo.

## What is here

| File | What it is |
|---|---|
| `checkpoints/distilroberta_stage1/` | `distilbert/distilroberta-base` fine-tuned (all weights) to route concerns to 12 labels |
| `checkpoints/tfidf_stage1.joblib` | TF-IDF + logistic regression router, trained from scratch on the same data |
| `doccompass/` | emergency rules, routers, explanation and the Gradio app |

Labels: Dermatology, Orthopedics, ENT, Gastroenterology, Neurology, Urology, Ob-Gyn, Mental health, Cardiology, Eye care, Dentistry, Start with a GP.

## Training data

Stage 1 only: 6,252 unique comments from *Patient Comments and Specialist Types*
(Mendeley Data, DOI 10.17632/2twgjzpn82.2, CC BY 4.0), with its 68 symptom categories
remapped to the labels above. These are short, one-sentence comments, so treat results
on this set as a sanity check only.

## Results

On 938 held-out comments from that same public set, the fine-tuned router scores
94.3% top-1 (95% CI 92.7%–95.7%), 99.0% top-3 and
0.908 macro-F1. The comments are short and similar to each other, so this is an easy score:
it says how well the router fits the public data, not how it does on real posts.

## Limits

- English only, and trained on short comments. It can be confidently wrong on wording the
  public set doesn't cover: "my gums bleed when I brush" is routed to Ob-Gyn.
- The emergency check is a short list of written rules and will miss emergencies phrased
  in ways the rules don't anticipate. In an emergency call 911.
- Not clinically validated.