| --- |
| license: apache-2.0 |
| datasets: |
| - pietrolesci/pubmed-200k-rct |
| metrics: |
| - accuracy |
| base_model: |
| - openai-community/gpt2 |
| tags: |
| - medical |
| - biology |
| - research |
| - pubmed |
| model-index: |
| - name: MedGPT |
| results: [] |
| demo: |
| - name: Try in Space |
| url: https://huggingface.co/spaces/devmanpreet/Medical-GPT2-Classifier |
| --- |
| |
| # MedGPT — GPT-2 Fine-Tuned on PubMed RCT |
|
|
| MedGPT is a GPT-2 model fine-tuned on the `pubmed-200k-rct` dataset. It classifies individual sentences from biomedical abstracts into one of five standard sections: |
|
|
| - Background |
| - Objective |
| - Methods |
| - Results |
| - Conclusion |
|
|
| This model is useful for tasks requiring structured understanding or summarization of scientific literature. |
|
|
| ## Training Details |
|
|
| - Base Model: `gpt2` (124M parameters) |
| - Dataset: `pietrolesci/pubmed-200k-rct` |
| - Task: Sentence classification |
| - Labels: Background, Objective, Methods, Results, Conclusion |
| - Epochs: 1 (partial training) |
| - Loss Function: CrossEntropy |
| - Optimizer: AdamW |
|
|
