PulseGPT / README.md
komalmagarwal's picture
Upload README.md with huggingface_hub
20f72c1 verified
|
Raw History Blame Contribute Delete
745 Bytes
metadata
language: en
license: mit
tags:
  - medical
  - gpt
  - healthcare
  - pubmed
  - nlp

PulseGPT

A 123M parameter GPT-style language model trained from scratch on PubMed medical abstracts, built by Sola Technologies.

Model Details

  • Architecture: GPT-2 style decoder-only transformer
  • Parameters: 123M
  • Training data: 85M tokens of PubMed medical abstracts
  • Fine-tuned on: PubMedQA medical Q&A dataset
  • Hardware: Apple MacBook Pro M5 Pro, 48GB RAM
  • Framework: PyTorch + nanoGPT

Intended Use

  • Medical text understanding
  • Clinical Q&A
  • Medical document summarisation

Built by

Sola Technologies — AI for active ageing and healthcare.