--- language: en license: mit tags: - medical - gpt - healthcare - pubmed - nlp --- # PulseGPT A 123M parameter GPT-style language model trained from scratch on PubMed medical abstracts, built by [Sola Technologies](https://solatechnologies.co.uk). ## Model Details - **Architecture:** GPT-2 style decoder-only transformer - **Parameters:** 123M - **Training data:** 85M tokens of PubMed medical abstracts - **Fine-tuned on:** PubMedQA medical Q&A dataset - **Hardware:** Apple MacBook Pro M5 Pro, 48GB RAM - **Framework:** PyTorch + nanoGPT ## Intended Use - Medical text understanding - Clinical Q&A - Medical document summarisation ## Built by [Sola Technologies](https://solatechnologies.co.uk) — AI for active ageing and healthcare.