connect with us
FORESIGHT: A novel GPT-based pipeline trained on NHS data
February 7, 2023
Zeljko Kraljevic
outlines how these foundation models for medicine can provide the potential for a diverse integration of medical data that includes electronic health records, images, lab values, biologic layers such as the genome and gut microbiome...
Over the past four years, the AI world has surged ahead with large language models (LLMs), also known as “foundation models” which can be adapted to achieve many linguistic tasks. You’ve probably seen a plethora of articles in the media recently about some of these models (ChatGPT, Dalle-2), that can write coherent essays, write code, but also generate art and films, and many other capabilities.
With the NHS at breaking point, a critical question is whether these AI approaches could be used to improve care. Hospital records hold detailed information about each patient's health status and general clinical history, a large portion of which is stored within the unstructured text. Temporal modelling of this medical history, which considers the sequence of events, could be used to forecast and simulate future events, estimate risk, suggest alternative diagnoses or forecast complications.
I have developed
Foresight
as part of the
CogStack
platform, a novel GPT-based pipeline that is trained on NHS data to forecast future medical events such as disorders, medications, symptoms and interventions.
On tests in two large King’s Health Partner hospitals (King’s College Hospital, South London and Maudsley) and the US MIMIC-III dataset Foresight performed well when set challenges by clinicians. The model is being used for many uses including real-world risk estimation, virtual clinical trials and clinical research to study the progression of diseases, simulate interventions and counterfactuals, and for educational purposes.
Preprint:
https://arxiv.org/abs/2212.08072
Share
We’re pleased to announce that Stuart Harrison from ETHOS , will deliver our first 2025 Seminar Series with his talk, "Effective deployment of digital health focused technology at scale " . Stuart has led the Clinical Safety movement in the NHS alongside some of the most prominent Clinical leaders for over 20 years. Stuart is now the co-founder & director of ETHOS, a company providing ethical services to the health industry. Seminar Series Event: "Effective deployment of digital health focused technology at scale" Date and Time: 15:00 – 16.00, Wednesday 29 January 2025 Location: The Judy Dunn Room, Social Genetic and Developmental Psychiatry Building, Denmark Hill Campus, Memory Lane, London SE5 8AF Registration: EPSRC DRIVE-Health students, alumni and wider King's College London research community. Please email drive-health-cdt@kcl.ac.uk to register interest. Abstract: ETHOS will provide insight into the requirements for the safe, secure, and effective deployment of digital health focused technology at scale. Discussions concerning early research problem identification, health system challenges and taking research through to minimum viable product (MVP) and minimum marketable product (MMP). The objective is to highlight the benefit of earlier alignment with regulatory challenges to aid successful interventions and to demonstrate standards can be an enabler not a barrier to innovation. Stuart Harrison has led the Clinical Safety movement in the NHS alongside some of the most prominent Clinical leaders for over 20 years. Stuart is now the co-founder & director of a company providing ethical services to the health industry. ETHOS Ltd was formed in 2014 as a result of a feasibility study completed in partnership with a large pharmaceutical company in the interests of furthering medical science / MedTech innovation. ETHOS was formed from subject matter experts in the compliance requirements for the NHS covering security, information governance, clinical safety, Medical Devices and General Data Protection Regulations. Stuart’s background is Engineering, particularly safety critical industries where safety has immediate risk to harm to system users or the wider general population. He was one of the original authors of the clinical safety standards. An expert advisor (BSI UK) international safety, security, and effectiveness standards; leading this area since 2017 and creating a legacy from the widely recognised NHS clinical safety practises into the international health informatics industry. Stuart has significantly contributed to over 1000 health software systems being clinically assured and provided subject matter input to over 3000 service incidents with patient safety impact in the NHS. He led the creation of clinical risk management toolkits to enable self-certification across the industry for low-risk unregulated health software & ensuring they are compatible with new medical device regulations. A specialist advisor to NICE for medical technology and work closely with MHRA and other arm’s length bodies where patient safety and health software initiatives are needed. A steering group member and advisor to many professional institutions and organisations representing digital health; Stuart is helping to influence safety culture and methods across a number of domains. Stuart was co-author of the government’s Regulators Pioneer Fund bid to address the assurance of AI & machine learning in health software. Having successfully facilitated a £1M research grant being awarded to NHS Digital & MHRA. Digital Leader finalist – Digital City Awards 2021. Stuart is currently studying part time for a PhD at the University of Warwick on the subject of clinical decision supporting systems including safety concepts for emerging technology & complementary regulatory frameworks, the inclusion of mobile health data into safer decision making and exploring the lifecycle models of clinical decision supporting systems.
We’re thrilled to announce that John Jumper, PhD , will kick-off our 2024/2025 Seminar Series with his talk, "Extending AlphaFold to make predictions across the universe of biomolecular interactions" . John is one of the key pioneers behind the development of Google’s DeepMind AlphaFold - an artificial intelligence model to predict protein structures from their amino acid sequence with high accuracy. This in-person event promises to be an incredible opportunity to hear from one of the foremost innovators in AI and biology. Seminar Series Event: Extending AlphaFold to make predictions across the universe of biomolecular interactions Date and Time: 14:00 – 15.00, Thursday 10 October 2024 Location: The Council Room, 2nd floor, The King’s Building, Strand Campus Registration: Limited to EPSRC DRIVE-Health students in the first instance. Please email drive-health-cdt@kcl.ac.uk to check availability. Abstract: The high accuracy of AlphaFold 2 in predicting protein structures and protein-protein interactions raises the question of how to extend the success of AlphaFold to general biomolecular modeling, including protein-nucleic and protein-small molecule structure predictions as well as the effects of post-translational modification. In this talk, I will discuss our latest work on AlphaFold 3 to develop a single deep learning system that makes accurate predictions across these interaction types, as well as examine some of the remaining challenges in predicting the universe of biologically-relevant protein interactions.
