This project is funded by:
Complaints to the NHS generate large volumes of data that should inform improvements to quality of care and patient safety. This PhD project will explore the application of Large Language Models (LLMs) in improving complaint management and resolution systems within a healthcare setting. The research will investigate how LLMs can streamline and optimise the management and resolution process through automating key processes such as complaint categorisation (text classification) and analysis, sentiment analysis, and response generation (text generation). Efficient complaint handling is important in maintaining patient trust, improving patient care quality, and addressing inequalities in patient complaint processes and experiences. It is anticipated that this project will assess the accuracy and performance of using LLMs in handling patient complaints and examine the potential of AI to reduce response times, and support complaint management to ultimately enhance patient satisfaction using formalised key performance indicators (KPIs).
The following study areas will address the technical, practical, and communicative aspects of exploring the integration of AI in healthcare complaint management to optimise processes for effective outcomes.
1. Exploring AI Integration in Complaint Handling
This study will focus on exploring techniques, frameworks, and case studies for integrating LLMs into complaint management systems. The study aims to explore ways to improve efficiency while ensuring necessary human oversight ”human-in-the-loop”.
2. Exploring LLMs Architectures for Complaint Management
This study area will focus on the capabilities, limitations, of LLMs specifically for complaint management. The objective is to adapt and optimise LLMs to effectively handle complaint scenarios, addressing unique NLP challenges, ethical considerations, and system integration requirements.
3. Evaluation and validation of AI Supported Complaint Management Prototype
This study area will evaluate prototype with selected stakeholders and measure the impact of the AI system on critical performance indicators, such as complaint resolution time, classification accuracy, and using pre-defined benchmarks for comparison.
The School of Computing at Ulster University holds Athena Swan Bronze Award since 2016 and is committed to promote and advance gender equality in Higher Education. We particularly welcome female applicants, as they are under-represented within the School.
Applicants should hold, or expect to obtain, a First or Upper Second Class Honours Degree in a subject relevant to the proposed area of study.
We may also consider applications from those who hold equivalent qualifications, for example, a Lower Second Class Honours Degree plus a Master’s Degree with Distinction.
In exceptional circumstances, the University may consider a portfolio of evidence from applicants who have appropriate professional experience which is equivalent to the learning outcomes of an Honours degree in lieu of academic qualifications.
If the University receives a large number of applicants for the project, the following desirable criteria may be applied to shortlist applicants for interview.
The University is an equal opportunities employer and welcomes applicants from all sections of the community, particularly from those with disabilities.
Appointment will be made on merit.
This project is funded by:
Our fully funded PhD scholarships will cover tuition fees and provide a maintenance allowance of £19,237 (tbc) per annum for three years (subject to satisfactory academic performance). A Research Training Support Grant (RTSG) of £900 per annum is also available.
These scholarships, funded via the Department for the Economy (DfE) and the Vice Chancellor’s Research Scholarships (VCRS), are open to applicants worldwide, regardless of residency or domicile.
Applicants who already hold a doctoral degree or who have been registered on a programme of research leading to the award of a doctoral degree on a full-time basis for more than one year (or part-time equivalent) are NOT eligible to apply for an award.
Due consideration should be given to financing your studies.
Complaints Key Performance Indicators for the Model Complaints Handling Procedures. Scottish Public Services Ombudsman. www.spso.org.uk/sites/spso/files/csa/SPSOKPIsMCHP.pdf. Accessed 30/10/2024.
Arora, Anmol et al. The promise of large language models in health care. The Lancet, Volume 401, Issue 10377, 641, 2023. doi: 10.1016/S0140-6736(23)00216-7.
Taylor, N. Efficient large language models for the NHS and psychiatry [PhD thesis]. University of Oxford. 2024.
Ali SR et al. Using ChatGPT to write patient clinic letters. Lancet Digit Health 5(4): e179–e181. 2023. doi: 10.1016/S2589-7500(23)00048-1.
Alqahtani A et al. (2023) Care4Lang at MEDIQA-Chat 2023: Fine-tuning language models for classifying and summarizing clinical dialogues. In: proceedings of the 5th clinical natural language processing workshop, pp 524–528. doi: 10.18653/v1/2023.clinicalnlp-1.55.
Cascella M et al. (2023) Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios. J Med Syst 47(1):33. doi: 10.1007/s10916-023-01925-4.
Submission deadline
Monday 24 February 2025
04:00PM
Interview Date
April 2025
Preferred student start date
15 September 2025
Telephone
Contact by phone
Email
Contact by email