A research platform that captures what trial participants go through between check-ins. An AI agent checks in with them by voice, and a team of agents helps researchers turn those conversations into qualitative data for their study.
“I only asked for one talking agent. I never imagined you would build a whole working platform.”
“This is a whole new way of doing medical research.”
The platform has two sides. Participants talk to an AI agent about their health on their phone, and researchers define the trial, monitor and control the agents in the system, and get transcripts, patterns and help in creating new medical knowledge.
Two patients with the same injury and the same treatment can recover completely differently. Recovery is very much affected by a person’s lifestyle, experiences and environment.
Check-ins are infrequent, with long gaps in between, and the lived experiences of trial participants are not collected. Participants are asked to score their feelings and pain levels, and many are confused about how to do that.
Capturing that experience means interviewing participants regularly, then transcribing, pseudonymising and analysing every conversation manually, at a scale no research group can afford. So in MSK research it mostly isn’t done.
We explored the problem and the opportunity space in depth through interviews with patients, research participants, industry experts and researchers. We made field visits to the hospital, and to Oxford in the UK and Amsterdam in the Netherlands, meeting experts there and bringing in their points of view.
Three of us from the capstone team continued over the summer: a service designer and UX researcher, a UX, UI and visual designer, and me, coming from the School of Engineering, as the design engineer. The role was more than building the platform. It meant thinking on many different layers and taking on many different tasks.
I take a human way of thinking or working and convert it into an agentic system or architecture. These are examples. I came across many more problems.
In July, ten healthy volunteers used the platform for a week on their own phones, with no one supervising. We could not use real health data yet, so they talked about sports and health. They found it easy to use and talked more openly than in a survey, but felt they got little back. Speech with an accent was sometimes transcribed into the wrong language, so participants now choose Finnish or English before each call.
MSK research relies heavily on quantitative studies. What we are building shifts it to mixed methods, which can bring in new information and fill in gaps. In the long run, it is about delivering precise care to patients depending on their own situations.
Next: Preparing to run in actual clinical trials.