Skip to content

Commit 4b7bb54

Browse files
authored
Merge pull request #81 from NHSDigital/RAVS-fewer-questions-post
RAVS post on asking fewer,better questions in the record journey
2 parents 8190e2d + c80bd89 commit 4b7bb54

File tree

3 files changed

+137
-0
lines changed

3 files changed

+137
-0
lines changed
183 KB
Loading
200 KB
Loading
Lines changed: 137 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,137 @@
1+
---
2+
title: "Asking fewer, better questions "
3+
date: 2025-03-25
4+
---
5+
6+
For the first 2 months of 2025, the UCD team's main focus was on streamlining the record journey in our service.
7+
8+
The reason we prioritised this work is that users have told us that parts of the current journey are repetitive.
9+
10+
And within our design team, we'd also been critiquing our current journey and discussing what could be improved. We wanted to:
11+
12+
* move to a 1 thing per page approach and make our questions more conversational, following the [NHS Digital service manual guidance on how to write good questions](https://service-manual.nhs.uk/content/how-to-write-good-questions-for-forms)
13+
* align our designs more closely with the [NHS design system](https://service-manual.nhs.uk/design-system), using tried and tested components and patterns
14+
15+
16+
## What we did
17+
18+
This has been a big piece of work and it's not finished yet. It has involved:
19+
20+
* desk research
21+
* prototyping
22+
* multiple rounds of user research
23+
* lots of lively discussion within the UCD team and with our wider product team
24+
25+
There will be other posts about different aspects of the work. But this one is about how we set about asking fewer and better questions in the record journey.
26+
27+
This work followed from [an earlier design sprint where we'd explored the idea of "sessions"](https://design-history.prevention-services.nhs.uk/record-a-vaccination/2024/11/design-sprint-sessions/), allowing users to set up a vaccination clinic of sorts where certain parameters could be fixed. We may well come back to the idea of sessions but for now we wanted to look at improving the core vaccination journey rather than adding a new feature to the service.
28+
29+
## What data we capture and why
30+
31+
We started with desk research looking at the key requirements for capturing vaccination data.
32+
33+
We wanted to understand:
34+
35+
* what is the minimum vaccination data that has to be captured when you record a vaccination, as mandated by NHS England
36+
* what other data do we currently capture and how important is this to our users
37+
38+
## How people answer the questions in our current journey
39+
40+
We were lucky to have a data analyst join our team while we were doing this work. This meant we were able to get really useful insights into how users are currently answering questions.
41+
42+
It helped us:
43+
44+
* understand what proportion of users might be affected if we dropped certain questions
45+
* decide how to present certain questions based on the answers users most often give
46+
47+
## Prototyping the new journey
48+
49+
After mapping out a few different ideas for journeys in Mural, where we dropped some questions and reordered the remaining ones, we soon moved to creating a new journey in the prototyping kit.
50+
51+
This forced us to move to concrete designs and think hard about the words.
52+
53+
## Documenting our decisions
54+
55+
In parallel, we decided to document our design decisions in a slide deck. We were making so many decisions in conversations between the 3 designers working on the journey that we thought we should put some of this in writing so we could present our thinking back to the wider team.
56+
57+
### Agreement on dropping some questions
58+
We came up with a list of things we (designers) suggested dropping from the record journey and shared our plan with our wider team.
59+
60+
Some things were uncontroversial. There was consensus that we don't need to:
61+
62+
* ask for both the date of vaccination and the date the patient was assessed for a vaccination (since these would happen on the same date)
63+
* ask twice which vaccine product was being given
64+
* capture different clinical roles – we currently have 3 separate questions asking the user to confirm the name of the clinician who assessed the patient, who obtained consent and who gave the vaccination
65+
* explicitly ask if the patient had been given the vaccine, since other questions (such as where did you give the injection) already confirm this
66+
67+
### Reformatting questions
68+
69+
While we had set out to drop as many questions as possible, it turned out that there was possibly more scope to ask better questions than to drop questions altogether.
70+
71+
We ended up simplifying several questions so they could be answered in fewer steps by the majority of users. Here are a couple of examples.
72+
73+
1. In the current journey we ask users to select the date of vaccination using a fiddly date picker. We know from data that 80% of the time users select today's date. So in the new streamlined journey we've made it easier for the majority of users to answer this question by asking "Is the vaccination today?" and offering "Today" as the top radio answer.
74+
75+
Only the 20% who do not select today have to go on to enter a date. We've also changed our design for date entry to the more accessible NHS date input component.
76+
77+
![Screenshots showing before and after for the vaccination date question](vaccination-date-before-after.png)
78+
79+
2. In the current journey when it comes to consent, we ask first if consent was given and then who consented. So all users have to answer a minimum of 2 questions on consent.
80+
81+
We know from data that 98% of the time users select that the patient themselves gave consent.
82+
83+
![Screenshots showing before and after for the consent question](consent-before-and-after.png)
84+
85+
In the new journey, we simplified the question to "Who is giving consent?", presenting the name of the patient as the top answer – making it quicker to answer for the 98%.
86+
87+
88+
### Some proposals caused concern
89+
90+
We proposed removing 2 optional free text comment boxes from the journey because they didn't have a defined use. Data entered in these boxes is not sent to other services but just saved locally within Record a vaccination. We’d heard from at least 1 user that they thought information entered here would be sent to the patient's GP so this feature could be misleading.
91+
92+
However, because the comment boxes were used by up to 10% of users, there was concern in our team that we might inadvertently cause problems for users by removing them.
93+
94+
Another question that we proposed removing from the current journey is one that asks users if the vaccination was given. If the user selects no, no vaccination record is created and no data about the fact that the vaccination was not given is recorded or sent to any other systems.
95+
96+
We thought this question was redundant since a vaccination not given was not recorded. However some of our team were concerned that we should be doing more to address user needs around being able to record vaccinations not given.
97+
98+
To address these concerns, we agreed to delve more into the need for free text boxes and recording vaccinations not given as part of user research on the new journey.
99+
100+
## User research
101+
102+
We carried out a round of user research with 10 sessions in total, speaking to people in a range of roles across a range of settings.
103+
104+
### The new streamlined journey was straightforward
105+
106+
All users we able to click through the steps of recording a vaccination without hesitation and with minimum prompting. Perhaps the most striking thing was the lack of comments we received about how different the new journey was from the current journey.
107+
108+
We had anticipated that some users might react negatively to the 1 question per screen approach as the new journey has more screens than the current one but this was not commented on.
109+
110+
### Users wanted the option of adding free text notes or comments
111+
112+
Even if it was not something they often needed, users told us they wanted this option to be available for some scenarios. For example, if they wanted to log something out of the ordinary such as a vaccination given outside the guidelines.
113+
114+
### Vaccinations not given
115+
116+
We heard lots of different things about vaccinations not given. For some settings it was not considered important or useful to record a vaccination not given. But in others, it was considered really important as it could help identify problems with vaccination uptake or determine follow-up actions such as inviting patients to attend again.
117+
118+
## Where we are now
119+
120+
We've added a free text comments box to the end of the streamlined journey but made it clear in the interface that any text entered will not be shared with the patient's GP. We plan to monitor how this used with a view that it might still be something we remove or change in future.
121+
122+
We've started exploring some designs for recording vaccinations not given but this is proving challenging. The Record a vaccination service is just 1 touchpoint in an end-to-end vaccination journey – and a "vaccination not given" does not sit neatly within it.
123+
124+
Data on vaccinations not given is most useful when linked to invitation, booking and appointment systems and Record a vaccination is not currently integrated with any of those.
125+
126+
The problem space for "vaccinations not given" stretches beyond our service. In order to solve the whole problem, we'll need to look beyond our service and our team.
127+
128+
## What next
129+
130+
We are planning how and when we'll roll out the new record journey to users.
131+
132+
We are developing further features of the streamlined journey, including:
133+
134+
* a separate journey to allow users to record several vaccinations for 1 patient
135+
* a repeat journey to allow users to record consecutive vaccinations of the same type, for example if a site was running a clinic doing just flu vaccinations
136+
* an edit and delete journey to allow users to change or delete a vaccination record
137+

0 commit comments

Comments
 (0)