|
| 1 | +--- |
| 2 | +title: Designing a medical annotation tool for capturing breast features |
| 3 | +description: How we're designing a new medical annotation tool to enable users to capture features |
| 4 | +date: 2025-07-17 |
| 5 | +tags: |
| 6 | + - beta |
| 7 | + - prototype |
| 8 | + - screening |
| 9 | +--- |
| 10 | + |
| 11 | +We’re designing a way for radiographers to record breast features on a diagram, so that this information can later be used by radiologists during image-reading. Breast features include things like scars, moles and warts which can affect the appearances on the mammogram. |
| 12 | + |
| 13 | +## What's the user need? |
| 14 | + |
| 15 | +During screening, medical information is captured. This includes breast features like warts, moles, scars or tattoos. Radiologists review mammograms at a later stage and use the annotations made during mammogram to explain changes on the mammogram. For example, if they see something suspicious on the mammogram, they can cross-check with the annotated diagram and see that a scar is in that location, that can avoid them needing to call the person back for assessment. |
| 16 | + |
| 17 | + |
| 18 | +## Existing tools and their drawbacks |
| 19 | + |
| 20 | +Breast features are recorded on a paper form or within the NBSS software. |
| 21 | + |
| 22 | +Paper offers pros and cons: while drawing on paper offers an easy way for radiographers to record visual information, it also produces unstructured, offline data. It’s also difficult to amend errors. |
| 23 | + |
| 24 | +NBSS uses a grid on a diagram to create annotations, which is a step towards structured data. However, users have told us about various issues with recording on the grid. Some areas of the grid where a mark needs to be recorded – such as immediately left or right or above for below the nipple – can’t be selected, so NBSS’s annotation tool doesn’t allow users a necessary level of accuracy. |
| 25 | + |
| 26 | + |
| 27 | + |
| 28 | + |
| 29 | + |
| 30 | +## Starting with the wisdom of the team |
| 31 | + |
| 32 | +We kicked off this work with a sketching workshop to access the team's wisdom, context and experience within this space. |
| 33 | + |
| 34 | +We ended up with lots of interesting ideas and threads to explore, which formed a starting point of a prototype. |
| 35 | + |
| 36 | +Through the process of discussing the problem and voting on the best ideas to take forward, we also gained a shared understanding of the problem and consensus on our next steps. |
| 37 | + |
| 38 | + |
| 39 | + |
| 40 | +## Annotation methods |
| 41 | + |
| 42 | +There are two main mechanisms that people can use to annotate a diagram: picking a point (mapped to an area) or drawing a mark. |
| 43 | + |
| 44 | +We have an assumption that most users – at least right now – will be using a desktop computer, rather than a tablet. Drawing digitally using a mouse or trackpad isn’t easy or especially accessible. Drawing marks, aside from being a trickier way to annotate compared with clicking a point, also provides more detail than is required by radiologists at the image reading stage. |
| 45 | + |
| 46 | +For a MVP annotation tool, we wanted to keep it as simple as possible and iterate as we learned more from our users. |
| 47 | + |
| 48 | +## The prototype |
| 49 | + |
| 50 | +The prototype allows users to click on a diagram to add a mark. The mark shows up with a number on the diagram and a key shown beneath it. Marks added can be moved, edited and deleted. When a mark is added, we use the map of locations our subject matter expert (Dr Louise Wilkinson) has provided to display a text description of the location. |
| 51 | + |
| 52 | +## Diagram with no features added |
| 53 | + |
| 54 | +This is what the user sees when no features have been added. |
| 55 | + |
| 56 | + |
| 57 | + |
| 58 | +## Adding a feature |
| 59 | + |
| 60 | +When a location has been selected, the user will see a popover asking what the feature is. They can select mole, wart, breast reduction scar, other scar, or other feature. We are very likely to iterate this list as we try to prioritise the most common types of features, while also allowing enough flexibility for customisation. |
| 61 | + |
| 62 | + |
| 63 | + |
| 64 | + |
| 65 | +## Features added, key shown |
| 66 | + |
| 67 | +The diagram below shows two features added to the diagram, with the locations displayed next to them. |
| 68 | + |
| 69 | + |
| 70 | + |
| 71 | +# Mini GIF demo |
| 72 | + |
| 73 | + |
| 74 | + |
| 75 | +## Designing with our subject matter expert |
| 76 | + |
| 77 | +We worked with our subject matter expert, Dr Louise Wilkinson, to refine the locations shown in the diagram. It was important to get the right level of location accuracy when adding a mark on the diagram. |
| 78 | + |
| 79 | +She kindly drew some options for us to explore in our prototype. The top diagram’s locations and names were used to inform our prototype's locations. |
| 80 | + |
| 81 | + |
| 82 | + |
| 83 | +## Next steps |
| 84 | + |
| 85 | +Our next step is to test this with our primary users – radiographers. We’ll need to make sure the tool is usable, that we’re allowing them to capture what they need, and that the diagram is easy to understand by both radiographers and radiologists. |
0 commit comments