You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Clinical performance feedback commonly includes peer comparison because it helps providers to understand how their care differs from the norm, and may motivate them to improve the care they provide to align with peers. Peer comparison feedback may also motivate providers to maintain a social status of being a high performer, once they have achieved it. The Social Better Causal Pathway specifies feedback messages that are capable of motivating providers through the delivery of information about high performance, relative to peers. Example messages that uses the social better pathway are "You are a top performer" and "Congratulations, your performance was in the top 10% of providers this month." This vignette serves the purpose of illustrating how a precision feedback system uses the Social Better Causal Pathway to motivate providers.
3
+
## Introduction
4
+
Clinical performance feedback commonly includes comparison to goals because it helps providers to understand how their care differs from the norm, and may motivate them to improve the care they provide. Goal comparison feedback may also motivate providers to maintain the status of being a high performer, once they have achieved it by showing performance that became better than that of a goal comparator. The Goal Gain Pathway specifies feedback messages that are capable of motivating providers through the delivery of information about achieving goals. An example messages that uses the goal gain pathway is "You reached the goal." This vignette serves the purpose of illustrating how a precision feedback system uses the Goal Gain Pathway to motivate providers.
5
5
6
6
## Performance Data
7
-
MPOG has received operative case data from last month about Alice and Bob's cases and that of their peers. MPOG calculates the following performance information for the measure SUS-04:
7
+
MPOG has received operative case data from last month about Eugene and Gaile's cases and that of their peers. MPOG calculates the following performance information for the measure [TOC-01: Intraoperative Transfer of Care<sub>(MPOG)</sub>](https://spec.mpog.org/Spec/Public/29).
8
8
9
9
### Healthcare professionals
10
10
Alice has a performance level of 97%.
@@ -14,12 +14,10 @@ Alice's peer benchmarks for last month are 93% for the top 25% peer benchmark (7
14
14
15
15
## Preference data
16
16
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.
17
-
18
17
Alice's preference data: (TODO)
19
18
20
19
# Precision feedback system
21
20
To generate precision feedback, MPOG sends de-identified performance and preference data to a precision feedback system that processes each provider's data with their peer comparator performance data, to select an optimal precision feedback message.
22
-
23
21
The precision feedback system is a knowledge-based system that is comprised of the following parts: 1) A knowledge base, 2) A software pipeline, and 3) A web service.
24
22
25
23
## Precision Feedback Knowledge Base
@@ -30,16 +28,13 @@ The causal pathway "social better" describes the influence of feedback intervent
30
28
31
29
### Preconditions
32
30
Preconditions for social better are factors that are necessary for the success of the feedback intervention that uses the social better pathway. The social better pathway has the following preconditions:
33
-
34
31
Information content preconditions:
35
32
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
36
33
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104)
37
-
38
34
Message preconditions:
39
35
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
40
36
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
41
37
42
-
43
38
### Moderators
44
39
Moderators are factors that inhibit or promote the influence of the feedback intervention on the recipient. The social better causal pathway has the following moderators:
45
40
1. Habituation: How many times has the recipient previously received this message in the last year?
@@ -55,10 +50,8 @@ Mechanisms are factors that the intervention operates through to influence the f
55
50
### Outcomes
56
51
The expected outcome of the successful influence of an email that uses the social better pathway is clinical process performance improvement or sustainment.
57
52
58
-
59
53
## Message templates
60
54
Message templates represent a possible motivational message that a precision feedback system can send. There are two message templates that the precision feedback system can access for this vignette:
61
-
62
55
A. The [Top 10 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_10_performer.json) message template contains the following message:
63
56
"Congratulations on your high performance last month! Your performance was above the 90th percentile of [Top 10% Benchmark performance level] for the measure [performance measure name]. Your performance was [recipient performance level]."
64
57
This message template is about a positive performance gap set and a social comparator element (the MPOG Top 10% Benchmark), and is specified to be about (http://purl.obolibrary.org/obo/IAO_0000136) the following metadata:
@@ -71,52 +64,39 @@ This message template is about a positive performance gap set and a social compa
71
64
72
65
### Recipient annotations (Bitstomach)
73
66
The first stage of the pipeline analyzes performance to identify features of performance, such as comparisons and trends that are related to motivation. The analysis from this stage results in the following annotations:
74
-
75
67
Alice's annotations indicate the presence of information content about a social comparator and a positive performance gap for both the Top 10% and Top 25% Benchmarks:
76
68
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
77
69
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
78
70
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
The second stage of the pipeline creates possible messages by associating the annotations for Alice and Bob with each message template, so that two candidate messages are created for each person.
82
-
83
73
Alice's candidate messages:
84
-
85
74
A. Candidate A has the following annotations:
86
-
87
75
The [Top 10 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_10_performer.json) message template is about:
88
76
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
89
77
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
90
78
3. Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
91
79
4. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166)
92
-
93
80
Alice's performance is about:
94
81
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
95
82
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
96
83
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
97
-
98
84
B. Candidate B has the following annotations:
99
-
100
85
The [Top 25 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_25_performer.json) message template is about:
101
86
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
102
87
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
103
88
3. Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
104
89
4. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166)
105
-
106
90
Alice's performance is about:
107
91
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
108
92
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
109
93
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
For Alice, both candidates have matching preconditions with social better, and are indicated as acceptable for ranking in the next stage of the pipeline:
113
-
114
96
1. Candidate A acceptable by social better
115
97
2. Candidate B acceptable by social better
116
-
117
98
### Candidate Message Moderator Evaluation and Selection (Esteemer)
Copy file name to clipboardExpand all lines: vignettes/improving_vignette/readme.md
+11-8Lines changed: 11 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -78,10 +78,10 @@ This pathway describes the influence of feedback interventions that show the mes
78
78
Preconditions for improving are factors that are necessary for the success of the feedback intervention using this pathway. The improving pathway has the following preconditions:
Moderators are factors that inhibit or promote the influence of the feedback intervention on the recipient. The social loss causal pathway has the following moderators:
@@ -101,14 +101,17 @@ The expected outcome of the successful influence of an email that uses the impro
101
101
## Message templates (TODO)
102
102
Message templates represent a possible motivational message that a precision feedback system can send. There are two message templates that the precision feedback system can access for this vignette:
103
103
104
-
A. The [Performance Improving](https://github.com/Display-Lab/knowledge-base/...json TODO) message template contains the following message: "Your performance is improving this month for the measure [measure name].". This message template [is about] (http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
105
-
1. Positive performance trend set (http://purl.obolibrary.org/obo/PSDO_0000120)
106
-
2. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166), text only (TODO ?)
104
+
A. The [Performance Improving](https://github.com/Display-Lab/knowledge-base/...json TODO) message template contains the following message: "Your performance is improving this month for the measure [measure name].". This message template [is about<sub>(OB)</sub>](http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
107
105
108
-
B. The [Congrats Improved Performance](https://github.com/Display-Lab/knowledge-base/blob/...json TODO) message template contains the following message: "Congratulations on your improved performance this month for the measure [measure name]." This message template [is about] (http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
1. Positive performance trend set (http://purl.obolibrary.org/obo/PSDO_0000120)
111
-
2. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166), text only (TODO ?)
108
+
2. Display format compatibility: [Line Graph <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/IAO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FIAO_0000573), [Bar Chart <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/STATO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FSTATO_0000166), text only (TODO ?)
109
+
110
+
B. The [Congrats Improved Performance](https://github.com/Display-Lab/knowledge-base/blob/...json TODO) message template contains the following message: "Congratulations on your improved performance this month for the measure [measure name]." This message template [is about<sub>(BP)</sub>](http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
2. Display format compatibility: [Line Graph <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/IAO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FIAO_0000573), [Bar Chart <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/STATO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FSTATO_0000166), text only (TODO ?)
112
115
113
116
## Software Pipeline (Precision Feedback Pipeline) TODO
Deepa, another CRNA at Midwest Medicine, a medical-school affiliated hospital, has the following performance data over the last 6 months for the FLUID-01-NC measure:
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.
0 commit comments