Skip to content

Commit b8f7ba1

Browse files
authored
Merge pull request #99 from Display-Lab/main
merge main changes with loss template patch
2 parents 41d86f5 + 3b4a077 commit b8f7ba1

File tree

5 files changed

+210
-54
lines changed

5 files changed

+210
-54
lines changed
Lines changed: 3 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
# Goal Gain Vignette
22

3-
## Introduction
4-
Clinical performance feedback commonly includes peer comparison because it helps providers to understand how their care differs from the norm, and may motivate them to improve the care they provide to align with peers. Peer comparison feedback may also motivate providers to maintain a social status of being a high performer, once they have achieved it. The Social Better Causal Pathway specifies feedback messages that are capable of motivating providers through the delivery of information about high performance, relative to peers. Example messages that uses the social better pathway are "You are a top performer" and "Congratulations, your performance was in the top 10% of providers this month." This vignette serves the purpose of illustrating how a precision feedback system uses the Social Better Causal Pathway to motivate providers.
3+
## Introduction
4+
Clinical performance feedback commonly includes comparison to goals because it helps providers to understand how their care differs from the norm, and may motivate them to improve the care they provide. Goal comparison feedback may also motivate providers to maintain the status of being a high performer, once they have achieved it by showing performance that became better than that of a goal comparator. The Goal Gain Pathway specifies feedback messages that are capable of motivating providers through the delivery of information about achieving goals. An example messages that uses the goal gain pathway is "You reached the goal." This vignette serves the purpose of illustrating how a precision feedback system uses the Goal Gain Pathway to motivate providers.
55

66
## Performance Data
7-
MPOG has received operative case data from last month about Alice and Bob's cases and that of their peers. MPOG calculates the following performance information for the measure SUS-04:
7+
MPOG has received operative case data from last month about Eugene and Gaile's cases and that of their peers. MPOG calculates the following performance information for the measure [TOC-01: Intraoperative Transfer of Care<sub>(MPOG)</sub>](https://spec.mpog.org/Spec/Public/29).
88

99
### Healthcare professionals
1010
Alice has a performance level of 97%.
@@ -14,12 +14,10 @@ Alice's peer benchmarks for last month are 93% for the top 25% peer benchmark (7
1414

1515
## Preference data
1616
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.
17-
1817
Alice's preference data: (TODO)
1918

2019
# Precision feedback system
2120
To generate precision feedback, MPOG sends de-identified performance and preference data to a precision feedback system that processes each provider's data with their peer comparator performance data, to select an optimal precision feedback message.
22-
2321
The precision feedback system is a knowledge-based system that is comprised of the following parts: 1) A knowledge base, 2) A software pipeline, and 3) A web service.
2422

2523
## Precision Feedback Knowledge Base
@@ -30,16 +28,13 @@ The causal pathway "social better" describes the influence of feedback intervent
3028

3129
### Preconditions
3230
Preconditions for social better are factors that are necessary for the success of the feedback intervention that uses the social better pathway. The social better pathway has the following preconditions:
33-
3431
Information content preconditions:
3532
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
3633
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104)
37-
3834
Message preconditions:
3935
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
4036
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
4137

42-
4338
### Moderators
4439
Moderators are factors that inhibit or promote the influence of the feedback intervention on the recipient. The social better causal pathway has the following moderators:
4540
1. Habituation: How many times has the recipient previously received this message in the last year?
@@ -55,10 +50,8 @@ Mechanisms are factors that the intervention operates through to influence the f
5550
### Outcomes
5651
The expected outcome of the successful influence of an email that uses the social better pathway is clinical process performance improvement or sustainment.
5752

58-
5953
## Message templates
6054
Message templates represent a possible motivational message that a precision feedback system can send. There are two message templates that the precision feedback system can access for this vignette:
61-
6255
A. The [Top 10 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_10_performer.json) message template contains the following message:
6356
"Congratulations on your high performance last month! Your performance was above the 90th percentile of [Top 10% Benchmark performance level] for the measure [performance measure name]. Your performance was [recipient performance level]."
6457
This message template is about a positive performance gap set and a social comparator element (the MPOG Top 10% Benchmark), and is specified to be about (http://purl.obolibrary.org/obo/IAO_0000136) the following metadata:
@@ -71,52 +64,39 @@ This message template is about a positive performance gap set and a social compa
7164

7265
### Recipient annotations (Bitstomach)
7366
The first stage of the pipeline analyzes performance to identify features of performance, such as comparisons and trends that are related to motivation. The analysis from this stage results in the following annotations:
74-
7567
Alice's annotations indicate the presence of information content about a social comparator and a positive performance gap for both the Top 10% and Top 25% Benchmarks:
7668
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
7769
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
7870
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
79-
8071
### Candidate Message Generation (Candidate Smasher)
8172
The second stage of the pipeline creates possible messages by associating the annotations for Alice and Bob with each message template, so that two candidate messages are created for each person.
82-
8373
Alice's candidate messages:
84-
8574
A. Candidate A has the following annotations:
86-
8775
The [Top 10 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_10_performer.json) message template is about:
8876
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
8977
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
9078
3. Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
9179
4. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166)
92-
9380
Alice's performance is about:
9481
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
9582
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
9683
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
97-
9884
B. Candidate B has the following annotations:
99-
10085
The [Top 25 Performer](https://github.com/Display-Lab/knowledge-base/blob/social_better/message_templates/top_25_performer.json) message template is about:
10186
1. Social comparator element (http://purl.obolibrary.org/obo/psdo_0000045)
10287
2. Positive performance gap set (http://purl.obolibrary.org/obo/psdo_0000117)
10388
3. Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
10489
4. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166)
105-
10690
Alice's performance is about:
10791
1. Social comparator content (http://purl.obolibrary.org/obo/psdo_0000095)
10892
2. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 10% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000129)
10993
3. Positive performance gap content (http://purl.obolibrary.org/obo/psdo_0000104) regarding comparator Top 25% Benchmark Comparator (http://purl.obolibrary.org/obo/psdo_0000128)
110-
11194
### Candidate Message Preconditions Evaluation (Think Pudding)
11295
For Alice, both candidates have matching preconditions with social better, and are indicated as acceptable for ranking in the next stage of the pipeline:
113-
11496
1. Candidate A acceptable by social better
11597
2. Candidate B acceptable by social better
116-
11798
### Candidate Message Moderator Evaluation and Selection (Esteemer)
11899
TODO
119-
120100
### Message Generation and Delivery (Pictoralist)
121101
TODO
122102

vignettes/improving_vignette/readme.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -78,10 +78,10 @@ This pathway describes the influence of feedback interventions that show the mes
7878
Preconditions for improving are factors that are necessary for the success of the feedback intervention using this pathway. The improving pathway has the following preconditions:
7979

8080
Information content preconditions:
81-
1. Positive performance trend content (http://purl.obolibrary.org/obo/PSDO_0000099)
81+
1. [Positive performance trend content<sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/PSDO/?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FPSDO_0000099)
8282

8383
Message preconditions:
84-
1. Positive performance trend set (http://purl.obolibrary.org/obo/PSDO_0000120)
84+
1. [Positive performance trend set<sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/PSDO/?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FPSDO_0000120)
8585

8686
### Moderators
8787
Moderators are factors that inhibit or promote the influence of the feedback intervention on the recipient. The social loss causal pathway has the following moderators:
@@ -101,14 +101,17 @@ The expected outcome of the successful influence of an email that uses the impro
101101
## Message templates (TODO)
102102
Message templates represent a possible motivational message that a precision feedback system can send. There are two message templates that the precision feedback system can access for this vignette:
103103

104-
A. The [Performance Improving](https://github.com/Display-Lab/knowledge-base/...json TODO) message template contains the following message: "Your performance is improving this month for the measure [measure name].". This message template [is about] (http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
105-
1. Positive performance trend set (http://purl.obolibrary.org/obo/PSDO_0000120)
106-
2. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166), text only (TODO ?)
104+
A. The [Performance Improving](https://github.com/Display-Lab/knowledge-base/...json TODO) message template contains the following message: "Your performance is improving this month for the measure [measure name].". This message template [is about<sub>(OB)</sub>](http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
107105

108-
B. The [Congrats Improved Performance](https://github.com/Display-Lab/knowledge-base/blob/...json TODO) message template contains the following message: "Congratulations on your improved performance this month for the measure [measure name]." This message template [is about] (http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
106+
1. [Positive performance trend set<sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/PSDO/?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FPSDO_0000120)
109107

110-
1. Positive performance trend set (http://purl.obolibrary.org/obo/PSDO_0000120)
111-
2. Display format compatibility: Line graph (http://purl.obolibrary.org/obo/IAO_0000573), bar chart (http://purl.obolibrary.org/obo/STATO_0000166), text only (TODO ?)
108+
2. Display format compatibility: [Line Graph <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/IAO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FIAO_0000573), [Bar Chart <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/STATO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FSTATO_0000166), text only (TODO ?)
109+
110+
B. The [Congrats Improved Performance](https://github.com/Display-Lab/knowledge-base/blob/...json TODO) message template contains the following message: "Congratulations on your improved performance this month for the measure [measure name]." This message template [is about<sub>(BP)</sub>](http://purl.obolibrary.org/obo/IAO_0000136) the following features of performance data:
111+
112+
1. [Positive performance trend set<sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/PSDO/?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FPSDO_0000120)
113+
114+
2. Display format compatibility: [Line Graph <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/IAO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FIAO_0000573), [Bar Chart <sub>(BP)</sub>](https://bioportal.bioontology.org/ontologies/STATO?p=classes&conceptid=http%3A%2F%2Fpurl.obolibrary.org%2Fobo%2FSTATO_0000166), text only (TODO ?)
112115

113116
## Software Pipeline (Precision Feedback Pipeline) TODO
114117

vignettes/social_approach_vignette/readme.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -15,23 +15,23 @@ Bob, a nurse anesthetist (CRNA) at Max Commuity Hospital, has the following perf
1515

1616
|Month|Performance Level|Top 10% Benchmark|Peer Average|
1717
|-----|-----------------|-----------------|------------|
18-
|Oct | xx%| xx| xx|
19-
|Nov | 85%| 95| 87|
20-
|Dec | 85%| 93| 85|
21-
|Jan | 87%| 96| 88|
22-
|Feb | 88%| 97| 87|
23-
|Mar | 91%| 95| 86|
18+
|Oct | 84%| 90| 85|
19+
|Nov | 85%| 92| 86|
20+
|Dec | 85%| 93| 87|
21+
|Jan | 83%| 92| 86|
22+
|Feb | 81%| 92| 86|
23+
|Mar | 83%| 91| 85|
2424

2525
Deepa, another CRNA at Midwest Medicine, a medical-school affiliated hospital, has the following performance data over the last 6 months for the FLUID-01-NC measure:
2626

2727
|Month|Performance Level|Top 10% Benchmark|Peer Average|
2828
|-----|-----------------|-----------------|------------|
29-
|Oct | xx%| xx| xx|
30-
|Nov | 95%| 95| 87|
31-
|Dec | 94%| 93| 85|
32-
|Jan | 92%| 96| 88|
33-
|Feb | 94%| 97| 87|
34-
|Mar | 97%| 95| 86|
29+
|Oct | 83%| 93| 85|
30+
|Nov | 84%| 95| 87|
31+
|Dec | 85%| 93| 85|
32+
|Jan | 84%| 92| 88|
33+
|Feb | 84%| 93| 87|
34+
|Mar | 85%| 91| 86|
3535

3636
## Preference data
3737
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.

vignettes/social_better_vignette/readme.md

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -16,23 +16,23 @@ Alice, an attending anesthesiologist at Midwest Medicine, has the following perf
1616

1717
|Month|Performance Level|Top 10% Benchmark|Peer Average|
1818
|-----|-----------------|-----------------|------------|
19-
|Aug | 6/7| 94| 88|
20-
|sep | 16/19| 99| 91|
21-
|Oct | xx%| 95| 88|
19+
|Aug | 86%| 94| 88|
20+
|sep | 84%| 99| 91|
21+
|Oct | 86%| 95| 88|
2222
|Nov | 89%| 98| 93|
23-
|Dec | 87%| 98| 94|
24-
|Jan | 86%| 96| 90|
23+
|Dec | 90%| 98| 94|
24+
|Jan | 92%| 96| 90|
2525

2626
Gaile, a resident anesthesiologist at Midwest Medicine, has the following performance data over the last 6 months for SUS-04:
2727

2828
|Month|Performance Level|Top 10% Benchmark|Peer Average|
2929
|-----|-----------------|-----------------|------------|
30-
|Aug | 6/7| 94| 88|
31-
|sep | 16/19| 99| 91|
32-
|Oct | xx%| 95| 88|
33-
|Nov | 89%| 98| 93|
34-
|Dec | 87%| 98| 94|
35-
|Jan | 86%| 96| 90|
30+
|Aug | 88%| 94| 91|
31+
|sep | 89%| 99| 92|
32+
|Oct | 90%| 95| 89|
33+
|Nov | 90%| 98| 91|
34+
|Dec | 91%| 98| 92|
35+
|Jan | 93%| 96| 91|
3636

3737
## Preference data
3838
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.

0 commit comments

Comments
 (0)