Skip to content

Commit 9832f2d

Browse files
mackgalantemackgalante
authored
Merge pull request #113 from Display-Lab/main
Update with main
2 parents 1e27428 + 3001385 commit 9832f2d

File tree

4 files changed

+114
-118
lines changed

4 files changed

+114
-118
lines changed

message_templates/achieve_peer_average.json renamed to message_templates/achieved_peer_average.json

File renamed without changes.

‎vignettes/improving_vignette/readme.md‎

Lines changed: 33 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -8,62 +8,59 @@ A healthcare quality improvement consortium called the Multicenter Perioperative
88
MPOG has received operative case data from last month about Deepa and Gaile's cases and that of their peers. MPOG calculates the following performance information for the measure BP-03:
99

1010
### Healthcare professional performance
11-
Deepa's performance rate for BP-03 has level of 75% for November 2023, 74% for December 2023, and 77% for January 2023. Gaile's performance is 72% for November 2023, 75% for December 2023, and 74% for January 2023.
11+
Deepa's performance rate for BP-03 has level of 85% for November 2023, 86% for December 2023, and 87% for January 2023. Gaile's performance is 92% for November 2023, 94% for December 2023, and 95% for January 2023.
1212

1313
Deepa, a dedicated Certified Registered Nurse Anesthetist (CRNA) at Midwest Medicine, has the following performance data over the last 6 months for BP-03:
1414

1515
|Month|Performance Level|Top 10% Benchmark|Peer Average|
1616
|-----|-----------------|-----------------|------------|
17-
|Aug | | | |
18-
|Sep | | | |
17+
|Aug | 88%| | |
18+
|Sep | 87%| | |
1919
|Oct | 88%| 93| 86|
20-
|Nov | 89%| 96| 88|
21-
|Dec | 87%| 95| 87|
22-
|Jan | 86%| 97| 87|
20+
|Nov | 85%| 96| 88|
21+
|Dec | 86%| 95| 87|
22+
|Jan | 87%| 97| 87|
2323

2424
Gaile, a resident at Midwest Medicine, has the following performance data over the last 6 months for BP-03:
2525

2626
|Month|Performance Level|Top 10% Benchmark|Peer Average|
2727
|-----|-----------------|-----------------|------------|
28-
|Aug | | | |
29-
|Sep | | | |
28+
|Aug | 90%| | |
29+
|Sep | 90%| | |
3030
|Oct | 97%| 94| 85|
31-
|Nov | 96%| 95| 87|
32-
|Dec | 95%| 96| 86|
33-
|Jan | 98%| 97| 84|
31+
|Nov | 92%| 95| 87|
32+
|Dec | 94%| 96| 86|
33+
|Jan | 95%| 97| 84|
3434

3535
## Preference data
3636
Preferences for precision feedback are elicited through a preference survey that providers can take. The preference survey produces a preference model for each provider that, with the provider's permission, is shared with MPOG to maintain. MPOG analyses preferences data that is shared to identify population-level preference segments. These are generates as preference profiles that can serve as a default preference model for an organization, or which can be selected by providers who do not take the preference survey, but who identify preferences that are close enough to their own in the settings menu for the precision feedback system.
3737

38-
Deepa's preference data: (TODO)
38+
Deepa's preference data:
3939
|Motivating information |Utility value|Description |
4040
|-----------------------|-------------|--------------------------------------------------------------------------------|
41-
|Social gain |0.00000 |Performance was previously low, but it has improved to reach the peer benchmark.|
42-
|Social stayed better |0.00000 |Performance is consistently high (no recent change). |
43-
|Worsening |0.00000 |Performance is worsening. |
44-
|Improving |0.00000 |Performance is improving. |
45-
|Social los |0.00000 |Performance was previously high, but it has dropped below the peer average. |
46-
|Social stayed worse |0.00000 |Performance has remained below average (no recent change). |
47-
|Social better |0.00000 |Performance is high this month. |
48-
|Social worse |0.00000 |Performance is low this month. |
49-
|Social approach |0.00000 |Performance is improving, getting closer to the peer benchmark. |
50-
51-
52-
Gaile's preference data: (TODO)
53-
41+
|Social Gain |-8.1654 |Performance was previously low, but it has improved to reach the peer benchmark.|
42+
|Social Stayed Better |-6.2514 |Performance is consistently high (no recent change). |
43+
|Worsening |11.5498 |Performance is worsening. |
44+
|Improving |-5.2654 |Performance is improving. |
45+
|Social Loss |12.1369 |Performance was previously high, but it has dropped below the peer average. |
46+
|Social Stayed Worse |09.8987 |Performance has remained below average (no recent change). |
47+
|Social Better |01.5484 |Performance is high this month. |
48+
|Social Worse |10.5656 |Performance is low this month. |
49+
|Social Approach |-10.2541 |Performance is improving, getting closer to the peer benchmark. |
50+
51+
52+
Gaile's preference data:
5453
|Motivating information |Utility value|Description |
5554
|-----------------------|-------------|--------------------------------------------------------------------------------|
56-
|Social gain |-2.92114 |Performance was previously low, but it has improved to reach the peer benchmark.|
57-
|Social stayed better |-12.76936 |Performance is consistently high (no recent change). |
58-
|Worsening |1.06977 |Performance is worsening. |
59-
|Improving |-0.26266 |Performance is improving. |
60-
|Social loss |2.72075 |Performance was previously high, but it has dropped below the peer average. |
61-
|Social stayed worse |9.97743 |Performance has remained below average (no recent change). |
62-
|Social better |-5.97766 |Performance is high this month. |
63-
|Social worse |-0.05277 |Performance is low this month. |
64-
|Social approach |-0.24384 |Performance is improving, getting closer to the peer benchmark. |
65-
66-
The above tables were taken from Social Loss Vignette - PG
55+
|Social Gain |xx.xxxxx |Performance was previously low, but it has improved to reach the peer benchmark.|
56+
|Social Stayed Better |-11.3618 |Performance is consistently high (no recent change). |
57+
|Worsening |11.6598 |Performance is worsening. |
58+
|Improving |7.58489 |Performance is improving. |
59+
|Social Loss |8.46823 |Performance was previously high, but it has dropped below the peer average. |
60+
|Social Stayed Worse |-3.64987 |Performance has remained below average (no recent change). |
61+
|Social Better |-8.64669 |Performance is high this month. |
62+
|Social Worse |12.1645 |Performance is low this month. |
63+
|Social Approach |-10.6889 |Performance is improving, getting closer to the peer benchmark. |
6764

6865
# Precision feedback message generation
6966
To generate precision feedback, MPOG sends de-identified performance and preference data to a precision feedback system that processes each provider's data with their peer comparator performance data. The precision feedback system produces and evaluates candidate messages using metadata from message templates, then selects an optimal precision feedback message to return to MPOG. The precision feedback system is a knowledge-based system that is comprised of the following parts: 1) A knowledge base, 2) A software pipeline, and 3) A web service.

‎vignettes/social_approach_vignette/readme.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -99,7 +99,7 @@ Mechanisms are factors that the intervention operates through to influence the f
9999
1. `Awareness (knowledge)` - The message may change the recipient's awareness of their performance increasing and nearing a high performance benchmark relative to their peers.
100100
2. `Subjective norms` - The message may influence the recipient by creating or reinforcing their proximity to top/high-performer status within their peer group.
101101
3. `Motivation` - The message may motivate the recipient to keep up their recent performance increase to reach new social status.
102-
4. `Optimism` - *WIP* The message may influence the recipient to continue to be optimistic about their ability to improve their performance.
102+
4. `Optimism` - The message may influence the recipient's confidence in their ability to improve their performance and achieve their goals.
103103

104104
### Outcomes
105105
A successful precision feedback intervention leveraging the social approach pathway should increase clinical process performance improvement.

0 commit comments

Comments
 (0)