Merge pull request #138 from PovertyAction/release/right-fit-mel

Release of the MEL RFE pages and the A/B testing guide

Author: DavidTorresIPA

CONTRIBUTING.qmd

@@ -5,9 +5,6 @@ abstract: |
   to the IPA Research and Data Science Hub. This guide covers the development
   workflow, writing standards, content creation process, and technical
   requirements for contributors.
-format:
-   html: default
-   gfm: default
 
 freeze: false
 execute:
@@ -171,7 +168,7 @@ See [Quarto guide](./software/quarto/index.qmd) for more details on how to use Q
 
 Example YAML frontmatter:
 
-```yaml
+````yaml
 ---
 title: "My New Page"
 description: "Description of the page content"
@@ -206,7 +203,7 @@ license:
   text: "CC BY-SA"
   url: https://creativecommons.org/licenses/by-sa/4.0/
 ---
-```
+````
 
 ### Special Features
 

_quarto.yml

@@ -22,12 +22,13 @@ website:
     storage: cookies
     anonymize-ip: true
   bread-crumbs: true
-  announcement:
-    icon: none
-    dismissable: false
-    content: "<span>📣 The IPA Research and Data Science Hub is under development [contact us with any feedback](mailto:researchsupport@poverty-action.org) or consider [contributing to the Hub](https://data.poverty-action.org/CONTRIBUTING.html)!</span>"
-    type: light
-    position: above-navbar
+  # announcement:
+
+  #   icon: none
+  #   dismissable: false
+  #   content: "<span>📣 The IPA Research and Data Science Hub is under development [contact us with any feedback](mailto:researchsupport@poverty-action.org) or consider [contributing to the Hub](https://data.poverty-action.org/CONTRIBUTING.html)!</span>"
+  #   type: light
+  #   position: above-navbar
   back-to-top-navigation: true
   page-footer:
     background: light
@@ -59,6 +60,8 @@ website:
         menu:
           - text: "Research Design"
             href: ./research-design/index.qmd
+          - text: "MEL"
+            href: ./monitoring-evaluation-learning/theory-of-change.qmd
           - text: "Research Ethics"
             href: ./research-ethics/index.qmd
           - text: "Data Quality"
@@ -104,8 +107,6 @@ website:
         contents:
           - text: "About Research Design"
             href: ./research-design/index.qmd
-          - text: "Theory of Change"
-            href: ./research-design/theory-of-change.qmd
           - text: "Survey Translation"
             href: ./research-design/survey-translation.qmd
           - text: "Randomization"
@@ -116,6 +117,20 @@ website:
             href: ./research-design/sample-size-power.qmd
           - text: "Addressing Common Criticisms of RCTs"
             href: ./research-design/addressing-rct-criticisms.qmd
+      - section: "Monitoring, Evaluation, and Learning (MEL)"
+        contents:
+          - text: "Theory of Change"
+            href: ./monitoring-evaluation-learning/theory-of-change.qmd
+          - section: "A/B Testing"
+            contents:
+              - text: "About A/B Testing"
+                href: ./monitoring-evaluation-learning/ab-testing/index.qmd
+              - text: "When A/B Testing Works"
+                href: ./monitoring-evaluation-learning/ab-testing/when-ab-tests-works.qmd
+              - text: "Implementing A/B Testing"
+                href: ./monitoring-evaluation-learning/ab-testing/implementing-ab-tests.qmd
+              - text: "Learning Roadmap Guide"
+                href: ./monitoring-evaluation-learning/ab-testing/learning-roadmap-guide.qmd
       - section: "Research Ethics"
         contents:
           - text: "About IPA IRB"
@@ -256,14 +271,20 @@ website:
                 href: ./software/quarto/index.qmd
               - text: "Writing in Quarto"
                 href: ./software/quarto/basics.qmd
+      - section: "Teams"
+        contents:
+          - text: "Research and Data Science"
+            href: ./teams/grds.qmd
+          - text: "Right-Fit Evidence"
+            href: ./teams/rfe.qmd
 # bibliography: references.bib
 
 brand:
   light: assets/design-styles/light-brand.yml
   dark: assets/design-styles/dark-brand.yml
 highlight-style:
-  light: github
-  dark: github-dark
+  light: arrow
+  dark: dracula
 filters:
   - git-dates
 format:

assets/design-styles/index.css

@@ -269,13 +269,18 @@ body.quarto-dark .hello-quarto div.sourceCode {
     }
 
     .feature {
-        width: calc(33% - 30px);
+        width: calc(25% - 30px);
         margin: 20px 0 0 30px;
     }
 }
 
 .feature h3 {
     margin-top: 0;
+    text-align: left;
+}
+
+.feature p {
+    text-align: left;
 }
 
 .feature p:first-of-type {

assets/images/ab-testing-intro.png

@@ -39,7 +39,9 @@ contributors: []
 ![Field Staff Training in Guayaquil, Ecuador (© IPA, 2022)](/assets/images/Ecuador_Training_2022.jpeg){width=75%}
 
 :::{.callout-tip appearance="simple"}
+
 ## Key Takeaways
+
 - Great data starts with **well-trained enumerators** and **clear survey manuals**.
 - Training should cover **ethics & consent, safety, device/software use, instrument mastery, role-plays, and certification**.
 - Plan for **ongoing retraining** guided by **HFCs, back checks, and accompaniment**, not just a one-off event.
@@ -70,6 +72,7 @@ For phone surveys, emphasize call etiquette, privacy checks, contact protocols,
 Every survey team member should receive and carry the field manual. It should be referenced throughout training and updated during fieldwork.
 
 #### **What the manual must include**
+
 - Project overview and partner context (short, practical).
 - **Ethics and consent**: scripts, eligibility, privacy norms, adverse event escalation.
 - **Data security**: device protection, passwords, storage/transfer rules, handling PII.
@@ -93,20 +96,21 @@ Every survey team member should receive and carry the field manual. It should be
 
 :::
 
-
 ## Hiring and selection
-- **Over-invite** to training, within budget, to allow performance-based selection. 
+
+- **Over-invite** to training, within budget, to allow performance-based selection.
 - Use **transparent criteria**: test scores, role-play performance, device skills, professionalism, and reliability.
 - Aim for **balanced teams** (language, gender, locality, experience, etc.)
 - Communicate clearly about contracts, pay, per-diems, schedules, and expectations.
 
 ## Retraining field staff
+
 - **When to retrain**: patterns in HFCs/back checks, new translations, recurrent refusals, protocol drifts, or safety issues.  
 - **How to retrain**:
-  - Review updated manual and highlight changes.
-  - Targeted role-plays on problem modules.
-  - Refresh on tracking/replacements and consent.
-  - Update choice lists and translations that are frequently 'Other'.
+    - Review updated manual and highlight changes.
+    - Targeted role-plays on problem modules.
+    - Refresh on tracking/replacements and consent.
+    - Update choice lists and translations that are frequently 'Other'.
 - **Keep morale up**: short, focused sessions; celebrate improvements.
 
 ::: {.callout-tip}
@@ -126,35 +130,36 @@ Every survey team member should receive and carry the field manual. It should be
 - **One-off training mindset:** Schedule retraining slots in the field plan.
 
 ## Sample 5-day agenda
+
 ::: {.callout-tip collapse="false"}
-**Day 1:** 
+**Day 1:**
 
-  - Orientation
-  - Ethics protocols, informed consent
-  - Safety & security protocols
+- Orientation
+- Ethics protocols, informed consent
+- Safety & security protocols
 
-**Day 2:** 
+**Day 2:**
 
-  - Question-by-question Part I + role-plays
-  - Device and basic survey flows
-  - Short quiz  
+- Question-by-question Part I + role-plays
+- Device and basic survey flows
+- Short quiz  
 
-**Day 3:** 
+**Day 3:**
 
-  - Question-by-question Part II + role-plays
-  - Advanced device flows
-  - Quiz  
+- Question-by-question Part II + role-plays
+- Advanced device flows
+- Quiz  
 
 **Day 4:**
 
-  - Pilot interviews in the field
-  - Learning debrief
-  - Fix issues and resolve questions
+- Pilot interviews in the field
+- Learning debrief
+- Fix issues and resolve questions
 
-**Day 5:** 
+**Day 5:**
 
-  - Quality systems (HFCs, back checks, accompaniment)
-  - Final test
-  - Admin and logistics processes
+- Quality systems (HFCs, back checks, accompaniment)
+- Final test
+- Admin and logistics processes
 
 :::

assets/images/learning-roadmap-ab-testing.png

@@ -90,7 +90,6 @@ This resource provides a quick guide on obtaining and using nonpublic administra
 Qualitative research methods provide invaluable insights into human experiences, behaviors, and systems that drive change. These approaches help bridge the gap between quantitative data and the realities of individuals and communities participating in research studies.
 :::
 
-
 ## Training & Field Preparation
 
 ::: {.callout-tip appearance="simple"}

assets/images/prioritization-matrix.png

@@ -1,5 +1,5 @@
 ---
-pagetitle: "Research and Data Science Hub"
+pagetitle: "IPA Knowledge Hub"
 page-layout: custom
 section-divs: false
 toc: false
@@ -14,11 +14,11 @@ hide-description: true
 
 ::: {.hero-text}
 
-# Welcome to the IPA Hub
+# Welcome to the IPA Knowledge Hub
 
-## Research and data science resources curated by Innovations for Poverty Action
+## Research, data science, and MEL resources curated by Innovations for Poverty Action
 
-::: {.grid .gap-3 .pb-3 .pt-4}
+::: {.grid .gap-3 .pb-3 .pt-4 .justify-content-center}
 ::: {.g-col-12 .g-col-sm-4}
 [Get Started](./research-design/index.qmd){.btn-action-primary .btn-action .btn .btn-lg .w-100 role="button"}
 :::
@@ -40,7 +40,7 @@ hide-description: true
 
 ### Research Design
 
-Design research grounded in theory of change. Covers sampling strategies, randomization methods, power calculations, measurement frameworks, and implementation best practices for RCTs and other research designs.
+Design research grounded in best practices for measuring impact. Covers sampling strategies, randomization methods, power calculations, measurement frameworks, and implementation best practices for RCTs and other research designs.
 
 ::: {.learn-more}
 [Learn more »](/research-design/index.qmd)
@@ -49,6 +49,17 @@ Design research grounded in theory of change. Covers sampling strategies, random
 
 ::: {.feature}
 
+### MEL
+
+Monitoring, Evaluation, and Learning guidance to help organizations build data-driven learning. Includes A/B testing, theory of change development, and practical resources for continuous learning based on right-fit approaches to data and methods.
+
+::: {.learn-more}
+[Learn more »](/monitoring-evaluation-learning/theory-of-change.qmd)
+:::
+:::
+
+::: {.feature}
+
 ### Research Ethics
 
 Plan for and navigate ethical considerations including informed consent, data privacy, and IRB processes. Provides guidance on ethical compliance, human subjects protection, and institutional review requirements.
@@ -95,7 +106,7 @@ Address common data issues including missing values, outliers, and inconsistenci
 
 ### Software Guides
 
-Learn essential tools for research and data science projects. Provides tutorials and best practices for Stata, Python, R, and other software commonly used in development research, analysis, and software development.
+Learn essential tools for research, data science, and MEL projects. Provides tutorials and best practices for Stata, Python, R, and other software commonly used in research, evaluation, analysis, and software development.
 
 ::: {.learn-more}
 [Learn more »](software/guides/venv.qmd)