@@ -655,22 +655,20 @@ \section*{Results}
655655participants' quiz performance. On Quiz~3, after viewing both lectures, no
656656participant answered more than three \textit {Four Fundamental Forces }-related
657657questions incorrectly, and all but five participants (out of 50) answered two or
658- fewer questions incorrectly. (This was the only subset of questions about either
659- lecture, across all three quizzes, for which this was true.) Because of this,
660- when we held out one incorrectly answered
661- \textit {Four Fundamental Forces }-related question from a given participant's
662- Quiz~3 responses and estimated their knowledge at its embedding coordinate using
663- the remaining \textit {Four Fundamental Forces }-related questions they answered,
664- for 90\% of participants, that estimate leveraged information about at most a
665- single other question they were \textit {not } able to correctly answer. This
666- homogeneity in participants' success on questions used to estimate their
667- knowledge may have hurt our ability to accurately characterize the specific (and
668- by Quiz~3, relatively few) aspects of the lecture content they did \textit {not }
669- know about. Taken together, these results suggest that our knowledge estimates
670- can reliably distinguish between questions about different content covered by a
671- single lecture, provided there is sufficient diversity in participants' quiz
672- responses to extract meaningful information about both what they know and what
673- they do not know.
658+ fewer incorrectly. (This was the only subset of questions about either lecture,
659+ across all three quizzes, for which this was true.) Because of this, for 90\% of
660+ participants, our within-lecture estimates of their knowledge for \textit {Four
661+ Fundamental Forces }-related questions that they answered incorrectly leveraged
662+ information from at most a single other question they were \textit {not } able to
663+ correctly answer. This likely hampered our ability to accurately characterize
664+ the specific (and by the time they took Quiz~3, relatively few) aspects of the
665+ lecture content these participants did \textit {not } know about, and successfully
666+ distinguish them from the far more numerous aspects of the lecture content they
667+ now \textit {did } know about. Taken together, these results suggest that our
668+ knowledge estimates can reliably distinguish between questions about different
669+ content covered by a single lecture, provided there is sufficient diversity in
670+ participants' quiz responses to extract meaningful information about both what
671+ they know and what they do not know.
674672
675673Finally, when we estimated participants' knowledge for each question about one
676674lecture using their performance on questions (from the same quiz) about the
0 commit comments