Modern Threats to Online Surveys: An Interactive Workshop on Bots, Repeat Respondents, and Data Quality Checks

Location: Grand Ballroom I

Presenters: Andrea Low (UCLA Anderson), Kianté Fernandez (UCLA Anderson), Jon Bogard (Washington University), and Craig Fox (UCLA Anderson)

Advances in AI and automation have introduced novel and increasingly sophisticated threats to data integrity in online behavioral research, including bot-generated responses and mass participation from survey farms. This workshop directly tackles the urgent challenge of ensuring response authenticity in online studies. Participants will take part in live demonstrations, collaborative problem-solving, and real-time testing of community-sourced quality checks. Using actual bots, we will stress-test both existing and newly developed detection methods in real time. The session concludes with the launch of a curated repository of validated tools aimed at strengthening data quality practices.

Citation

If you use these materials, please cite:

Low, A., Fernandez, K., Bogard, J., & Fox, C. R. (2025). Modern threats to online surveys: An interactive workshop on bots, repeat respondents, and data quality checks [Workshop materials]. Society for Judgment and Decision Making (SJDM) 2025. https://github.com/kiante-fernandez/sjdm-data-validation-workshop

BibTeX:

@misc{low2025modernthreats,
  author       = {Low, Andrea and Fernandez, Kiant{\'e} and Bogard, Jon and Fox, Craig R.},
  title        = {Modern Threats to Online Surveys: An Interactive Workshop on Bots, Repeat Respondents, and Data Quality Checks},
  year         = {2025},
  howpublished = {Workshop presented at the Society for Judgment and Decision Making (SJDM) 2025},
  url          = {https://github.com/kiante-fernandez/sjdm-data-validation-workshop}
}