Conducting Recommender Systems User Studies Using POPROX
, , and . 2024. Conducting Recommender Systems User Studies Using POPROX. Tutorial presented at Proceedings of the 18th ACM Conference on Recommender Systems (RecSys '24), Oct 14–18, 2024. pp. 1277–1278. DOI 10.1145/3640457.3687092.
Abstract
The Platform for OPen Recommendation and Online eXperimentation (POPROX) is a new resource to allow RecSys researchers to conduct online user research without having to develop all of the necessary infrastructure and recruit users. Our first domain is personalized news recommendations – POPROX 1.0 provides a daily newsletter (with content from the Associated Press) to users who have already consented to participate in research, along with interfaces and protocols to support researchers in conducting studies that assign subsets of users to various experimental algorithms and/or interfaces.
The purpose of this tutorial is to introduce the platform and its capabilities to prospective research users while walking through the implementation of a sample experiment so that researchers can proceed to propose and carry out experiments on the POPROX platform.