Michael Ekstrand

Reproducible Recommender Systems Research

I have spent considerable effort implementing software and conducting research to help promote reproducibility in recommender systems research. This has most notably resulted in the LensKit software, an open-source toolkit for recommender systems research. I am still maintaining this software and am active in promoting reproducibility in the RecSys research community.


  • Texas State University Research Enhancement Program: Temporal Evaluation of Recommender Systems ($8000)



Michael D. Ekstrand and Vaibhav Mahant. 2017. Sturgeon and the Cool Kids: Problems with Top-N Recommender Evaluation. In Proceedings of the 30th International Florida Artificial Intelligence Research Society Conference.


Michael D. Ekstrand and Michael Ludwig. 2016. Dependency Injection with Static Analysis and Context-Aware Policy. Journal of Object Technology 15, 1 (February 2016), pp 1:1–31. DOI:10.5381/jot.2016.15.5.a1.

- Michael D. Ekstrand. 2014. *[Towards Recommender Engineering: Tools and Experiments in Recommender Differences](../thesis/)*. Ph.D Thesis, University of Minnesota. -

Michael D. Ekstrand. 2014. Building Open-Source Tools for Reproducible Research and Education. In Sharing, Re-use and Circulation of Resources in Cooperative Scientific Work, a workshop at ACM CSCW 2014.


Michael D. Ekstrand, Michael Ludwig, Joseph A. Konstan, and John T. Riedl. 2011. Rethinking The Recommender Research Ecosystem: Reproducibility, Openness, and LensKit. In Proceedings of the Fifth ACM Conference on Recommender Systems (RecSys '11). ACM, 133–140. DOI:10.1145/2043932.2043958. Acceptance rate: 27% (20% for oral presentation, which this received). Cited 70 times (117 est.).


Michael D. Ekstrand, Michael Ludwig, Jack Kolb, and John T. Riedl. 2011. LensKit: a modular recommender framework. Demo presented at the Fifth ACM Conference on Recommender Systems (RecSys '11). ACM, 349–350. DOI:10.1145/2043932.2044001. Cited 10 times.


Justin J. Levandoski, Michael D. Ekstrand, Michael J. Ludwig, Ahmad Eldawy, Mohamed F. Mokbel, and John T. Riedl. 2011. RecBench: Benchmarks for Evaluating Performance of Recommender System Architectures. Proceedings of the VLDB Endowment 4, 11 (August 2011), 911–920. Acceptance rate: 18%. Cited 6 times.