Making Information Systems Good for People
I gave this talk on March 2, 2018 at Boise State Computer Science’s Senior Seminar.
Every day, we interact with countless information systems enhanced by artificial intelligence: Google helps us find what we seek, Amazon and Netflix recommend things for us to buy and watch, Apple News gives us the day’s events, BuzzFeed guides us to related articles, and VISA assesses whether our morning coffee is a fraudulent purchase. These systems deliver immense value, but also have profound influence over how we experience information and the resources and perspectives we see.
In this talk, I will explain the basic principles of modern data-driven artificial intelligence systems, and present some of the work that I and others are doing to measure their human impact and ensure that they are good for the people they affect: that they provide value, minimize harm, and produce outcomes that treat people fairly. I will pay particular attention to recommender systems, the algorithms that suggest products and articles, and how they do or do not meet their users’ needs.
Franklin, Ursula M. 2004. The Real World of Technology. Revised Edition. Toronto, Ont.; Berkeley, CA: House of Anansi Press.
Resnick, Paul, Neophytos Iacovou, Mitesh Suchak, Peter Bergstrom, and John Riedl. 1994. “GroupLens: An Open Architecture for Collaborative Filtering of Netnews.” In ACM CSCW ’94, 175–86. ACM. doi:10.1145/192844.192905.
Sarwar, Badrul, George Karypis, Joseph Konstan, and John Reidl. 2001. “Item-Based Collaborative Filtering Recommendation Algorithms.” In ACM WWW ’01, 285–95. ACM. doi:10.1145/371920.372071.
Sarwar, Badrul M, George Karypis, Joseph A Konstan, and John T Riedl. 2000. “Application of Dimensionality Reduction in Recommender System – A Case Study.” In WebKDD 2000. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.29.8381.
Rishabh Mehrotra, Ashton Anderson, Fernando Diaz, Amit Sharma, Hanna Wallach, and Emine Yilmaz. 2017. Auditing Search Engines for Differential Satisfaction Across Demographics. In Proceedings of the 26th International Conference on World Wide Web Companion (WWW ’17 Companion).
Tolga Bolukbasi, Kai-Wei Chang, James Zou, Venkatesh Saligrama, and Adam Kalai. 2016. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. In Advances in Neural Information Processing Systems 29 (NIPS 2016).
Robyn Speer. 2017. ConceptNet Numberbatch 17.04: better, less-stereotyped word vectors.
Neil Hunt. 2014. 🎞 Quantifying the Value of Better Recommendations.
David Streitfield. 2017. [‘The Internet Is Broken’: @ev Is Trying to Salvage It](https://www.nytimes.com/2017/05/20/technology/evan-williams-medium-twitter-internet.html). New York Times, May 20, 2017.
- Bibblio.org. 2017. Ad-driven media doesn’t care about the truth, and that isn’t going to change