Andreas Haupt

Digital Fellows

There’s such a long history on running randomized controlled trials in companies, and now everyone is evaluating AI. It felt too clear that we need to evaluate AI with the humans. That led to centaur evaluations.

Areas of Research

Andreas Haupt is an AI Institute Fellow-in-Residence at Schmidt Sciences, a Digital Fellow at the Stanford Digital Economy Lab, and a Technology and Human Rights Fellow at the Harvard Kennedy School. He studies how algorithmic systems represent and are evaluated against diverse human preferences, using methods from microeconomic theory, structural econometrics, and reinforcement learning.

His work has been published in AI venues such as NeurIPS and ICML, in computer science venues such as ACM EC, ACM RecSys, and ACM FAccT, and as a lead article in the American Economic Review.

Centaur Evaluations

Researchers: Andreas Haupt, Erik Brynjolfsson

AISPA: User-Centric System Prompt Auditing for Large Language Model Applications

Authors: Xiangning Lin et al.

TaskNet

Understanding how AI is reshaping work requires an accurate account of the tasks workers perform. We introduce the Stanford Task Network (TaskNet), an occupational taxonomy grounded directly in workers’ accounts of their everyday work.

Researchers: Jennifer Wang, Andreas Haupt, Isaac Robinson, Phil Lewis, Erik Brynjolfsson, Diyi Yang, Adam Gill, Luca Vendraminelli, Andrew Wang, Natania Wong