Law Commons^™

How Ai Can Learn From The Law: Putting Humans In The Loop Only On Appeal, I. Glenn Cohen, Boris Babic, Sara Gerke, Qiong Xia,, Theodoros Evgeniou, Klaus Wertenbroch

Faculty Scholarly Works

While the literature on putting a “human in the loop” in artificial intelligence (AI) and machine learning (ML) has grown significantly, limited attention has been paid to how human expertise ought to be combined with AI/ML judgments. This design question arises because of the ubiquity and quantity of algorithmic decisions being made today in the face of widespread public reluctance to forgo human expert judgment. To resolve this conflict, we propose that human expert judges be included via appeals processes for review of algorithmic decisions. Thus, the human intervenes only in a limited number of cases and only after an …