Digital Commons Network^™

Lexical Predictability During Natural Reading: Effects Of Surprisal And Entropy Reduction, Matthew W. Lowder, Wonil Choi, Fernanda Ferreira, John M. Henderson

Psychology Faculty Publications

What are the effects of word‐by‐word predictability on sentence processing times during the natural reading of a text? Although information complexity metrics such as surprisal and entropy reduction have been useful in addressing this question, these metrics tend to be estimated using computational language models, which require some degree of commitment to a particular theory of language processing. Taking a different approach, this study implemented a large‐scale cumulative cloze task to collect word‐by‐word predictability data for 40 passages and compute surprisal and entropy reduction values in a theory‐neutral manner. A separate group of participants read the same texts while their …