Social and Behavioral Sciences Commons^™

Building A Better Model: Variable Selection To Predict Poverty In Pakistan And Sri Lanka, Marium Afzal, Jonathan Hersh, David Newhouse

Economics Faculty Articles and Research

Numerous studies have developed models to predict poverty, but surprisingly few have rigorously examined different approaches to developing prediction models. This paper applies out of sample validation techniques to household data from Pakistan and Sri Lanka, to compare the accuracy of regional poverty predictions from models derived using manual selection, stepwise regression, and Lasso-based procedures. It also examines how much incorporating publically available satellite data into the model improves its accuracy. The five main findings are that: 1) Lasso tends to outperform both discretionary and stepwise models in Pakistan, where the set of potential predictors is large. 2) Lasso and …