Geographic Information Sciences Commons^™

Towards Understanding The Geospatial Skills Of Chatgpt: Taking A Geographic Information Systems (Gis) Exam, Peter Mooney, Wencong Cui, Boyuan Guan, Levente Juhasz

GIS Center

This paper examines the performance of ChatGPT, a large language model (LLM), in a geographic information systems (GIS) exam. As LLMs like ChatGPT become increasingly prevalent in various domains, including education, it is important to understand their capabilities and limitations in specialized subject areas such as GIS. Human learning of spatial concepts significantly differs from LLM training methodologies. Therefore, this study aims to assess ChatGPT's performance and ability to grasp geospatial concepts by challenging it with a real GIS exam. By analyzing ChatGPT's responses and evaluating its understanding of GIS principles, we gain insights into the potential applications and challenges …