Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

University of Massachusetts Amherst

Andrew McCallum

Selected Works

Question answering

Publication Year

Articles 1 - 2 of 2

Full-Text Articles in Physical Sciences and Mathematics

Table Extraction For Answer Retrieval, Xing Wei, Bruce Croft, Andrew Mccallum Jan 2004

Table Extraction For Answer Retrieval, Xing Wei, Bruce Croft, Andrew Mccallum

Andrew McCallum

The ability to find tables and extract information from them is a necessary component of question answering and other information retrieval tasks. Documents often contain tables in order to communicate densely packed, multidimensional information. Tables do this by employing layout patterns to efficiently indicate fields and records in two-dimensional form. Their rich combination of formatting and content present difficulties for traditional retrieval techniques. This paper describes techniques for extracting tables from text and retrieving answers from the extracted information. We compare machine learning (especially conditional random fields) and heuristic methods for table extraction. Our approach creates a cell document, which …


Table Extraction Using Conditional Random Fields, David Pinto, Andrew Mccallum, Xing Wei, W. Bruce Croft Jan 2003

Table Extraction Using Conditional Random Fields, David Pinto, Andrew Mccallum, Xing Wei, W. Bruce Croft

Andrew McCallum

The ability to find tables and extract information from them is a necessary component of data mining, question answering, and other information retrieval tasks. Documents often contain tables in order to communicate densely packed, multi-dimensional information. Tables do this by employing layout patterns to efficiently indicate fields and records in two-dimensional form. Their rich combination of formatting and content present difficulties for traditional language modeling techniques, however. This paper presents the use of conditional random fields (CRFs) for table extraction, and compares them with hidden Markov models (HMMs). Unlike HMMs, CRFs support the use of many rich and overlapping layout …