Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 2 of 2
Full-Text Articles in Physical Sciences and Mathematics
Incremental Test Collections, Ben Carterette, James Allan
Incremental Test Collections, Ben Carterette, James Allan
Computer Science Department Faculty Publication Series
Corpora and topics are readily available for information retrieval research. Relevance judgments, which are necessary for system evaluation, are expensive; the cost of obtaining them prohibits in-house evaluation of retrieval systems on new corpora or new topics. We present an algorithm for cheaply constructing sets of relevance judgments. Our method intelligently selects documents to be judged and decides when to stop in such a way that with very little work there can be a high degree of confidence in the result of the evaluation. We demonstrate the algorithm's effectiveness by showing that it produces small sets of relevance judgments that …
Strategy-Based Interactive Cluster Visualization For Information Retrieval, Anton Leuski, James Allan
Strategy-Based Interactive Cluster Visualization For Information Retrieval, Anton Leuski, James Allan
Computer Science Department Faculty Publication Series
In this paper we investigate a general purpose interactive information organization system. The system organizes documents by placing them into 1-, 2-, or 3- dimensional space based on their similarity and a springembedding algorithm. We begin by developing a method for estimating the quality of the organization when it is applied to a set of documents returned in response to a query. We show how the relevant documents tend to clump together in space. We proceed by presenting amethod for measuring the amount of structure in the organization and explain how this knowledge can be used to refine the system. …