Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
Identifying Variable-Length Meaningful Phrases With Correlation Functions, Hyoung-Rae Kim, Philip K. Chan
Identifying Variable-Length Meaningful Phrases With Correlation Functions, Hyoung-Rae Kim, Philip K. Chan
Electrical Engineering and Computer Science Faculty Publications
Finding meaningful phrases in a document has been studied in various information retrieval systems in order to improve the performance. Many previous statistical phrase finding methods had different aim such as document classification. Some are hybridized with statistical and syntactic grammatical methods; others use correlation heuristics between words. We propose a new phrase-finding algorithm that adds correlated words one by one to the phrases found in the previous stage, maintaining high correlation within a phrase. Our results indicate that our algorithm finds more meaningful phrases than an existing algorithm. Furthermore, the previous algorithm could be improved by applying different correlation …