Social Media Commons^™

Community-Based Classification Of Noun Phrases In Twitter, Freddy Chong Tat Chua, William W. Cohen, Justin Betterridge, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Many event monitoring systems rely on counting known keywords in streaming text data to detect sudden spikes in frequency. But the dynamic and conversational nature of Twitter makes it hard to select known keywords for monitoring. Here we consider a method of automatically finding noun phrases (NPs) as keywords for event monitoring in Twitter. Finding NPs has two aspects, identifying the boundaries for the subsequence of words which represent the NP, and classifying the NP to a specific broad category such as politics, sports, etc. To classify an NP, we define the feature vector for the NP using not just …