Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

Articles

2019

Evaluation dataset

Articles 1 - 1 of 1

Full-Text Articles in Physical Sciences and Mathematics

Capturing And Measuring Thematic Relatedness, Magdalena Kacmajor, John D. Kelleher Jan 2019

Capturing And Measuring Thematic Relatedness, Magdalena Kacmajor, John D. Kelleher

Articles

In this paper we explain the difference between two aspects of semantic relatedness: taxonomic and thematic relations. We notice the lack of evaluation tools for measuring thematic relatedness, identify two datasets that can be recommended as thematic benchmarks, and verify them experimentally. In further experiments, we use these datasets to perform a comprehensive analysis of the performance of an extensive sample of computational models of semantic relatedness, classified according to the sources of information they exploit. We report models that are best at each of the two dimensions of semantic relatedness and those that achieve a good balance between the …