Technical Reports
HPL-2010-147
Click here for full text:
Monte Carlo Study of Taxonomy Evaluation
Ulanov, Alexander; Shevlyakov, Georgy; Lyubomishchenko, Nikolay; Mehra, Pankaj; Polutin, Vladimir
HP Laboratories
HPL-2010-147
Keyword(s): Taxonomy evaluation, taxonomy benchmarks
Abstract: The problems of taxonomy evaluation criteria comparison and corresponding benchmark creation are considered. The classes of Primitive Ideal Taxonomies (PITs), their WordNet and disrupted versions are proposed as the sets of benchmark taxonomies for the comparison of taxonomy evaluation methods. For WordNet PITs and their perturbations, the performances of the structure-based PageRank, FloorRank, and the corpusbased Information Content criteria are studied in Monte Carlo experiment. It is shown that the proposed approach can be used for the ranking of taxonomy evaluation criteria.
5 Pages
Additional Publication Information: To be published and presented at WeBS 2010, Bilbao, Spain.
External Posting Date: October 6, 2010 [Fulltext]. Approved for External Publication
Internal Posting Date: October 6, 2010 [Fulltext]