This study investigates the combination of four different classification methods for text categorization through experimental comparisons. These methods include the Support Vector Machine, kNN (nearest neighbours), kNN model-based approach (kNNM), and Rocchio methods. We first review these learning methods and the method for combining the classifiers, and then present some experimental results on a benchmark data collection of 20-newsgroup with an emphasis of average group performance - looking at the effectiveness of combining multiple classifiers on each category. In an attempt to see why the combination of the best and the second best classifiers can achieve better performance, we propose an empirical measure called closeness as a basis of our experiments. Based on our empirical study, we verify the hypothesis that when a classifier has the high closeness to the best classifier, their combination can achieve the better performance.
|Title of host publication||Unknown Host Publication|
|Number of pages||10|
|Publication status||Published - 2004|
|Name||LECTURE NOTES IN COMPUTER SCIENCE|
15th International Conference on Database and Expert Systems Applications (DEXA 2004), Zaragoza, SPAIN, AUG 30-SEP 03, 2004; DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS ; Conference date: 01-01-2004