Abstract
dc:description.abstract<p>The problem of pattern classification is considered for the case of multicategory classification where the number of classes, <i>k</i>, is greater than two. Many classification algorithms are in fast 2-class classifiers and are generalised to solve <i>k</i>-class problems. Which classifiers are naturally multicategory and the nature of the generalisation of a 2-class classifier to <i>k</i> classes is not often investigated. A thorough analysis of multicategory classification is given in this thesis which provides a new taxonomy of popular classification algorithms, and goes on to derive these from a probabilistic viewpoint. A clear distinction is made between classifiers that partition the input space and those that partition the set of <i>k</i> classes. Of the classifiers which partition the set of classes, the one-of-<i>n</i>, pairwise, and hierarchical methods of decomposition are shown to be equivalent in the knowledge of the true data distributions. The scaling properties of these algorithms are analysed for increasing <i>k</i>. The effects of learning models on finite data are then investigated to show the practical differences between each decomposition.</p><p>In classification problems with many classes it is commonly the case that different classes exhibit wildly different properties. In this case it is unreasonable to expect to be able to summarise these properties by using features designed to represent all the classes. In contrast, features should be designed to represent subsets of classes that exhibit common properties without regard to any class outside the subset. The value for classes outside the subset may be meaningless, or simply undefined. The multicategory classification schemes proposed explicitly deal with such class-dependent features, and attractive properties of these classifiers are demonstrated for a real-world handwritten digit recognition application.</p>
Degree
thesis:*- Name dc:type.qualificationname
- Ph.D.
- Level dc:type.qualificationlevel
- doctoral
- Grantor dc:publisher.institution
- University of Southampton
- Year dc:date.issued
- 2001
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Bailey, Alex
Rights
- Language dc:language
- English, eng