support vector machine (SVM) to multi-classification problems. For an N-class problem, a HTL constructs a decision tree up to a depth of
|
. A leaf node of the decision tree is allowed to be placed with a holistic triple learning unit whose generalisation abilities
are assessed and approved. Meanwhile, the remaining nodes in the decision tree each accommodate a standard binary SVM classifier.
The holistic triple classifier is a regression model trained on three classes, whose training algorithm is originated from
a recently proposed implementation technique, namely the least-squares support vector machine (LS-SVM). A major novelty with
the holistic triple classifier is the reduced number of support vectors in the solution. For the resultant HTL-SVM, an upper
bound of the generalisation error can be obtained. The time complexity of training the HTL-SVM is analysed, and is shown to
be comparable to that of training the one-versus-one (1-vs.-1) SVM, particularly on small-scale datasets. Empirical studies
show that the proposed HTL-SVM achieves competitive classification accuracy with a reduced number of support vectors compared
to the popular 1-vs-1 alternative.
- Content Type Journal Article
- Pages 1-11
- DOI 10.1007/s00500-010-0551-9
- Authors
- Xiao-Lei Xia, Queen’s University of Belfast Intelligent Systems and Control, School of Electronics, Electrical Engineering and Computer Science Belfast BT9 5AH UK
- Kang Li, Queen’s University of Belfast Intelligent Systems and Control, School of Electronics, Electrical Engineering and Computer Science Belfast BT9 5AH UK
- George W. Irwin, Queen’s University of Belfast Intelligent Systems and Control, School of Electronics, Electrical Engineering and Computer Science Belfast BT9 5AH UK
- Journal Soft Computing – A Fusion of Foundations, Methodologies and Applications
- Online ISSN 1433-7479
- Print ISSN 1432-7643