Support vector machine optimization via margin distribution analysis

Donald Waagen; Mary Cassabaum; Harry A. Schmitt; Bruce Pollock

doi:10.1117/12.487379

16 September 2003 Support vector machine optimization via margin distribution analysis

Donald Waagen, Mary Cassabaum, Harry A. Schmitt, Bruce Pollock

Proceedings Volume 5094, Automatic Target Recognition XIII; (2003) https://doi.org/10.1117/12.487379
Event: AeroSense 2003, 2003, Orlando, Florida, United States

Abstract

Support Vector Machines (SVMs) have generated excitement and interest in the pattern recognition community due to their generalization, performance, and ability to operate in high dimensional feature spaces. Although SVMs are generated without the use of user-specified models, required hyperparameters, such as Gaussian kernel width, are usually user-specified and/or experimentally derived. This effort presents an alternative approach for the selection of the Gaussian kernel width via analysis of the distributional characteristics of the training data projected on the 'trained' SVM (margin values). The efficacy of a particular kernel width can be visually determined via one-dimensional density estimate plots of the training data margin values. Projecting the data onto the SVM hyperplane allows the one-dimensional analysis of the data from the viewpoint of the 'trained' SVM. The effect of kernel parameter selection on class-conditional margin distributions is demonstrated in the one-dimensional projection subspace, and a criterion for unsupervised optimization of kernel width is discussed. Empirical results are given for two classification problems: the 'toy' checkerboard problem and a high dimensional classification problem using simulated High-Resolution Radar (HRR) targets projected into a wavelet packet feature space.

Citation Download Citation

Donald Waagen, Mary Cassabaum, Harry A. Schmitt, and Bruce Pollock "Support vector machine optimization via margin distribution analysis", Proc. SPIE 5094, Automatic Target Recognition XIII, (16 September 2003); https://doi.org/10.1117/12.487379

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available