Feature Selection Using Multi Objective Genetic Algorithm with Support Vector Machine

Document Type : Original Research (Full Papers)

Authors

1 Faculty of Computer and Information Technology Engineering, Qazvin Branch, Islamic Azad University, Qazvin, Iran

2 Electrical and Computer Engineering Department, K.N. Toosi University of Technology, Iran

Abstract

Different approaches have been proposed for feature selection to obtain suitable features subset among all features. These methods search feature space for feature subsets which satisfies some criteria or optimizes several objective functions. The objective functions are divided into two main groups: filter and wrapper methods.  In filter methods, features subsets are selected due to some measures like inter-class distance, features statistical independence or information theoretic measures. Even though, wrapper methods use a classifier to evaluate features subsets by their predictive accuracy (on test data) by statistical resampling or cross-validation. Filter methods usually use only one measure for feature selection that does not necessarily produce the best result. In this paper, we proposed to use the classification error measures besides to filter measures where our classifier is support vector machine (SVM). To this end, we use multi objective genetic algorithm. In this way, one of our feature selection measure is SVM classification error. Another measure is selected between mutual information and Laplacian criteria which indicates informative content and structure preserving property of features, respectively. The evaluation results on the UCI datasets show the efficiency of this method.

Keywords

Journal of Computer & Robotics
Volume 9, Issue 2 - Serial Number 2
Summer and Autumn 2016
Pages 11-17

Files

History

  • Receive Date: 01 December 2015
  • Accept Date: 29 January 2016

Share

How to cite

Statistics