Parameters Optimization and Application of SVM Based on PCA-Particle Swarm Algorithm

Authors

  • Qingmi Yang  School of Communication Engineering, Chengdu University of Information Technology, Chengdu, Sichuan, China

DOI:

https://doi.org//10.32628/IJSRSET196431

Keywords:

Support Vector Machine; Principal Component Analysis; Particle Swarm Optimization; parameter optimization

Abstract

The parameter optimization of Support Vector Machine (SVM) has been a hot research direction. To improve the optimization rate and classification performance of SVM, the Principal Component Analysis (PCA) - Particle Swarm Optimization (PSO) algorithm was used to optimize the penalty parameters and kernel parameters of SVM. PSO which is to find the optimal solution through continuous iteration combined with PCA that eliminates linear redundancy between data, effectively enhance the generalization ability of the model, reduce the optimization time of parameters, and improve the recognition accuracy. The simulation comparison experiments on 6 UCI datasets illustrate that the excellent performance of the PCA-PSO-SVM model. The results show that the proposed algorithm has higher recognition accuracy and better recognition rate than simple PSO algorithm in the parameter optimization of SVM. It is an effective parameter optimization method.

References

  1. Vapnik V. The nature of statistical learning theory M. Springer science & business media, 2013.
  2. Huanrui H. New mixed kernel functions of SVM used in pattern recognitionJ. Cybernetics and Information Technologies, 2016, 16(5): 5-14.
  3. Korpela J, Miyaji R, Maekawa T, et al. Toothbrushing performance evaluation using smartphone audio based on hybrid HMM-recognition/SVM-regression modelJ. Journal of Information Processing, 2016, 24(2): 302-313.
  4. Huang C L, Wang C J. A GA-based feature selection and parameters optimization for support vector machinesJ. Expert Systems with applications, 2006, 31(2): 231-240.
  5. Friedrichs F, Igel C. Evolutionary tuning of multiple SVM parametersJ. Neurocomputing, 2005, 64: 107-117.
  6. Eberhart R, Kennedy J. Particle swarm optimizationC//Proceedings of the IEEE international conference on neural networks. 1995, 4: 1942-1948.
  7. Shi Y, Eberhart R. A modified particle swarm optimizerC//1998 IEEE international conference on evolutionary computation proceedings. IEEE world congress on computational intelligence (Cat. No. 98TH8360). IEEE, 1998: 69-73.
  8. Shi Y, Eberhart R C. Empirical study of particle swarm optimizationC//Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406). IEEE, 1999, 3: 1945-1950.
  9. Gaspar P, Carbonell J, Oliveira J L. On the parameter optimization of Support Vector Machines for binary classificationJ. Journal of integrative bioinformatics, 2012, 9(3): 33-43.

Downloads

Published

2019-08-30

Issue

Section

Research Articles

How to Cite

[1]
Qingmi Yang, " Parameters Optimization and Application of SVM Based on PCA-Particle Swarm Algorithm, International Journal of Scientific Research in Science, Engineering and Technology(IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 6, Issue 4, pp.325-330, July-August-2019. Available at doi : https://doi.org/10.32628/IJSRSET196431