Journal of Guangxi Normal University(Natural Science Edition) ›› 2013, Vol. 31 ›› Issue (3): 51-58.

Previous Articles     Next Articles

Classifier of p-norm Regularizing SVM with Nonconvex Conjugate Gradient Algorithm

ZUO Xin, HUANG Hai-long, LIU Jian-wei   

  1. Research Institute of Automation,China University of Petroleum,Beijing 102249,China
  • Received:2013-04-20 Online:2013-09-20 Published:2018-11-26

Abstract: Classical classification algorithm of SVM via p norm regularization usually takes the regularization parameter p as 0,1 or 2.However,large amount of experiments show that these parameters can not always achieve the best classification results.It means finding out the appropriate parameter according to specific dataset may help promote the predictive rate.LIU Jian-wei has already discussed this problem.However,as it is based on the idea of reweighed iteration,it only gets the approximate solution of the original problem.The original problem was solved from the point of optimization when 0<p<1.Three different kinds of SVM have been discussed and the classification results are shown with the experiments on three gene datasets.

Key words: p-norm, support vector machine, conjugate gradient algorithm

CLC Number: 

  • TP18
[1] BOSER B E,GUYON I M,VAPNIK V N.A training algorithm for optimal margin classifiers[C]//Proceedings of the Fifth Annual Workshop on Computational Learning Theory.New York:ACM Press,1992:144-152.
[2] CORTES C,VAPNIK V.Support-vector networks[J].Machine Learning,1995,20:273-297.
[3] WESTON J,ELISSEEFF A,SCHOLKOPF B,et al.Use of the zero-norm with linear models and kernel methods[J].Journal of Machine Learning Research,2003,3:1439-1461.
[4] ZHU Ji,HASTIE T,ROSSET S,et al.1-Norm support vector machines[C]//Neural Information Processing Systems.Cambridge,USA:MIT Press,2004:16.
[5] LIU Zhen-qiu,JIANG Feng,TIAN Guo-liang,et al.Sparse logistic regression with Lp penalty for biomarker identification[J].Statistical Applications in Genetics and molecular Biology,2007,6(1):1-22.
[6] NG A Y.Feature selection,L1 vs.L2 regularization,and rotational invariance[C]//Proc of 21st International Conference on Machine Learning.New York:ACM Press,2004:78.
[7] LIU Yu-feng,WU Yi-chao.Variable selection via a combination of the L0 and L1 penalties[J].Journal of Computational and Graphical Statistics,2007,16(4):782-798.
[8] LIU Yu-feng,ZHANG He-len,CHEOLWOO P,et al.Support vector machines with adaptive Lq penalties[J].Computational Statistics and Data Analysis,2007,51(12):6380-6394.
[9] FLETCHER R,REEVES C M.Function minimization by convergent gradients[J].The Computer Journal,1964,7(2):149-154.
[10] WOLFE P.Convergence conditions for ascent methods[J].SIAM Review,1969,11(2):226-235.
[11] WOLFE P.Convergence conditions for ascent methods Ⅱ:some corrections[J].SIAM Review,1969,13(2):185-188.
[12] MORE J J,THUENTE D J.Line search algorithms with guaranteed sufficient decrease[J].ACM Transactions on Mathematical Software,1994,20:286-307.
[13] HAGER W W,ZHANG Hong-chao.A new conjugate gradient method with guaranted descent and an efficient line search[J].SIAM Optimization,2005,16:170-192.
[14] PYTLAK R.Conjugate gradient algorithm in nonconvex optimization[M].Berlin:Springer,2009.
[15] 刘建伟,李双成,罗雄麟.p范数正则化支持向量机分类算法[J].自动化学报,2012,38:76-87.
[1] ZHU Yongjian, PENG Ke, QI Guangwen, XIA Haiying, SONG Shuxiang. Defect Detection of Solar Panel Based on Machine Vision [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 105-112.
[2] LÜ Kaichen, YAN Hongfei, CHEN Chong. Quantitative Investment Strategy Based on CSI 300 [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 1-12.
[3] LI Ziyan,LIU Weiming. New Method of Moving Vehicle Detection Based on Partial HOG Feature [J]. Journal of Guangxi Normal University(Natural Science Edition), 2017, 35(3): 1-13.
[4] LIU Yanhong, LUO Xiaoshu, CHEN Jin, GUO Lei. Research on Cervical Cell Image Feature Extraction and Recognition [J]. Journal of Guangxi Normal University(Natural Science Edition), 2016, 34(2): 61-66.
[5] CHEN Si-yi, LUO Qiang, HUANG Hui-xian. Division Method of Coordinated Control Sub-areas Based on Group Decision Making Theory and Support Vector Machine [J]. Journal of Guangxi Normal University(Natural Science Edition), 2014, 32(4): 18-25.
[6] WANG Shi-ming, XU Jian-min, LI Ri-han. Improvement on On-ramp Control Algorithm of Urban Freeway [J]. Journal of Guangxi Normal University(Natural Science Edition), 2012, 30(2): 1-6.
[7] YAN Xiao-ming, ZHENG Zhi. Optimizing Parameters of SVM Based on Combined Bionic Algorithm [J]. Journal of Guangxi Normal University(Natural Science Edition), 2011, 29(2): 114-118.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!