Journal of Guangxi Normal University(Natural Science Edition) ›› 2015, Vol. 33 ›› Issue (4): 55-62.doi: 10.16088/j.issn.1001-6600.2015.04.010

Previous Articles     Next Articles

KNN Imputation Algorithm Based on LPP and l2,1

SU Yi-juan1, SUN Ke2,3 , DENG Zhen-yun2,3, YIN Ke-jun2,3   

  1. 1.College of Computer and Information Engineering,Guangxi Teachers Education University,Nanning Guangxi 530023,China;
    2. College of Computer Science and Information Technology,Guangxi Normal University,Guilin Guangxi 541004, China;
    3.Guangxi Key Lab of Multi-sourceInformation Mining & Security, Guangxi Normal University,Guilin Guangxi 541004, China
  • Received:2015-03-16 Online:2015-12-25 Published:2018-09-21

PDF (PC)

170

Abstract: Traditional KNN missing data filling algorithm does not utilize the correlation between the properties of samples, Neither considers but also does not consider to maintain the sample structures and removes noise samples. In this paper, a method of using training samples to reconstruct the test sample is proposed, which is used for the nearest neighbor missing data imputation. The method makes full use of the correlation between samples, uses the LPP (locality preserving projection) to maintain the data structure in the process of reconstruction, and uses l2,1 norm to remove noise samples. Simulation experiments on UCI data sets show that the proposed method has higher prediction accuracy than the traditional KNN algorithm and Entropy-KNN algorithm based on attribute information entropy.

Key words: missing data imputation, KNN, LPP, reconstruction

CLC Number: 

  • TP181
[1] ZHANG Shi-chao, JIN Zhi, ZHU Xiao-feng. Missing data imputation by utilizing information within incomplete instances[J].Journal of Systems and Software,2011,84(3):452-459.
[2] ZHU Xiao-feng,ZHANG Shi-chao, JIN Zhi,et al.Missing value estimation for mixed-attribute data sets[J].IEEE Trans Knowl Data Eng,2011,23(1):110-121.
[3] ZHANG Shi-chao,ZHANG Cheng-qi.Propagating temporal relations of intervals by matrix[J].Applied Artificial Intelligence,2002,16(1):1-27.
[4] SILVA-RAMIREZ E L, PINO-MEJIAS R, LOPEZ-COELLO M,et al.Missing value imputation on missing completely at random data using multilayer perceptrons[J].Neural Networks,2011,24(1):121-129.
[5] BU Fan-yu,CHEN Zhi-kui ,ZHANG Qing-chen,et al.Incomplete high-dimensional data imputation algorithm using feature selection and clustering analysis on cloud[EB/OL]. (2015-05-06) [2015-06-22]. http://link.springer.com/article/10.1007/s11227-015-1433-9.
[6] RAHMAN M G,ISLAM M Z.FIMUS: a framework for imputing missing values using co-appearance,correlation and similarity analysis[J].Knowl Based Syst,2014,56:311-327.
[7] ZHU Xiao-feng,HUANG Zi,SHEN Heng-tao,et al.Dimensionality reduction by mixed kernel canonical correlation analysis[J].Pattern Recognition,2012,45(8):3003-3016.
[8] ZHU Xiao-feng,HUANG Zi,CHENG Hong,et al.Sparse hashing for fast multimedia search[J].ACM Trans Inf Syst,2013,31(2):9.
[9] ZHU Xiao-feng,HUANG Zi,YANG Yang,et al.Self-taught dimensionality reduction on the high-dimensional small-sized data[J].Pattern Recognition,2013,46(1):215-229.
[10] HE Xiao-fei,NIYOGI P.Locality preserving projections[C]//THRUN S, SAUL L K, SCHOLKOPF B. Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2004:153-160.
[11] QIN Zhen-xing,WANG A T,ZHANG Cheng-qi,et al.Cost-sensitive classification with k-nearest neighbors[C]//Knowledge Science, Engineering and Management:LNCS Volume 8041.Berlin:Springer,2013:112-131.
[12] HAN Jia-wei,KAMBER M,PEI Jian.数据挖掘概念与技术[M].范明,孟小峰,译.北京:机械工业出版社,2012:275-276.
[13] HASTIE T, TIBSHIRANI R, FRIEDMAN J.统计学习基础:数据挖掘、推理与预测[M].范明,柴玉梅,咎红英,译.北京:电子工业出版社2004:28-32.
[14] 王超学,潘正茂,马春森,等. 改进型加权KNN算法的不平衡数据集分类[J].计算机工程,2012,38(20):160-163, 168.
[15] ZHANG Shi-chao,ZHU Man-long.Weighting imputation methods and their evaluation under shell-neighbor machine[C]//Proceeding of 9th IEEE International Conference on Cognitive Informatics. Piscataway, NJ: IEEE Press, 2010:874-879.
[16] ZHU Xiao-feng,HUANG Zi, CUI Jiang-tao , et al.Video-to-shot tag propagation by graph sparse group lasso[J]. IEEE Transactions on Multimedia,2013,15(3): 633-646.
[17] 童先群,周忠眉.基于属性值信息熵的KNN改进算法[J].计算机工程与应用,2010,46(3):115-117.
[1] WU Hao, QIN Lichun, LUO Liurong. Improving Classification Rule with Lift Measure for KNN Classifier [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 75-81.
[2] XUE Yang,ZENG Qingke,XIA Haiying,WANG Wentao. Remote Sensing Image Fusion Based on Convolutional Neural Network Super-resolution Reconstruction [J]. Journal of Guangxi Normal University(Natural Science Edition), 2018, 36(2): 33-41.
[3] ZONG Ming, GONG Yonghong, WEN Guoqiu, CHENG Debo, ZHU Yonghua. kNN Classification Based on Sparse Learning [J]. Journal of Guangxi Normal University(Natural Science Edition), 2016, 34(3): 39-45.
[4] DENG Zhenyun, GONG Yonghong, SUN Ke, ZHANG Jilian. A kNN Classification Algorithm Based on Local Correlation [J]. Journal of Guangxi Normal University(Natural Science Edition), 2016, 34(1): 52-58.
[5] WANG Feng, JIN Xiao-bo, YU Jun-wei, WANG Gui-cai. V-optimal Histogram and Its Application in License Plate Classification [J]. Journal of Guangxi Normal University(Natural Science Edition), 2013, 31(3): 138-143.
[6] LU Guang-quan, XIE Yang-cai, LIU Xing, ZHANG Shi-chao. An Improvement Semi-supervised Learning Based on KNN Classification [J]. Journal of Guangxi Normal University(Natural Science Edition), 2012, 30(1): 45-49.
[7] HE Quan-hao, FAN Xing-hua, ZHOU Peng. Text ClassificationBased on Experimental Study of Two-step Strategy [J]. Journal of Guangxi Normal University(Natural Science Edition), 2011, 29(4): 35-38.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Guangxi Normal University(Natural Science Edition), All Rights Reserved.
Tel: 0773-5857325　E-mail: gxsdzkb@mailbox.gxnu.edu.cn
Powered by Beijing Magtech Co. Ltd