Journal of Guangxi Normal University(Natural Science Edition) ›› 2019, Vol. 37 ›› Issue (1): 71-79.doi: 10.16088/j.issn.1001-6600.2019.01.008

Previous Articles     Next Articles

Multi-label Classification Based on the Deep Autoencoder

NIE Yu1,2,3*, LIAO Xiangwen1,2,3*, WEI Jingjing4, YANG Dingda1,2,3, CHEN Guolong1,2,3   

  1. 1. College of Mathematics and Computer Science, Fuzhou University, Fuzhou Fujian 350116, China;
    2. Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing (Fuzhou University), Fuzhou Fujian 350116, China;
    3. Digital Fujian Institute of Financial Big Data, Fuzhou University, Fuzhou Fujian 350116, China;
    4. College of Electronics and Information Science, Fujian Jiangxia University, Fuzhou Fujian 350108, China
  • Received:2018-09-25 Published:2019-01-08

PDF (PC)

322

Abstract: For the issue of multi-label classification, most existing methods only take the neighborhood information into consideration and ignore the structural similarity, leading to the low accuracy of classification. Therefore, a deep autoencoder for multi-label classification is proposed in this paper. In order to capture the global network structure, this method uses orbit counting algorithm (Orca) to calculate structural similarity of each node, which is the input information of the representations in the latent space. Then, the highly-nonlinear network structure can be well preserved by jointly optimizing the global structure and the neighborhood structure in the proposed model. Finally, SVM is used to classify the nodes according to the nodes vectors obtained from the latent space. Three real-world networks are used to conduct the experiment and the results show that the new model outperforms the state-of-the-art methods in multi-label classification.

Key words: multi-label classification, network embedding, structural similarity, deep autoencoder

CLC Number: 

  • TP391
[1] LIU H, LI X, ZHANG S. Learning instance correlation functions for multilabel classification[J]. IEEE Transactions on Cybernetics, 2016, 47(2):499-510.
[2] TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Mining multi-label data[C]//MAIMON O, ROKACH L. Data Mining and Knowledge Discovery Handbook.New York:Springer, 2009:667-685.
[3] BOUTELL M R, LUO J, SHEN X, et al. Learning multi-label scene classification[J]. Pattern Recognition, 2004, 37(9): 1757-1771.
[4] TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Randomk-labelsets for multilabel classification[J]. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7): 1079-1089.
[5] ZHANG M L, ZHOU Z H. Multilabel neural networks with applications to functional genomics and text categorization[J]. IEEE Transactions on Knowledge and Data Engineering, 2006, 18(10): 1338-1351.
[6] BENBOUZID D, CASAGRANDE N. MULTIBOOST: a multi-purpose boosting package[J]. Journal of Machine Learning Research, 2012, 13(1): 549-553.
[7] ZHANG M L, ZHOU Z H. ML-KNN: A lazy learning approach to multi-label learning[J]. Pattern Recognition, 2007, 40(7): 2038-2048.
[8] XU J. Multi-label weighted k-nearest neighbor classifier with adaptive weight estimation[C]//International Conference on Neural Information Processing. Berlin: Springer, 2011:79-88.
[9] ELISSEEFF A, WESTON J. A kernel method for multi-labelled classification[C]//International Conference on Neural Information Processing Systems: Natural and Synthetic.Cambridge,MA:MIT Press, 2001:681-687.
[10] ROWEIS S T, SAUL L K. Nonlinear dimensionality reduction by locally linear embedding[J]. Science, 2000, 290(5500): 2323.
[11] BELKIN M, NIYOGI P. Laplacian eigenmaps for dimensionality reduction and data representation[J]. Neural Computation, 2014, 15(6):1373-1396.
[12] TENENBAUM J B, SILVA, LANGFORD J C. A global geometric framework for nonlinear dimensionality reduction[J]. Science, 2000, 290(5500): 2319.
[13] 涂存超, 杨成, 刘知远,等. 网络表示学习综述[J]. 中国科学:信息科学, 2017,47(8):980-996.
[14] PEROZZI B, AL-RFOU R, SKIENA S. DeepWalk:online learning of social representations[C]//Acm Sigkdd International Conference on Knowledge Discovery and Data Mining.New York:ACM, 2014:701-710.
[15] MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality[J]. Advances in Neural Information Processing Systems, 2013, 26:3111-3119.
[16] CAO S, LU W, XU Q. GraRep: Learning graph representations with global structural information[C]//ACM International on Conference on Information and Knowledge Management. New York: ACM, 2015:891-900.
[17] TANG J, QU M, WANG M Z, et al. Line: large-scale information network embedding[C].Proceedings of the 24th International Conference on World Wide Web.[s.l.]:International World Wide Web Conferences Steering Committee, 2015:1067-1077.
[18] GROVER A, LESKOVEC J. Node2vec: scalable feature learning for networks[C]//Acm Sigkdd International Conference on Knowledge Discovery and Data Mining.New York:ACM, 2016:855.
[19] WANG D, CUI P, ZHU W. Structural deep network embedding[C]//ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM,2016:1225-1234.
[20] HOCˇEVAR T, DEMČAR J. A combinatorial approach to graphlet counting[J]. Bioinformatics, 2014, 30(4): 559.
[21] TANG L, LIU H. Relational learning via latent social dimensions[C]//ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York:ACM, 2009:817-826.
[1] ZHANG Canlong, LI Yanru, LI Zhixin, WANG Zhiwen. Block Target Tracking Based on Kernel Correlation Filter and Feature Fusion [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(5): 12-23.
[2] WANG Jian, ZHENG Qifan, LI Chao, SHI Jing. Remote Supervision Relationship Extraction Based on Encoder and Attention Mechanism [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(4): 53-60.
[3] XIAO Yiqun, SONG Shuxiang, XIA Haiying. Fast Pedestrian Detection Method Based on Multi-Features    and Implementation [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(4): 61-67.
[4] WANG Xun, LI Tinghui, PAN Xiao, TIAN Yu. Image Segmentation Method Based on Improved Fuzzy C-means Clustering and Otsu Maximum Variance [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(4): 68-73.
[5] CHEN Feng,MENG Zuqiang. Topic Discovery in Microblog Based on BTM and Weighting K-Means [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(3): 71-78.
[6] ZHANG Suiyuan, XUE Yuanhai, YU Xiaoming, LIU Yue, CHENG Xueqi. Research on Short Summary Generation of Multi-Document [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 60-74.
[7] SUN Ronghai, SHI Linfu, HUANG Liyan, TANG Zhenjun, YU Chunqiang. Reversible Data Hiding Based on Image Interpolation and Reference Matrix [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 90-104.
[8] ZHU Yongjian, PENG Ke, QI Guangwen, XIA Haiying, SONG Shuxiang. Defect Detection of Solar Panel Based on Machine Vision [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 105-112.
[9] WU Wenya,CHEN Yufeng,XU Jin’an,ZHANG Yujie. High-level Semantic Attention-based Convolutional Neural Networks for Chinese Relation Extraction [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 32-41.
[10] YUE Tianchi, ZHANG Shaowu, YANG Liang, LIN Hongfei, YU Kai. Stance Detection Method Based on Two-Stage Attention Mechanism [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 42-49.
[11] YU Chuanming,LI Haonan,AN Lu. Analysis of Text Emotion Cause Based on Multi-task Deep Learning [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 50-61.
[12] LIN Yuan, LIU Haifeng, LIN Hongfei, XU Kan. Group Ranking Methods with Loss Function Incorporation [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 62-70.
[13] WANG Qi,QIU Jiahui,RUAN Tong,GAO Daqi,GAO Ju. Recurrent Capsule Network for Clinical Relation Extraction [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 80-88.
[14] WAN Fucheng,MA Ning,HE Xiangzhen. Tibetan Information Extraction Technology Integrated with Event Feature and Semantic Role Labeling [J]. Journal of Guangxi Normal University(Natural Science Edition), 2018, 36(2): 18-23.
[15] XIA Haiying,LIU Weitao,ZHU Yongjian. An Improved Fast SUSAN Chessboard Corner Detection Algorithm [J]. Journal of Guangxi Normal University(Natural Science Edition), 2018, 36(1): 44-52.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © Journal of Guangxi Normal University(Natural Science Edition), All Rights Reserved.
Tel: 0773-5857325　E-mail: gxsdzkb@mailbox.gxnu.edu.cn
Powered by Beijing Magtech Co. Ltd