AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Regular Paper

Joint Label-Specific Features and Correlation Information for Multi-Label Learning

School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Show Author Information

Abstract

Multi-label learning deals with the problem where each instance is associated with a set of class labels. In multi-label learning, different labels may have their own inherent characteristics for distinguishing each other, and the correlation information has shown promising strength in improving multi-label learning. In this study, we propose a novel multi-label learning method by simultaneously taking into account both the learning of label-specific features and the correlation information during the learning process. Firstly, we learn a sparse weight parameter vector for each label based on the linear regression model, and the label-specific features can be extracted according to the corresponding weight parameters. Secondly, we constrain label correlations directly on the output of labels, not on the corresponding parameter vectors which conflicts with the label-specific feature learning. Specifically, for any two related labels, their corresponding models should have similar outputs rather than similar parameter vectors. Thirdly, we also exploit the sample correlations through sparse reconstruction. The experimental results on 12 benchmark datasets show that the proposed method performs better than the existing methods. The proposed method ranks in the 1st place at 66.7% case and achieves optimal average rank in terms of all evaluation measures.

Electronic Supplementary Material

Download File(s)
jcst-35-2-247-Highlights.pdf (308.6 KB)

References

[1]

He Z Y, Wu J, Lv P. Multi-label text classification based on the label correlation mixture model. Intelligent Data Analysis Analysis, 2017, 21(6): 1371-1392.

[2]
Kazawa H, Izumitani T, Taira H et al. Maximal margin labeling for multi-topic text categorization. In Proc. the 18th Annual Conference on Neural Information Processing Systems, December 2004, pp.649-656.
[3]

de Almeida A M G, Ricardo C, Paraiso E C et al. Applying multi-label techniques in emotion identification of short texts. Neurocomputing, 2018, 320: 35-46.

[4]
Li Y, Song Y, Luo J. Improving pairwise ranking for multi-label image classification. In Proc. the 30th IEEE Conference on Computer Vision and Pattern Recognition, July 2017, pp.1837-1845.
[5]
Tan M, Shi Q, van den Hengel A et al. Learning graph structure for multi-label image classification via clique generation. In Proc. the 28th IEEE Conference on Computer Vision and Pattern Recognition, June 2015, pp.4100-4109.
[6]

Sun F, Tang J, Li H et al. Multi-label image categorization with sparse factor representation. IEEE Transactions on Image Processing, 2014, 23(3): 1028-1037.

[7]
Trohidis K, Tsoumakas G, Kalliris G et al. Multi-label classification of music into emotions. In Proc. the 9th International Conference on Music Information Retrieval, September 2008, pp.325-330.
[8]
Wu B, Zhong E, Horner A et al. Music emotion recognition by multi-label multi-layer multi-instance multi-view learning. In Proc. the 22nd ACM International Conference on Multimedia, November 2014, pp.117-126.
[9]

Zhang M L, Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8): 1819-1837.

[10]
Zhou Z H, Zhang M L. Multi-label learning. In Encyclopedia of Machine Learning and Data Mining, Sammut C, Webb G (eds.), Springer, 2016.
[11]
Zhang M L, Wu L. Lift: Multi-label learning with label-specific features. In Proc. the 22nd International Joint Conference on Artificial Intelligence, July 2011, pp.1609-1614.
[12]
Huang J, Li G, Huang Q et al. Learning label specific features for multi-label classification. In Proc. the 15th IEEE International Conference on Data Mining, November 2015, pp.181-190.
[13]

Huang J, Li G, Huang Q et al. Joint feature selection and classification for multi-label learning. IEEE Transactions on Cybernetics, 2018, 48(3): 876-889.

[14]

Han H, Huang M, Zhang Y et al. Multi-label learning with label specific features using correlation information. IEEE Access, 2019, 7: 11474-11484.

[15]
Elisseeff A, Weston J. A kernel method for multi-labelled classification. In Proc. the 15th Annual Conference on Neural Information Processing Systems, December 2001, pp.681-687.
[16]

Tsoumakas G, Katakis I, Vlahavas I. Random k-labelsets for multilabel classification. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7): 1079-1089.

[17]
Zhang Q W, Zhong Y, Zhang M L. Feature-induced labeling information enrichment for multi-label learning. In Proc. the 32nd AAAI Conference on Artificial Intelligence, February 2018, pp.4446-4453.
[18]

Zhang J, Li C, Cao D et al. Multi-label learning with label-specific features by resolving label correlations. Knowledge-Based Systems, 2018, 159: 148-157.

[19]

Roweis S T, Saul L K. Nonlinear dimensionality reduction by locally linear embedding. Science, 2000, 290(5500): 2323-2326.

[20]

Read J, Pfahringer B, Holmes G et al. Classifier chains for multi-label classification. Machine Learning, 2011, 85(3): 333-359.

[21]

Boutell M R, Luo J, Shen X et al. Learning multi-label scene classification. Pattern Recognition, 2004, 37(9): 1757-1771.

[22]

Furnkranz J, Hüllermeier E, Mencia E L et al. Multi-label classification via calibrated label ranking. Machine Learning, 2008, 73(2): 133-153.

[23]
Zhang M L, Zhang K. Multi-label learning by exploiting label dependency. In Proc. the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, July 2010, pp.999-1008.
[24]

Xu S, Yang X, Yu H et al. Multi-label learning with label-specific feature reduction. Knowledge-Based Systems, 2016, 104: 52-61.

[25]
Yan Y, Li S, Yang Z et al. Multi-label learning with label-specific feature selection. In Proc. the 24th International Conference on Neural Information Processing, November 2017, pp.305-315.
[26]
Huang S J, Zhou Z H. Multi-label learning by exploiting label correlations locally. In Proc. the 26th AAAI Conference on Artificial Intelligence, July 2012, pp.949-955.
[27]
Lin Z, Ganesh A, Wright J et al. Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. Technical Report, University of Illinois at Urbana-Champaign, 2009. https://www.ideals.illinois.edu/bitstream/handle/2142/74352/B40-DC_246.pdf?sequence=2&isAllowed=y, Dec. 2019.
[28]

Demisar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 2006, 7(1): 1-30.

Journal of Computer Science and Technology
Pages 247-258
Cite this article:
Jia X-Y, Zhu S-S, Li W-W. Joint Label-Specific Features and Correlation Information for Multi-Label Learning. Journal of Computer Science and Technology, 2020, 35(2): 247-258. https://doi.org/10.1007/s11390-020-9900-z

399

Views

29

Crossref

N/A

Web of Science

31

Scopus

4

CSCD

Altmetrics

Received: 01 August 2019
Revised: 02 January 2020
Published: 27 March 2020
©Institute of Computing Technology, Chinese Academy of Sciences 2020
Return