Journal Home > Volume 1 , Issue 3

Due to the widespread availability of implicit feedback (e.g., clicks and purchases), some researchers have endeavored to design recommender systems based on implicit feedback. However, unlike explicit feedback, implicit feedback cannot directly reflect user preferences. Therefore, although more challenging, it is also more practical to use implicit feedback for recommender systems. Traditional collaborative filtering methods such as matrix factorization, which regards user preferences as a linear combination of user and item latent vectors, have limited learning capacities and suffer from data sparsity and the cold-start problem. To tackle these problems, some authors have considered the integration of a deep neural network to learn user and item features with traditional collaborative filtering. However, there is as yet no research combining collaborative filtering and content-based recommendation with deep learning. In this paper, we propose a novel deep hybrid recommender system framework based on auto-encoders (DHA-RS) by integrating user and item side information to construct a hybrid recommender system and enhance performance. DHA-RS combines stacked denoising auto-encoders with neural collaborative filtering, which corresponds to the process of learning user and item features from auxiliary information to predict user preferences. Experiments performed on the real-world dataset reveal that DHA-RS performs better than state-of-the-art methods.


menu
Abstract
Full text
Outline
About this article

A Novel Deep Hybrid Recommender System Based on Auto-encoder with Neural Collaborative Filtering

Show Author's information Yu LiuShuai WangM. Shahrukh KhanJieyu He( )
School of Computer Science and Engineering, and also with MOE Key Laboratory of Computer Network and Information Integration, Southeast University, Nanjing 211189, China.

Abstract

Due to the widespread availability of implicit feedback (e.g., clicks and purchases), some researchers have endeavored to design recommender systems based on implicit feedback. However, unlike explicit feedback, implicit feedback cannot directly reflect user preferences. Therefore, although more challenging, it is also more practical to use implicit feedback for recommender systems. Traditional collaborative filtering methods such as matrix factorization, which regards user preferences as a linear combination of user and item latent vectors, have limited learning capacities and suffer from data sparsity and the cold-start problem. To tackle these problems, some authors have considered the integration of a deep neural network to learn user and item features with traditional collaborative filtering. However, there is as yet no research combining collaborative filtering and content-based recommendation with deep learning. In this paper, we propose a novel deep hybrid recommender system framework based on auto-encoders (DHA-RS) by integrating user and item side information to construct a hybrid recommender system and enhance performance. DHA-RS combines stacked denoising auto-encoders with neural collaborative filtering, which corresponds to the process of learning user and item features from auxiliary information to predict user preferences. Experiments performed on the real-world dataset reveal that DHA-RS performs better than state-of-the-art methods.

Keywords: hybrid recommender system, neural collaborative filtering, auto-encoder, implicit feedback

References(26)

[1]
J. W. Lu, Y. Guo, Z. Q. Mi, and Y. Yang, Trust-enhanced matrix factorization using PageRank for recommender system, in Proc. 2017 Int. Conf. Computer, Information and Telecommunication Systems, Dalian, China, 2017, pp. 123-127.
DOI
[2]
G. Linden, B. Smith, and J. York, Amazon.com recommendations: Item-to-item collaborative filtering, IEEE Internet Comput., vol. 7, no. 1, pp. 76-80, 2003.
[3]
J. A. Konstan, B. N. Miller, D. Maltz, J. L. Herlocker, L. R. Gordon, and J. Riedl, Grouplens: Applying collaborative filtering to Usenet news, Commun. ACM, vol. 40, no. 3, pp. 77-87, 1997.
[4]
R. Salakhutdinov, A. Mnih, and G. Hinton, Restricted Boltzmann machines for collaborative filtering, in Proc. 24th Int. Conf. Machine Learning, Corvalis, OR, USA, 2007, pp. 791-798.
DOI
[5]
Y. X. Ouyang, W. Q. Liu, W. G. Rong, and Z. Xiong, Autoencoder-based collaborative filtering, in Proc. Int. Conf. Neural Information Processing, Kuching, Malaysia, 2014, pp. 284-291.
DOI
[6]
X. N. He, L. Z. Liao, H. W. Zhang, L. Q. Nie, X. Hu, and T. S. Chua, Neural collaborative filtering, in Proc. 26th Int. Conf. World Wide Web, Perth, Australia, 2017, pp. 173-182.
DOI
[7]
S. Li, J. Kawale, and Y. Fu, Deep collaborative filtering via marginalized denoising auto-encoder, in Proc. 24th ACM Int. Conf. Information and Knowledge Management, Melbourne, Australia, 2015, pp. 811-820.
DOI
[8]
F. Z. Zhang, N. J. Yuan, D. F. Lian, X. Xie, and W. Y. Ma, Collaborative knowledge base embedding for recommender systems, in Proc. 22ndACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2016, pp. 353-362.
DOI
[9]
J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl, Evaluating collaborative filtering recommender systems, ACM Trans. Inf. Syst., vol. 22, no. 1, pp. 5-53, 2004.
[10]
H. Wang, N. Y. Wang, and D. Y. Yeung, Collaborative deep learning for recommender systems, in Proc. 21th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, Sydney, Australia, 2015, pp. 1235-1244.
DOI
[11]
D. D. Lee and H. S. Seung, Algorithms for non-negative matrix factorization, in Proc. 13th Int. Conf. Neural Information Processing Systems, Denver, CO, USA, 2001, pp. 556-562.
[12]
Y. Koren, R. Bell, and C. Volinsky, Matrix factorization techniques for recommender systems, Computer, vol. 42, no. 8, pp. 30-37, 2009.
[13]
R. Salakhutdinov and A. Mnih, Probabilistic matrix factorization, in Proc. 20th Int. Conf. Neural Information Processing Systems, Vancouver, Canada, 2008, pp. 1257-1264.
[14]
H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio, An empirical evaluation of deep architectures on problems with many factors of variation, in Proc. 24th Int. Conf. Machine Learning, Corvalis, OR, USA, 2007, pp. 473-480.
DOI
[15]
K. Georgiev and P. Nakov, A non-IID framework for collaborative filtering with restricted Boltzmann machines, in Proc. 30th Int. Conf. Machine Learning, Atlanta, GA, USA, 2013, pp. 1148-1156.
[16]
Y. Wu, C. DuBois, A. X. Zheng, and M. Ester, Collaborative denoising auto-encoders for top-N recommender systems, in Proc. 9th ACM Int. Conf. Web Search and Data Mining, San Francisco, CA, USA, 2016, pp. 153-162.
DOI
[17]
P. Vincent, H. Larochelle, Y. Bengio, and P. A. Manzagol, Extracting and composing robust features with denoising autoencoders, in Proc. 25th Int. Conf. Machine Learning, Helsinki, Finland, 2008, pp. 1096-1103.
DOI
[18]
R. N. He and J. McAuley, VBPR: Visual Bayesian personalized ranking from implicit feedback, in Proc. 30th AAAI Conf. Artificial Intelligence, Phoenix, AZ, USA, 2016, pp. 144-150.
[19]
M. D. Zeiler and R. Fergus, Visualizing and understanding convolutional networks, in Proc. European Conf. Computer Vision, Zurich, Switzerland, 2014, pp. 818-833.
DOI
[20]
A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural networks, in Proc. 25th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2012, pp. 1097-1105.
[21]
Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, Greedy layer-wise training of deep networks, in Proc. 19th Int. Conf. Neural Information Processing Systems , 2007, pp. 153-160.
[22]
X. N. He, T. Chen, M. Y. Kan, and X. Chen, TriRank: Review-aware explainable recommendation by modeling aspects, in Proc. 24th ACM Int. Conf. Information and Knowledge Management, Melbourne, Australia, 2015, pp. 1661-1670.
DOI
[23]
B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, Item-based collaborative filtering recommendation algorithms, in Proc. 10th Int. Conf. World Wide Web, Hong Kong, China, 2001, pp. 285-295.
DOI
[24]
S. Rendle, Factorization machines, in Proc. 10th Int. Conf. Data Mining, Sydney, Australia, 2010, pp. 995-1000.
DOI
[25]
S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme, BPR: Bayesian personalized ranking from implicit feedback, in Proc. 25th Conf. Uncertainty in Artificial Intelligence, Montreal, Canada, 2009, pp. 452-461.
[26]
D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, arXiv preprint arXiv: 1412.6980, 2014.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 31 January 2018
Accepted: 04 March 2018
Published: 24 May 2018
Issue date: September 2018

Copyright

© The author(s) 2018

Acknowledgements

This work was supported by the National Natural Science Foundation of China (No. 61370077) and Collaborative Innovation Center of Novel Software Technology and Industrialization.

Rights and permissions

Return