Journal Home > Volume 3 , Issue 1
International Journal of Crowd Science 2019, 3(1): 87-103 https://doi.org/10.1108/IJCS-09-2018-0025
Research paper | Open Access | Issue | Published: 13 November 2018

Exploring the relationships between gamification and motivational needs in technology design

Show Author's Information Jian Tang1( ),  Ping Zhang2
School of Information, Central University of Finance and Economics, Beijing, China
School of Information Studies, Syracuse University, Syracuse, New York, USA
Keywords:
Gamification, Human-computer interaction, Basic human needs, Motivational affordances
Cite this article:
Tang J, Zhang P. Exploring the relationships between gamification and motivational needs in technology design. International Journal of Crowd Science, 2019, 3(1): 87-103. https://doi.org/10.1108/IJCS-09-2018-0025
Download citation
EndNote(RIS)
BibTeX

405

Views

21

Downloads

Citations

14

Crossref

N/A

WoS

12

Scopus

N/A

CSCD

Abstract Full text About this article
Purpose

Drawing upon the motivational affordance theory, this paper aims to investigate how gamification design and human motivational needs are associated in extant literature.

Design/methodology/approach

The authors conducted a literature analysis of 60 journal articles that studied motivational influences of gamification in information technology design. Content analysis was used to identify game design features and motivation variables studied in prior literature, and correspondence analysis was used to show the co-occurrence of game design features and basic motivational needs.

Findings

The results showed that four types of game design features and eight basic motivational needs are studied in this pool of literature. Correspondence analysis indicates some interesting associations between game design features and basic human needs.

Research limitations/implications

This research used a motivational affordance perspective to interpret the impact of game design features and suggested directions for future investigations. It is limited due to its sample size and considered as an exploratory study.

Practical implications

This research provided suggestions for technology designers that game design features vary in their motivational influence, and therefore, game design features should be used accordingly to meet users’ motivational needs.

Originality/value

This research is one of initial studies which explored the association between game design features and basic motivational needs. The findings of this study provide the groundwork for guidelines and strategies to facilitate motivational design in information technology.


menu
Abstract
Full text
Outline
About this article

Exploring the relationships between gamification and motivational needs in technology design

Show Author's information Jian Tang1( ), Ping Zhang2
School of Information, Central University of Finance and Economics, Beijing, China
School of Information Studies, Syracuse University, Syracuse, New York, USA

Abstract

Purpose

Drawing upon the motivational affordance theory, this paper aims to investigate how gamification design and human motivational needs are associated in extant literature.

Design/methodology/approach

The authors conducted a literature analysis of 60 journal articles that studied motivational influences of gamification in information technology design. Content analysis was used to identify game design features and motivation variables studied in prior literature, and correspondence analysis was used to show the co-occurrence of game design features and basic motivational needs.

Findings

The results showed that four types of game design features and eight basic motivational needs are studied in this pool of literature. Correspondence analysis indicates some interesting associations between game design features and basic human needs.

Research limitations/implications

This research used a motivational affordance perspective to interpret the impact of game design features and suggested directions for future investigations. It is limited due to its sample size and considered as an exploratory study.

Practical implications

This research provided suggestions for technology designers that game design features vary in their motivational influence, and therefore, game design features should be used accordingly to meet users’ motivational needs.

Originality/value

This research is one of initial studies which explored the association between game design features and basic motivational needs. The findings of this study provide the groundwork for guidelines and strategies to facilitate motivational design in information technology.

Keywords: Gamification, Human-computer interaction, Basic human needs, Motivational affordances

References(87)

Adukaite, A., van Zyl, I., Er, Ş. and Cantoni, L. (2017), “Teacher perceptions on the use of digital gamified learning in tourism education: the case of South African secondary schools”, Computers and Education, Vol. 111, pp. 172-190.
DOI Google Scholar

Alabbasi, D. (2017), “Exploring graduate students’ perspectives towards using gamification techniques in online learning”, Turkish Online Journal of Distance Education, Vol. 18 No. 3, pp. 180-196.
DOI Google Scholar

Albuquerque, J., Bittencourt, I.I., Coelho, J.A.P.M. and Silva, A.P. (2017), “Does gender stereotype threat in gamified educational environments cause anxiety? An experimental study”, Computers and Education, Vol. 115, pp. 161-170.
DOI Google Scholar

Auvinen, T., Hakulinen, L. and Malmi, L. (2015), “Increasing students’ awareness of their behavior in online learning environments with visualizations and achievement badges”, Ieee Transactions on Learning Technologies, Vol. 8 No. 3, pp. 261-273.
DOI Google Scholar

Aydin, G. (2015), “Adoption of gamified systems: a study on a social media gamification website”,International Journal of Online Marketing, Vol. 5 No. 3, pp. 18-1n/a.
DOI Google Scholar

Aydin, G. (2018), “Effect of demographics on use intention of gamified systems”, International Journal of Technology and Human Interaction, Vol. 14 No. 1, pp. 1-21.
DOI Google Scholar

Bittner, J.V. and Shipper, J. (2014), “Motivational effects and age differences of gamification in product advertising”, Journal of Consumer Marketing, Vol. 31 No. 5, pp. 391-400.
DOI Google Scholar

Boendermaker, W.J., Boffo, M. and Wiers, R.W. (2015), “Exploring elements of fun to motivate youth to do cognitive bias modification”, Games for Health Journal, Vol. 4 No. 6, pp. 434-443.
DOI Google Scholar

Borras-Gene, O., Martiñez-nunez, M. and Fidalgo-Blanco, A. (2016), “New challenges for the motivation and learning in engineering education using gamification in MOOC”, International Journal of Engineering Education, Vol. 32 No. 1, pp. 501-512.
Google Scholar
Broer, J. and Poeppelbuss, J. (2013), “Gamification – a new phenomenon in IS research?”, in 24th Australasian Conference on Information Systems, Melbourne, Australia.

Browne, K., Anand, C. and Gosse, E. (2014), “Gamification and serious game approaches for adult literacy tablet software”, Entertainment Computing, Vol. 5 No. 3, pp. 135-146.
DOI Google Scholar

Buckley, P. and Doyle, E. (2017), “Individualising gamification: an investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market”, Computers and Education, Vol. 106, pp. 43-55.
DOI Google Scholar

Chen, C.H., Liu, G.Z. and Hwang, G.J. (2016), “Interaction between gaming and multistage guiding strategies on students’ field trip mobile learning performance and motivation”, British Journal of Educational Technology, Vol. 47 No. 6, pp. 1032-1050.
DOI Google Scholar

Cheong, C., Filippou, J. and Cheong, F. (2014), “Towards the gamification of learning: investigating student perceptions of game elements”, Journal of Information Systems Education, Vol. 25 No. 3, pp. 233-244.
Google Scholar
Deterding, S. (2011), “Situated motivational affordances of game elements: a conceptual model”, in SIGCHI Conference on Human Factors in Computing Systems 2011, Vancouver, BC, Canada, ACM, New York, NY, 7-12 May.

Ding, L., Kim, C. and Orey, M. (2017), “Studies of student engagement in gamified online discussions”, Computers and Education, Vol. 115, pp. 126-142.
DOI Google Scholar

Fajiculay, J.R., Parikh, B.T., Wright, C.V. and Sheehan, A.H. (2017), “Student perceptions of digital badges in a drug information and literature evaluation course”, Currents in Pharmacy Teaching and Learning, Vol. 9 No. 5, pp. 881-886.
DOI Google Scholar
Flatla, D.R., Gutwin, C., Nacke, L.E., Bateman, S. and Mandryk, R.L. (2011), “Calibration games: making calibration tasks enjoyable by adding motivating game elements”, in Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ACM, Santa Barbara, CA, 16-19 October, pp. 403-412.https://doi.org/10.1145/2047196.2047248
DOI

Fotaris, P., Mastoras, T., Leinfellner, R. and Rosunally, Y. (2016), “Climbing up the leaderboard: an empirical study of applying gamification techniques to a computer programming class”, Electronic Journal of E-Learning, Vol. 14 No. 2, pp. 94-110.
Google Scholar

Frost, R.D., Matta, V. and MacIvor, E. (2015), “Assessing the efficacy of incorporating game dynamics in a learning management system”, Journal of Information Systems Education, Vol. 26 No. 1, pp. 59-70.
Google Scholar

Glynn, D. (2012), “Correspondence analysis. An exploratory technique for identifying usage patterns”, Polysemy and Synonymy. Corpus Methods and Applications in Cognitive Linguistics, pp. 133-180.
Google Scholar

Gonzalez, C.S., Gomez, N., Navarro, V., Cairos, M., Quirce, C., Toledo, P. and Marrero-Gordillo, N. (2016), “Learning healthy lifestyles through active videogames, motor games and the gamification of educational activities”, Computers in Human Behavior, Vol. 55, pp. 529-551.
DOI Google Scholar
Greenacre, M.J. (1984), Theory and Applications of Correspondence Analysis, Academic Press, London.
Hair, J.F., Jr, Black, W.C., Babin, B.J., Anderson, R.E. and Tatham, R.L. (2006), Multivariate Data Analysis, Upper Saddle River, New Jersy.

Hakulinen, L., Auvinen, T. and Korhonen, A. (2015), “The effect of achievement badges on students’ behavior: an empirical study in a university-level computer science course”, International Journal of Emerging Technologies in Learning (Ijet), Vol. 10 No. 1, pp. 18-29.
DOI Google Scholar

Halan, S., Rossen, B., Cendan, J. and Lok, B. (2010), “High score! – Motivation strategies for user participation in virtual human development”, Iva, Vol., No. pp. 482-488.
DOI Google Scholar
Halloluwa, T., Vyas, D., Usoof, H., Hewagamage, K.P. and Sahama, T. (2016), “Gamifying mathematics for primary students in rural Sri Lanka”, in ACM International Conference Proceeding Series.https://doi.org/10.1145/2971485.2971522
DOI

Hamari, J. (2013), “Transforming homo economicus into homo ludens: a field experiment on gamification in a utilitarian peer-to-peer trading service”, Electronic Commerce Research and Applications, Vol. 12 No. 4, pp. 236-245.
DOI Google Scholar

Hamari, J. and Koivisto, J. (2015a), “Why do people use gamification services?”, International Journal of Information Management, Vol. 35 No. 4, pp. 419-431.
DOI Google Scholar

Hamari, J. and Koivisto, J. (2015b), “‘Working out for likes’: an empirical study on social influence in exercise gamification”, Computers in Human Behavior, Vol. 50, pp. 333-347.
DOI Google Scholar
Hamari, J., Koivisto, J. and Sarsa, H. (2014), “Does gamification work?–a literature review of empirical studies on gamification”, in 47th HI International Conference on System Sciences (HICSS), IEEE, pp. 3025-3034.https://doi.org/10.1109/HICSS.2014.377
DOI

Hamzah, W., Ali, N.H., Saman, M.Y.M., Yusoff, M.H. and Yacob, A. (2015a), “Influence of gamification on students’ motivation in using e-learning applications based on the motivational design model”, International Journal of Emerging Technologies in Learning (Ijet), Vol. 10 No. 2, pp. 30-34.
DOI Google Scholar
Hamzah, W.M.A.F.W., Ali, N.H., Mohd Yusoff, M.H., Yusoff, M.H. and Yacob, A. (2015b), “Enhancement of the ARCS model for gamification of learning”, in Proceedings – 2014 3rd International Conference on User Science and Engineering: Experience. Engineer. Engage, i-USEr 2014, pp. 287-291.https://doi.org/10.1109/IUSER.2014.7002718
DOI

Hanus, M.D. and Fox, J. (2015), “Assessing the effects of gamification in the classroom: a longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance”, Computers and Education, Vol. 80, pp. 152-161.
DOI Google Scholar

Hew, K.F., Huang, B., Chu, K.W.S. and Chiu, D.K. (2016), “Engaging asian students through game mechanics: findings from two experiment studies”, Computers and Education, Vol. 92, pp. 221-236.
DOI Google Scholar

Hoffman, D.L. and Franke, G.R. (1986), “Correspondence analysis: graphical representation of categorical data in marketing research”, Journal of Marketing Research (JMR), Vol. 23 No. 3, pp. 213-227.
DOI Google Scholar

Huotari, K. and Hamari, J. (2017), “A definition for gamification: anchoring gamification in the service marketing literature”, Electronic Markets, Vol. 27 No. 1, pp. 21-31.
DOI Google Scholar

Iaremenko, N.V. (2017), “Enhancing english language learners’ motivation through online games”, Information Technologies and Learning Tools, Vol. 59 No. 3, pp. 126-133.
DOI Google Scholar
Ipeirotis, P.G. and Gabrilovich, E. (2015), “Quizz:targeted crowdsourcing with a billion (potential) users”, in International Conference on World Wide Web, pp. 143-154.https://doi.org/10.1145/2566486.2567988
DOI

Kaczmarek, L.D., Misiak, M., Behnke, M., Dziekan, M. and Guzik, P. (2017), “The pikachu effect: social and health gaming motivations lead to greater benefits of pokémon GO use”,Computers in Human Behavior, Vol. 75, pp. 356-363.
DOI Google Scholar

Kim, K. and Ahn, S.J.G. (2017), “The role of gamification in enhancing intrinsic motivation to use a loyalty program”, Journal of Interactive Marketing, Vol. 40, pp. 41-51.
DOI Google Scholar

Koivisto, J. and Hamari, J. (2014), “Demographic differences in perceived benefits from gamification”, Computers in Human Behavior, Vol. 35, pp. 179-188.
DOI Google Scholar

Kwon, K.H., Halavais, A. and Havener, S. (2015), “Tweeting badges: user motivations for displaying achievement in publicly networked environments”, Cyberpsychology Behavior and Social Networking, Vol. 18 No. 2, pp. 93-100.
DOI Google Scholar

Landers, R.N. and Armstrong, M.B. (2017), “Enhancing instructional outcomes with gamification: an empirical test of the technology-enhanced training effectiveness model”, Computers in Human Behavior, Vol. 71, pp. 499-507.
DOI Google Scholar

Landers, R.N., Bauer, K.N. and Callan, R.C. (2017), “Gamification of task performance with leaderboards: a goal setting experiment”, Computers in Human Behavior, Vol. 71, pp. 508-515.
DOI Google Scholar

Lee, T.Y., Dugan, C., Geyer, W., Ratchford, T., Rasmussen, J., Shami, N.S. and Lupushor, S. (2013), “Experiments on motivational feedback for crowdsourced workers”, in Seventh International AAAI Conference on Weblogs and Social Media, pp. 341-350.
Google Scholar

Liu, D., Santhanam, R. and Webster, J. (2017), “Towards meaningful engagement: a framework for design and research of gamified information systems”, MIS Quarterly, Vol. 41 No. 4, pp. 1011-1034.
DOI Google Scholar

Luu, S. and Narayan, A. (2017), “Games at work: examining a model of team effectiveness in an interdependent gaming task”, Computers in Human Behavior, Vol. 77, pp. 110-120.
DOI Google Scholar

Malas, R.I. and Hamtini, T.M. (2016), “A gamified e-learning design model to promote and improve learning”, International Review on Computers and Software (Irecos), Vol. 11 No. 1, pp. 8-19.
DOI Google Scholar
Massung, E., Coyle, D., Cater, K.F., Jay, M. and Preist, C. (2003), “Using crowdsourcing to support pro-environmental community activism”, in CHI 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 371-380.https://doi.org/10.1145/2470654.2470708
DOI

Mekler, E.D., Bruhlmann, F., Tuch, A.N. and Opwis, K. (2017), “Towards understanding the effects of individual gamification elements on intrinsic motivation and performance”,Computers in Human Behavior, Vol. 71, pp. 525-534.
DOI Google Scholar

Morillas Barrio, C., Munoz-Organero, M. and Sanchez Soriano, J. (2016), “Can gamification improve the benefits of student response systems in learning? An experimental study”, IEEE Transactions on Emerging Topics in Computing, Vol. 4 No. 3, pp. 429-438.
DOI Google Scholar

Morschheuser, B., Hamari, J., Koivisto, J. and Maedche, A. (2017), “Gamified crowdsourcing: Conceptualization, literature review, and future agenda”, International Journal of Human-Computer Studies, Vol. 106, pp. 26-43.
DOI Google Scholar

Nebel, S., Beege, M., Schneider, S. and Rey, G.D. (2016), “The higher the score, the higher the learning outcome? Heterogeneous impacts of leaderboards and choice within educational videogames”, Computers in Human Behavior, Vol. 65, pp. 391-401.
DOI Google Scholar

Nebel, S., Schneider, S., Beege, M. and Rey, G.D. (2017), “Leaderboards within educational videogames: the impact of difficulty, effort and gameplay”, Computers and Education, Vol. 113, pp. 28-41.
DOI Google Scholar

Nelson, E.C., Verhagen, T. and Noordzij, M.L. (2016), “Health empowerment through activity trackers: an empirical smart wristband study”, Computers in Human Behavior, Vol. 62, pp. 364-374.
DOI Google Scholar

Peng, W., Lin, J.-H., Pfeiffer, K.A. and Winn, B. (2012), “Need satisfaction supportive game features as motivational determinants: an experimental study of a self-determination theory guided exergame”, Media Psychology, Vol. 15 No. 2, pp. 175-196.
DOI Google Scholar

Pe-Than, E.P.P., Goh, D.H.-L. and Lee, C.S. (2014), “Making work fun: investigating antecedents of perceived enjoyment in human computation games for information sharing”, Computers in Human Behavior, Vol. 39, pp. 88-99.
DOI Google Scholar

Pitura, J. and Chmielarz, D. (2017), “Creating a comic strip is very creative and thanks to it we learn and remember – student perceptions of a biology challenge in a gamified extracurricular CLIL project”, Teaching English with Technology, Vol. 17 No. 3, pp. 77-95.
Google Scholar
Preist, C., Massung, E. and Coyle, D. (2014), “Competing or aiming to be average? Normification as a means of engaging digital volunteers”, in ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 1222-1233.https://doi.org/10.1145/2531602.2531615
DOI

Prestopnik, N.R. and Tang, J. (2015), “Points, stories, worlds, and diegesis: comparing player experiences in two citizen science games”, Computers in Human Behavior, Vol. 52, pp. 492-506.
DOI Google Scholar
R Development Core Team (2012), R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing: Vienna, Austria [Online], available at: www.R-project.org [Accessed].
Reeve, J. (2005), Understanding Motivation and Emotion, John Wiley and Sons Inc, New York, NY.

Remenyi, D. (1992), “Researching information systems: data analysis methodology using content and correspondence analysis”, Journal of Information Technology, Vol. 7 No. 2, pp. 75-90.
DOI Google Scholar

Rodrigues, L.F., Costa, C.J. and Oliveira, A. (2017), “How does the web game design influence the behavior of e-banking users?”, Computers in Human Behavior, Vol. 74, pp. 163-174.
DOI Google Scholar

Rodrigues, L.F., Oliveira, A. and Costa, C.J. (2016a), “Does ease-of-use contributes to the perception of enjoyment? A case of gamification in e-banking”, Computers in Human Behavior, Vol. 61, pp. 114-126.
DOI Google Scholar

Rodrigues, L.F., Oliveira, A. and Costa, C.J. (2016b), “Playing seriously – how gamification and social cues influence bank customers to use gamified e-business applications”, Computers in Human Behavior, Vol. 63, pp. 392-407.
DOI Google Scholar

Ryan, R.M. and Deci, E.L. (2000), “Intrinsic and extrinsic motivations: classic definitions and new directions”, Contemporary Educational Psychology, Vol. 25 No. 1, pp. 54-67.
DOI Google Scholar

Sailer, M., Hense, J.U., Mayr, S.K. and Mandl, H. (2017), “How gamification motivates: an experimental study of the effects of specific game design elements on psychological need satisfaction”, Computers in Human Behavior, Vol. 69, pp. 371-380.
DOI Google Scholar

Santhanam, R., Liu, D. and Shen, W.C.M. (2016), “Gamification of technology-mediated training: not all competitions are the same”, Information Systems Research, Vol. 27 No. 2, pp. 453-465.
DOI Google Scholar
Schlagenhaufer, C. and Amberg, M. (2015), “A descriptive literature review and classification framework for gamification in information systems”, in 32rd European Conference on Information Systems (ECIS), Münster, Germany.

Siemens, J.C., Smith, S., Fisher, D., Thyroff, A. and Killian, G. (2015), “Level up! The role of progress feedback type for encouraging intrinsic motivation and positive brand attitudes in public versus private gaming contexts”, Journal of Interactive Marketing, Vol. 32, pp. 1-12.
DOI Google Scholar

Sigala, M. (2015a), “The application and impact of gamification funware on trip planning and experiences: the case of TripAdvisor’s funware”,Electronic Markets, Vol. 25 No. 3, pp. 189-209.
DOI Google Scholar

Sigala, M. (2015b), “The application and impact of gamification funware on trip planning and experiences: the case of TripAdvisor’s funware”, Electronic Markets, Vol. 25 No. 3, pp. 189-209.
DOI Google Scholar

Snow, E.L., Allen, L.K., Jackson, G.T. and McNamara, D.S. (2015), “Spendency: students’ propensity to use system currency”, International Journal of Artificial Intelligence in Education, Vol. 25 No. 3, pp. 407-427.
DOI Google Scholar

Song, D.L., Ju, P. and Xu, H. (2017), “Engaged cohorts: can gamification engage all college students in class?” Eurasia Journal of Mathematics Science and Technology Education, Vol. 13 No. 7, pp. 3723-3734.
DOI Google Scholar

Su, C.H. (2016), “The effects of students’ motivation, cognitive load and learning anxiety in gamification software engineering education: a structural equation modeling study”, Multimedia Tools and Applications, Vol. 75 No. 16, pp. 10013-10036.
DOI Google Scholar

Su, C.H. (2017), “The effects of students’ learning anxiety and motivation on the learning achievement in the activity theory based gamified learning environment”,Eurasia Journal of Mathematics, Science and Technology Education, Vol. 13 No. 5, pp. 1229-1258.
DOI Google Scholar

Su, C.H. and Cheng, C.H. (2015), “A mobile gamification learning system for improving the learning motivation and achievements”, Journal of Computer Assisted Learning, Vol. 31 No. 3, pp. 268-286.
DOI Google Scholar

Suh, A. and Wagner, C. (2017), “How gamification of an enterprise collaboration system increases knowledge contribution: an affordance approach”, Journal of Knowledge Management, Vol. 21 No. 2, pp. 416-431.
DOI Google Scholar

Suh, A., Cheung, C.M.K., Ahuja, M. and Wagner, C. (2017), “Gamification in the workplace: the Central role of the aesthetic experience”, Journal of Management Information Systems, Vol. 34 No. 1, pp. 268-305.
DOI Google Scholar

Tan, M. and Hew, K.F. (2016), “Incorporating meaningful gamification in a blended learning research methods class: examining student learning, engagement, and affective outcomes”, Australasian Journal of Educational Technology, Vol. 32 No. 5, pp. 19-34.
Google Scholar

Wang, J.H., Chen, S.Y. and Chan, T.W. (2016), “An investigation of a joyful peer response system: High ability vs low ability”, International Journal of Human-Computer Interaction, Vol. 32 No. 6, pp. 431-444.
DOI Google Scholar

Yang, Y., Asaad, Y. and Dwivedi, Y. (2017), “Examining the impact of gamification on intention of engagement and brand attitude in the marketing context”, Computers in Human Behavior, Vol. 73, pp. 459-469.
DOI Google Scholar

Zarzycka-Piskorz, E. (2016), “Kahoot it or not? Can games be motivating in learning grammar?”, Teaching English with Technology, Vol. 16 No. 3, pp. 17-36.
Google Scholar

Zhang, P. (2008a), “Motivational affordances: fundamental reasons for ICT design and use”, Communications of the Acm, Vol. 51 No. 11, pp. 145-147.
DOI Google Scholar
Zhang, P. (2008b), “Toward a positive design theory: Principles for designing motivating information and communication technology”, Avital, M., Bolland, R. and Cooperrider, D. (Eds), Designing Information and Organizations with a Positive Lens, Emerald Group Publishing Limited, San Diego, CA.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 26 September 2018
Revised: 14 October 2018
Accepted: 15 October 2018
Published: 13 November 2018
Issue date: June 2019

Copyright

© The author(s)

Acknowledgements

Acknowledgements

This research is supported by National Key Research and Development Plan of China (2017YFB1400100) and the Ministry of Education, Humanities and Social Sciences Council in China (grant number 18YJCZH160).

Rights and permissions

Jian Tang and Ping Zhang. Published in International Journal of Crowd Science. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode

Return