Journal Home > Volume 4 , Issue 2
International Journal of Crowd Science 2020, 4(2): 117-132 https://doi.org/10.1108/IJCS-11-2019-0031
Research paper | Open Access | Issue | Published: 08 April 2020

Utilizing short version big five traits on crowdsouring

Show Author's Information Kousaku Igawa1( ),  Kunihiko Higa2,  Tsutomu Takamiya2
Innovation Management, Tokyo Institute of Technology, Tokyo, Japan
Tokyo Institute of Technology, Tokyo, Japan
Keywords:
Crowdsourcing, Task assignment, Work performance, Human resource, Quality evaluation, Big five
Cite this article:
Igawa K, Higa K, Takamiya T. Utilizing short version big five traits on crowdsouring. International Journal of Crowd Science, 2020, 4(2): 117-132. https://doi.org/10.1108/IJCS-11-2019-0031
Download citation
EndNote(RIS)
BibTeX

789

Views

26

Downloads

Citations

3

Crossref

N/A

WoS

1

Scopus

N/A

CSCD

Abstract Full text About this article
Purpose

The purpose of this paper is to examine the efficacy of the Japanese ten-item personality inventory (TIPI-J), a short version of the big five (BF) questionnaire, on crowdsourcing. The BF traits are indicators of personality and are said to be an effective predictor of study performance in various occupations. BF can be used in crowdsourcing to predict crowd workers’ performance; however, it will be difficult to use in practice for two reasons like the time-and-effort issue and the bias issue. In this study, an empirical analysis is conducted on crowdsourcing to examine if TIPI-J can solve those issues.

Design/methodology/approach

To investigate the issues, two tasks are posted on a crowdsourcing provider. Both TIPI-J and full version BF are conducted before and after selecting crowd workers. Structural validity and convergence validity are tested with correlation analysis between before (TIPI-J) and after (full version BF) data to examine the bias issue. Additionally, those correlations are compared with previous study and significances are examined.

Findings

The correlations in “conscientiousness” is 0.45-0.50, respectively, compared with a previous study, those two correlations did not show significance. This indicates that no clear bias exists.

Originality/value

This is the first research to investigate the efficacy of TIPI-J on crowdsourcing and showed that TIPI-J can be a useful tool for predicting crowd workers’ performance and thus it can help to select appropriate crowd workers.


menu
Abstract
Full text
Outline
About this article

Utilizing short version big five traits on crowdsouring

Show Author's information Kousaku Igawa1( ), Kunihiko Higa2, Tsutomu Takamiya2
Innovation Management, Tokyo Institute of Technology, Tokyo, Japan
Tokyo Institute of Technology, Tokyo, Japan

Abstract

Purpose

The purpose of this paper is to examine the efficacy of the Japanese ten-item personality inventory (TIPI-J), a short version of the big five (BF) questionnaire, on crowdsourcing. The BF traits are indicators of personality and are said to be an effective predictor of study performance in various occupations. BF can be used in crowdsourcing to predict crowd workers’ performance; however, it will be difficult to use in practice for two reasons like the time-and-effort issue and the bias issue. In this study, an empirical analysis is conducted on crowdsourcing to examine if TIPI-J can solve those issues.

Design/methodology/approach

To investigate the issues, two tasks are posted on a crowdsourcing provider. Both TIPI-J and full version BF are conducted before and after selecting crowd workers. Structural validity and convergence validity are tested with correlation analysis between before (TIPI-J) and after (full version BF) data to examine the bias issue. Additionally, those correlations are compared with previous study and significances are examined.

Findings

The correlations in “conscientiousness” is 0.45-0.50, respectively, compared with a previous study, those two correlations did not show significance. This indicates that no clear bias exists.

Originality/value

This is the first research to investigate the efficacy of TIPI-J on crowdsourcing and showed that TIPI-J can be a useful tool for predicting crowd workers’ performance and thus it can help to select appropriate crowd workers.

Keywords: Crowdsourcing, Task assignment, Work performance, Human resource, Quality evaluation, Big five

References(35)

Anderson, G., (1992), and Viswesvaran, C. “An update of the validity of personality scales in personnel selection: a meta-analysis of studies published after 1992”, 13th Annual Conference of the Society of Industrial and Organizational Psychology, Dallas.
Assemi, B. and Schlagwein, D. (2012), “Profile information and business outcomes of providers in electronic service marketplaces: an empirical investigation”, Australasian Conference on Information Systems (ACIS), ACIS, pp. 1-10.

Barrick, M.R. and Mount, M.K. (1991), “The big five personality dimensions and job performance: a meta‐analysis”, Personnel Psychology, Vol. 44 No. 1, pp. 1-26.
DOI Google Scholar

Barrick, M.R., Mount, M.K. and Judge, T.A. (2001), “Personality and performance at the beginning of the new millennium: What do we know and where do we go next?”, International Journal of Selection and Assessment, Vol. 9 Nos 1/2, pp. 9-30.
DOI Google Scholar
Brier, E. and Pearson, R. (2020), “Upwork’s SVP of marketing explain what it takes to perfect an offering that relies on people”, available at: https://techdayhq.com/community/articles/upwork-s-svp-of-marketing-explains-what-it-takes-to-perfect-an-offering-that-relies-on-people, (accessed 23 December 2018).
Costa, P.T. and McCrea, R.R. (1992), “Revised neo personality inventory (neo-pi-r) and neo-five-factor inventory (NEO-FFI)”, Psychological Assessment Resources.

Digman, J.M. and Shmelyov, A.G. (1996), “The structure of temperament and personality in Russian children”, Journal of Personality and Social Psychology, Vol. 71 No. 2, pp. 341-351.
DOI Google Scholar
Downs, J.S., Holbrook, M.B., Sheng, S. and Cranor, L.F. (2010), “Are your participants gaming the system?: screening mechanical Turk workers”, Proceedings of the SIGCHI conference on human factors in computing systems, ACM, 2399-2402.https://doi.org/10.1145/1753326.1753688
DOI

Faullant, R., Holzmann, P. and Schwarz, E.J. (2016), “everybody is invited but not everybody will come – the influence of personality dispositions on users’entry decisions for crowdsourcing competitions”, International Journal of Innovation Management, Vol. 20 No. 6, p. 1650044.
DOI Google Scholar

Feist, G.J. (1998), “A Meta-analysis of personality in scientific and artistic creativity”, Personality and Social Psychology Review, Vol. 2 No. 4, pp. 290-309.
DOI Google Scholar

Fiske, D.W. (1949), “Consistency of the factorial structures of personality ratings from different sources”, The Journal of Abnormal and Social Psychology, Vol. 44 No. 3, pp. 329-344.
DOI Google Scholar
Fujishima, Y. Yamada, N. and Tsuji, H. (2005), “Construction of short form of five-factor personality questionnaire”.https://doi.org/10.2132/personality.13.231
DOI

Goldberg, L.R. (1990), “An alternative” description of personality”: the big-five factor structure”, Journal of Personality and Social Psychology, Vol. 59 No. 6, pp. 1216-1229.
DOI Google Scholar

Goldberg, L.R. (1999), “A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models”, Personality Psychology in Europe, Vol. 7 No. 1, pp. 7-28.
Google Scholar
Gong, Y. (2015), “Enabling flexible IT services by crowdsourcing: a method for estimating crowdsourcing participants”, Open and Big Data Management and Innovation, Springer, pp. 275-286.https://doi.org/10.1007/978-3-319-25013-7_22
DOI

Gosling, S.D., Gaddis, S. and Vazire, S. (2007), “Personality impressions based on Facebook profiles”, Icwsm, Vol. 7, pp. 1-4.
Google Scholar

Gosling, S.D., Rentfrow, P.J. and Swann, W.B. Jr, (2003), “A very brief measure of the Big-Five personality domains”, Journal of Research in Personality, Vol. 37 No. 6, pp. 504-528.
DOI Google Scholar

Howe, J. (2006), “The rise of crowdsourcing”, Wired Magazine, Vol. 14 No. 6, pp. 1-4.
Google Scholar

Huang, J.-H. and Yang, Y.-C. (2010), “The relationship between personality traits and online shopping motivations”, Social Behavior and Personality: An International Journal, Vol. 38 No. 5, pp. 673-679.
DOI Google Scholar
Igawa, K., Higa, K. and Takamiya, T. (2016), “An exploratory study on estimating the ability of high skilled crowd workers”, 2016 5th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI), 10-14 July 2016, pp. 735-740.https://doi.org/10.1109/IIAI-AAI.2016.13
DOI

John, O.P. and Srivastava, S. (1999), “The big five trait taxonomy: history, measurement, and theoretical perspectives”, Handbook of Personality: Theory and Research, Vol. 2 No. 1999, pp. 102-138.
Google Scholar
Kazai, G., Kamps, J. and Milic-Frayling, N. (2011), “Worker types and personality traits in crowdsourcing relevance labels”, Proceedings of the 20th ACM international conference on Information and knowledge management, ACM, pp. 1941-1944.https://doi.org/10.1145/2063576.2063860
DOI
Kittur, A., Chi, E.H. and Suh, B. (2008), “Crowdsourcing user studies with Mechanical Turk”, 2008: ACM, pp. 453-456.https://doi.org/10.1145/1357054.1357127
DOI
Mourelatos, E. and Tzagarakis, M. (2016), “Worker’s cognitive abilities and personality traits as predictors of effective task performance in crowdsourcing tasks”,Proceedings of 5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS 2016), pp. 112-116.https://doi.org/10.21437/PQS.2016-24
DOI

Murakami, Y. (2003), “Big five and psychometric conditions for their extraction in Japanese”, The Japanese Journal of Personality, Vol. 11 No. 2, pp. 70-85.
DOI Google Scholar
Murakami, Y. and Murakami, C. (2001), Big Five Handbook, Gakugei Tosho Co., Ltd.

Oshio, A., Abe, S., Cutrone, P. and Gosling, S.D. (2014), “Further validity of the Japanese version of the ten-item personality inventory (TIPI-J)”, Journal of Individual Differences, Vol. 35 No. 4.
DOI Google Scholar

Rammstedt, B. and John, O.P. (2007), “Measuring personality in one minute or less: a 10-item short version of the big five inventory in English and German”, Journal of Research in Personality, Vol. 41 No. 1, pp. 203-212.
DOI Google Scholar
Ross, J., Irani, L., Silberman, M., Zaldivar, A. and Tomlinson, B. (2010), “Who are the crowdworkers?: shifting demographics in mechanical Turk”, CHI’10 extended abstracts on Human factors in computing systems, ACM, pp. 2863-2872.https://doi.org/10.1145/1753846.1753873
DOI

Schmidt, F.L. and Hunter, J.E. (1998), “The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings”, Psychological Bulletin, Vol. 124 No. 2, pp. 262-274.
DOI Google Scholar
Shimonaka, Y., Nakazato, K., Gondo, Y. and Takayama, M. (1999), Revised NEO-Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) Manual for the Japanese Version, (In Japanese), Tokyo Shinri, Tokyo.
Snagajob (2017), “Snagajob appoints former Upwork CEO to board of directors”, available at: www.prnewswire.com/news-releases/snagajob-appoints-former-upwork-ceo-to-board-of-directors-300417689.html (accessed 31 December 2018).

Uchida, T. (2002), “Effects of the speech rate on speakers’ personality-trait impressions”, Japanese Journal of Psychology.
Google Scholar

Wada, S. (1996), “Construction of the big five scales of personality trait terms and concurrent validity with NPI”, The Japanese Journal of Psychology, Vol. 67 No. 1, pp. 61-67.
DOI Google Scholar
Wiggins, J.S. (1996), The Five-Factor Model of Personality: Theoretical Perspectives, Guilford Press.
Publication history
Copyright
Rights and permissions

Publication history

Received: 07 November 2019
Revised: 19 January 2020
Accepted: 21 January 2020
Published: 08 April 2020
Issue date: June 2020

Copyright

© The author(s)

Rights and permissions

Kousaku Igawa, Kunihiko Higa and Tsutomu Takamiya. Published in International Journal of Crowd Science. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode

Return