Journal Home > Volume 5 , Issue 3
Purpose

Basic capturing of emotion on user experience of web applications and browsing is important in many ways. Quite often, online user experience is studied via tangible measures such as task completion time, surveys and comprehensive tests from which data attributes are generated. Prediction of users’ emotion and behaviour in some of these cases depends mostly on task completion time and number of clicks per given time interval. However, such approaches are generally subjective and rely heavily on distributional assumptions making the results prone to recording errors. This paper aims to propose a novel method – a window dynamic control system – that addresses the foregoing issues.

Design/methodology/approach

Primary data were obtained from laboratory experiments during which 44 volunteers had their synchronized physiological readings – skin conductance response, skin temperature, eye movement behaviour and users activity attributes taken by biosensors. The window-based dynamic control system (PHYCOB I) is integrated to the biosensor which collects secondary data attributes from these synchronized physiological readings and uses them for two purposes: for detection of both optimal emotional responses and users’ stress levels. The method's novelty derives from its ability to integrate physiological readings and eye movement records to identify hidden correlates on a webpage.

Findings

The results from the analyses show that the control system detects basic emotions and outperforms other conventional models in terms of both accuracy and reliability, when subjected to model comparison – that is, the average recoverable natural structures for the three models with respect to accuracy and reliability are more consistent within the window-based control system environment than with the conventional methods.

Research limitations/implications

Graphical simulation and an example scenario are only provided for the control's system design.

Originality/value

The novelty of the proposed model is its strained resistance to overfitting and its ability to automatically assess user emotion while dealing with specific web contents. The procedure can be used to predict which contents of webpages cause stress-induced emotions to users.


menu
Abstract
Full text
Outline
About this article

Integration of biosensor to a window-based control system for user emotion detection to static and dynamic visual contents of webpages

Show Author's information Fatima M. Isiaka1( )Awwal Adamu2Zainab Adamu3
Ahmadu Bello University Zaria, Kaduna, Nigeria
Department of Computer Science, Nasarawa State University Keffi Nigeria
Federal University of Technology Minna, Lagos, Nigeria

Abstract

Purpose

Basic capturing of emotion on user experience of web applications and browsing is important in many ways. Quite often, online user experience is studied via tangible measures such as task completion time, surveys and comprehensive tests from which data attributes are generated. Prediction of users’ emotion and behaviour in some of these cases depends mostly on task completion time and number of clicks per given time interval. However, such approaches are generally subjective and rely heavily on distributional assumptions making the results prone to recording errors. This paper aims to propose a novel method – a window dynamic control system – that addresses the foregoing issues.

Design/methodology/approach

Primary data were obtained from laboratory experiments during which 44 volunteers had their synchronized physiological readings – skin conductance response, skin temperature, eye movement behaviour and users activity attributes taken by biosensors. The window-based dynamic control system (PHYCOB I) is integrated to the biosensor which collects secondary data attributes from these synchronized physiological readings and uses them for two purposes: for detection of both optimal emotional responses and users’ stress levels. The method's novelty derives from its ability to integrate physiological readings and eye movement records to identify hidden correlates on a webpage.

Findings

The results from the analyses show that the control system detects basic emotions and outperforms other conventional models in terms of both accuracy and reliability, when subjected to model comparison – that is, the average recoverable natural structures for the three models with respect to accuracy and reliability are more consistent within the window-based control system environment than with the conventional methods.

Research limitations/implications

Graphical simulation and an example scenario are only provided for the control's system design.

Originality/value

The novelty of the proposed model is its strained resistance to overfitting and its ability to automatically assess user emotion while dealing with specific web contents. The procedure can be used to predict which contents of webpages cause stress-induced emotions to users.

Keywords: Skin temperature, Dynamic control system, Eye tracker sensors, Human physiological functions, Online behaviour, Skin conductance response

References(28)

Andreassi, J.L. (2000), Psychophysiology: Human Behavior and Physiological Response, Psychology Press, p. 12.
Bergstrom, J.R. and Schall, A. (2014), Eye Tracking in User Experience Design, Elsevier. 10-38.
Bixler, R., Blanchard, N., Garrison, L. and D’Mello, S. (2015), “Automatic detection of mind wandering during reading using gaze and physiology”, Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, pp. 299-306.https://doi.org/10.1145/2818346.2820742
DOI

Brandt, M.L., Brown, K.E., Dykes, P.J., Lindberg, E.D., Olson, D.E., Selden, J.E., Snyder, D.D. and Walts, J.O. (1999), “Computer apparatus and method for providing a common user interface for software applications accessed via the world-wide web”, US Patent, Vol. 5, pp. 892-905.

Castaneda, J.A., Munoz-Leiva, F. and Luque, T. (2007), “Web acceptance model (WAM): moderating effects of user experience”, Information and Management, Vol. 44 No. 4, pp. 384-396.

Chen, H., Wigand, R.T. and Nilan, M. (2000), “Exploring web users’ optimal flow experiences”, Information Technology and People, Vol. 13 No. 4, pp. 263-281.

Cooley, R., Mobasher, B. and Srivastava, J. (1999), “Data preparation for mining world wide web browsing patterns”, Knowledge and Information Systems, Vol. 1 No. 1, pp. 5-32.

Davis, E.V. (1990), “Software testing for evolutionary iterative rapid prototyping”, Ph.D. thesis, Naval Postgraduate School, Monterey, CA, 19.

Filipovic, S.R. and Andreassi, J.L. (2001), “Psychophysiology: human behavior and physiological response”, Journal of Psychophysiology, Vol. 15 No. 3, pp. 210-212.

Gross, J.J., Carstensen, L.L., Pasupathi, M., Tsai, J., Gotestam Skorpen, C. and Hsu, A.Y. (1997), “Emotion and aging: experience, expression, and control”, Psychology and Aging, Vol. 12 No. 4, p. 590.

Healey, J.A. and Picard, R.W. (2005), “Detecting stress during real-world driving tasks using physiological sensors”, Ieee Transactions on Intelligent Transportation Systems, Vol. 6 No. 2, pp. 156-166.

Iqbal, S.T., Zheng, X.S. and Bailey, B.P. (2004), “Task-evoked pupillary response to mental workload in human-computer interaction”, In CHI’04 Extended Abstracts on Human Factors in Computing Systems, ACM, Vol. 14, pp. 1477-1480.

Isiaka, F., (2017), “Modelling stress levels based on physiological responses to web contents”, Sheffield Hallam University.

Kamon, E., Pandolf, K. and Cafarelli, E. (1974), “The relationship between perceptual information and physiological responses to exercise in the heat”, Journal of Human Ergology, Vol. 3 No. 1, pp. 45-54.

Kim, E.S., Kyoung-Woon, O. and and Byoung-Tak, Z. (2015), “Behavioural pattern modelling of human-human interaction for teaching restaurant service robots”, AAAI 2015 Fall Symposium on AI for Human-Robot Interaction, pp. 45-89.
Kolakowska, A., Landowska, A., Szwoch, M., Szwoch, W. and Wrobel, M.R. (2013), “Emotion recognition and its application in software engineering”, Human System Interaction (HSI), 2013 The 6th International Conference, IEEE, 532-539.https://doi.org/10.1109/HSI.2013.6577877
DOI
Mindfield (2014), “eSense temperature, mindfield biofeedback systems”, eSence Skin Temperature Handbook, pp. 1-12.
Nielsen, J. (1994), “Usability inspection methods”, Conference companion on Human factors in computing systems, ACM, pp. 413-414.https://doi.org/10.1145/259963.260531
DOI
Nielsen, J. and Molich, R. (1990), “Heuristic evaluation of user interfaces”, Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, pp. 249-256.https://doi.org/10.1145/97243.97281
DOI

Saint-Aime, S., Le Pevedic, B. and Duhaut, D. (2009), “iGrace-emotional computational model for emi companion robot”, Advances in Human-Robot Interaction, Vol. 4, pp. 26.

Sauer, J. and Sonderegger, A. (2009), “The influence of prototype fidelity and aesthetics of design in usability tests: effects on user behaviour, subjective evaluation and emotion”, Applied Ergonomics, Vol. 40 No. 4, pp. 670-677.

Schneider-Hufschmidt, M., Malinowski, U. and Kuhme, T. (1993), Adaptive User Interfaces: Principles and Practice, Elsevier Science Inc, p. 22.

Skadberg, Y.X. and Kimmel, J.R. (2004), “Visitors’ flow experience while browsing a web site: its measurement, contributing factors and consequences”, Computers in Human Behavior, Vol. 20 No. 3, pp. 403-422.

Smith, M.J., Conway, F.T. and Karsh, B.T. (1999), “Occupational stress in human computer interaction”, Industrial Health, Vol. 37 No. 2, pp. 157-173.

Ugur, S. (2013), Wearing Embodied Emotions: A Practice Based Design Research on Wearable Technology, Springer, p. 4.
Vasalou, A., Ng, B., Wiemer-Hastings, P. and Oshlyansky, L. (2004), “Human-moderated remote user testing: protocols and applications”, 8th ERCIM Workshop, User Interfaces for All, Wien, p. 19.
Widyantoro, D.H., Ioerger, T.R. and Yen, J. (1999), “An adaptive algorithm for learning changes in user interests”, Proceedings of the eighth international conference on Information and knowledge management, ACM, pp. 405-412.https://doi.org/10.1145/319950.323230
DOI
Zhai, J. and Barreto, A. (2006), “Stress detection in computer users based on digital signal processing of noninvasive physiological variables”, Engineering in Medicine and Biology Society, 28th Annual International Conference of the IEEE, IEEE. pp. 1355-1358.https://doi.org/10.1109/IEMBS.2006.259421
DOI
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 24 June 2021
Revised: 05 August 2021
Accepted: 13 August 2021
Published: 11 October 2021
Issue date: November 2021

Copyright

© The author(s)

Acknowledgements

Acknowledgements

The authors would like to thank the Nasarawa State University for sponsoring this paper, Federal University of Technology, Minna and Amodu Bello University for their contributions.

Rights and permissions

Fatima M. Isiaka, Awwal Adamu and Zainab Adamu. Published in International Journal of Crowd Science. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode

Return