AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (697.4 KB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Predictive Emojis for User Cognitive Response to Dynamic Behaviour of Webpages Using Pupil and Click Reinforcement

Department of Computer Science, Nasarawa State University, Keffi 1022, Nigeria
Show Author Information

Abstract

The consequences of a poor user experience are based on the same principles that affect the user experience of any website. These principles span the gap between, for instance, a business webpage and a brick-motor company; the simple reason for this is whether online or in-store the cause or the cognitive processes of the users are similar in certain ways. The main steps towards improving the user experience of websites are through the understanding of the psychology of the users. This can be demonstrated using graphical-based emotion emojis. To understand the correlates and user affective response and how this changes by the dynamic behaviour of webpages, cognitive predictive markers such as bubble emojis are used to model users’ emotions to the objects they view on different webpages presented to them. The psychology and website user experience are framed at first impressions, through processing fluency, loading race, the limits of attention, and age of anxiety. This paper demonstrates an effective way of understanding user cognition through eye movement from the webcam and mouse clicking movement from finger touch during the interaction. User-generated data are collected and used as biomakers in form of emojis that relay the users’ emotion to the contents they view online. A computational test was carried out to determine the reliability of the proposed model (predictive dynamic control) with a standard artificial neural network and the results show compatibility as compared to state-of-the-art models. During process optimisation and flow, the bubbles seem to appear at undefined area of interest (AOI) of the visual webpages, and the selected URLs of some of these pages appear at random listings as defaults; these are some of the drawbacks of the proposed model. The originality of the project is its ability to automatically call up webpage in real-time with great processing speed and utilise the analytic control to predict users’ mood from previous search generated data and at the same time control synchronisation link between pupil changes and click reinforcement kernel.

References

[1]
H. A. Amosh and S. F. A. Khatib, Websites visits and financial performance for GCC banks: The moderating role of environmental, social and governance performance, Glob. Bus. Rev., doi: 10.1177/09721509221109576.
[2]

Y. Liu, Developing a scale to measure the interactivity of websites, J. Advert. Res., vol. 43, no. 2, pp. 207–216, 2003.

[3]

Y. X. Skadberg and J. R. Kimmel, Visitors’ flow experience while browsing a website: Its measurement, contributing factors and consequences, Comput. Hum. Behav., vol. 20, no. 3, pp. 403–422, 2004.

[4]

H. Guo, Z. Luo, M. Li, S. Kong, and H. Jiang, A literature review of big data-based urban park research in visitor dimension, Land, vol. 11, no. 6, p. 864, 2022.

[5]
I. Askwith, Deconstructing the Lost Experience. Cambridge, MA, USA: Convergence Culture Consortium, 2006.
[6]

S. McDougall, I. Reppa, J. Kulik, and A. Taylor, What makes icons appealing? The role of processing fluency in predicting icon appeal in different task contexts, Appl. Ergon., vol. 55, pp. 156–172, 2016.

[7]

S. Sohn, Consumer processing of mobile online stores: Sources and effects of processing fluency, J. Retail. Consumer Serv., vol. 36, pp. 137–147, 2017.

[8]
P. Winkielman, N. Schwarz, T. A. Fazendeiro, and R. Reber, The hedonic marking of processing fluency: Implications for evaluative judgment, in The Psychology of Evaluation: Affective Processes in Cognition and Emotion, J. Musch and K. C. Klauer, eds. Mahwah, NJ, USA: Lawrence Erlbaum Associates Publishers, 2003, pp. 189–217.
[9]
A. Miniukovich, Computational aesthetics in HCI: Towards a predictive model of graphical user interface aesthetics, PhD dissertation, International Doctoral School in Information and Communication Technologies, University of Trento, Trento, Italy, 2016.
[10]
M. Walker, H. Hedayati, J. Lee, and D. Szafir, Communicating robot motion intent with augmented reality, in Proc. 2018 13th ACM/IEEE Int. Conf. Human-Robot Interaction, Chicago, IL, USA, 2018, pp. 316–324.
[11]
R. C. Clark and C. Lyons, Graphics for Learning: Proven Guidelines for Planning, Designing, and Evaluating Visuals in Training Materials. Hoboken, NJ, USA: John Wiley & Sons, 2010.
[12]

C. M. Wittenbrink, A. T. Pang, and S. K. Lodha, Glyphs for visualizing uncertainty in vector fields, IEEE Trans. Vis. Comput. Graph., vol. 2, no. 3, pp. 266–279, 1996.

[13]

R. T. Richardson, T. L. Drexler, and D. M. Delparte, Color and contrast in e-learning design: A review of the literature and recommendations for instructional designers and web developers, MERLOT Journal of Online Learning and Teaching, vol. 10, no. 4, pp. 657–670, 2014.

[14]
Q. Liu, Y. Zeng, R. Mokhosi, and H. Zhang, STAMP: Short-term attention/memory priority model for session-based recommendation, in Proc. 24th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, London, UK, 2018, pp. 1831–1839.
[15]

G. Xue, C. Qi, H. Li, X. Kong, and J. Song, Heating load prediction based on attention long short term memory: A case study of Xingtai, Energy, vol. 203, p. 117846, 2020.

[16]

A. P. Streissguth, P. D. Sampson, H. C. Olson, F. L. Bookstein, H. M. Barr, M. Scott, J. Feldman, and A. F. Mirsky, Maternal drinking during pregnancy: Attention and short-term memory in 14-year-old offspring—A longitudinal prospective study, Alcohol., vol. 18, no. 1, pp. 202–218, 1994.

[17]

S. Haroz and D. Whitney, How capacity limits of attention influence information visualization effectiveness, IEEE Trans. Vis. Comput. Graph., vol. 18, no. 12, pp. 2402–2410, 2012.

[18]

J. Peng, A. Kimmig, J. Wang, X. Liu, Z. Niu, and J. Ovtcharova, Dual-stage attention-based long-short-term memory neural networks for energy demand prediction, Energy Build., vol. 249, p. 111211, 2021.

[19]

B. Bruya and Y. Y. Tang, Is attention really effort? Revisiting Daniel Kahneman’s influential 1973 book Attention and effort, Front. Psychol., vol. 9, p. 1133, 2018.

[20]

T. Sengupta-Irving and P. Agarwal, Conceptualizing perseverance in problem solving as collective enterprise, Math. Think. Learn., vol. 19, no. 2, pp. 115–138, 2017.

[21]

D. B. Goldston, S. S. Daniel, B. A. Reboussin, D. M. Reboussin, P. H. Frazier, and A. E. Harris, Cognitive risk factors and suicide attempts among formerly hospitalized adolescents: A prospective naturalistic study, J. Am. Acad. Child Adolesc. Psychiatry, vol. 40, no. 1, pp. 91–99, 2001.

[22]

B. Stanley, G. Brown, D. A. Brent, K. Wells, K. Poling, J. Curry, B. D. Kennard, A. Wagner, M. F. Cwik, A. B. Klomek, et al., Cognitive-behavioral therapy for suicide prevention (CBT-SP): Treatment model, feasibility, and acceptability, J. Am. Acad. Child Adolesc. Psychiatry, vol. 48, no. 10, pp. 1005–1013, 2009.

[23]

J. Kanwal, K. Smith, J. Culbertson, and S. Kirby, Zipf’s law of abbreviation and the principle of least effort: Language users optimise a miniature lexicon for efficient communication, Cognition, vol. 165, pp. 45–52, 2017.

[24]

G. M. Linders and M. M. Louwerse, Zipf’s law revisited: Spoken dialog, linguistic units, parameters, and the principle of least effort, Psychonomic Bulletin & Review, vol. 30, pp. 70–101, 2023.

[25]
S. Motiee, K. Hawkey, and K. Beznosov, Do windows users follow the principle of least privilege? Investigating user account control practices, in Proc. Sixth Symp. on Usable Privacy and Security, Redmond, WA, USA, 2010, pp. 1–13.
[26]
F. Tetard and M. Collan, Lazy user theory: A dynamic model to understand user selection of products and services, in Proc. 2009 42nd Hawaii Int. Conf. System Sciences, Waikoloa, HI, USA, 2009, pp. 1–9.
[27]

T. Hennig-Thurau, M. Groth, M. Paul, and D. D. Gremler, Are all smiles created equal? How emotional contagion and emotional labor affect service relationships, J. Mark., vol. 70, no. 3, pp. 58–73, 2006.

[28]

J. Xu, J. Broekens, K. Hindriks, and M. A. Neerincx, Mood contagion of robot body language in human robot interaction, Auton. Agents Multi Agent Syst., vol. 29, no. 6, pp. 1216–1248, 2015.

[29]

P. Gerbaudo, Rousing the Facebook crowd: Digital enthusiasm and emotional contagion in the 2011 protests in Egypt and Spain, International Journal of Communication, vol. 10, pp. 254–273, 2016.

[30]

N. M. Ashkanasy and A. D. Dorris, Emotions in the workplace, Annual Review of Organizational Psychology and Organizational Behavior, vol. 4, pp. 67–90, 2017.

[31]
S. G. Barsade, The ripple effect: Emotional contagion in groups, SSRN Electronic Journal, doi: 10.2139/ssrn.250894.
[32]
J. Xu, J. Broekens, K. V. Hindriks, and M. A. Neerincx, Robot mood is contagious: Effects of robot body language in the imitation game, in Proc. 2014 International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), Paris, France, 2014, pp. 973–980.
[33]
A. K. Fox, G. D. Deitz, M. B. Royne, and J. D. Fox, The face of contagion: Consumer response to service failure depiction in online reviews, Eur. J. Mark., vol. 52, nos. 1&2, pp. 39–65, 2018.
[34]
J. Tsai, E. Bowring, S. Marsella, W. Wood, and M. Tambe, A study of emotional contagion with virtual characters, in Proc. 12th International Conference on Intelligent Virtual Agents, Santa Cruz, CA, USA, 2012, pp. 81–88.
[35]
A. M. Ramadhani and H. S. Goo, Twitter sentiment analysis using deep learning methods, in Proc. 2017 7th Int. Annual Engineering Seminar (InAES), Yogyakarta, Indonesia, 2017, pp. 1–4.
[36]

L. Zhang, S. Wang, and B. Liu, Deep learning for sentiment analysis: A survey, WIREs Data Mining Knowl Discov., vol. 8, no. 4, p. e1253, 2018.

[37]

Y. Shi, Y. Zheng, K. Guo, and X. Ren, Stock movement prediction with sentiment analysis based on deep learning networks, Concurrency and Computation: Practice and Experience, vol. 33, no. 6, p. e6076, 2021.

[38]

P. Mehta, S. Pandya, and K. Kotecha, Harvesting social media sentiment analysis to enhance stock market prediction using deep learning, PeerJ Comput. Sci., vol. 7, p. e476, 2021.

[39]
R. Vanlalawmpuia and M. Lalhmingliana, Prediction of depression in social network sites using data mining, in Proc. 2020 4th Int. Conf. Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2020, pp. 489–495.
[40]

G. J. Siegle, S. R. Steinhauer, V. A. Stenger, R. Konecky, and C. S. Carter, Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data, NeuroImage, vol. 20, no. 1, pp. 114–124, 2003.

[41]

R. Ariel and A. D. Castel, Eyes wide open: Enhanced pupil dilation when selectively studying important information, Exp. Brain Res., vol. 232, no. 1, pp. 337–344, 2014.

[42]
H. Katti, K. Yadati, M. Kankanhalli, and C. Tat-Seng, Affective video summarization and story board generation using pupillary dilation and eye gaze, in Proc. 2011 IEEE Int. Symp. on Multimedia, Dana Point, CA, USA, 2011, pp. 319–326.
[43]

P. R. Mosaly, L. M. Mazur, F. Yu, H. Guo, M. Derek, D. H. Laidlaw, C. Moore, L. B. Marks, and J. Mostafa, Relating task demand, mental effort and task difficulty with physicians’ performance during interactions with electronic health records (EHRs), Int. J. Human–Computer Interact., vol. 34, no. 5, pp. 467–475, 2018.

[44]

Z. Tasir and O. C. Pin, Trainee teachers’ mental effort in learning spreadsheet through self-instructional module based on cognitive load theory, Comput. Educ., vol. 59, no. 2, pp. 449–465, 2012.

[45]

G. Porter, T. Troscianko, and I. D. Gilchrist, Effort during visual search and counting: Insights from pupillometry, Q. J. Exp. Psychol., vol. 60, no. 2, pp. 211–229, 2007.

[46]

J. Beatty, Task-evoked pupillary responses, processing load, and the structure of processing resources, Psychological Bulletin, vol. 91, no. 2, pp. 276–292, 1982.

[47]

B. C. Goldwater, Psychological significance of pupillary movements, Psychological Bulletin, vol. 77, no. 5, pp. 340–355, 1972.

[48]

J. M. Klebba, Physiological measures of research: A review of brain activity, electrodermal response, pupil dilation, and voice analysis methods and studies, Curr. Issues Res. Advert., vol. 8, pp. 53–76, 1985.

International Journal of Crowd Science
Pages 126-132
Cite this article:
Isiaka F. Predictive Emojis for User Cognitive Response to Dynamic Behaviour of Webpages Using Pupil and Click Reinforcement. International Journal of Crowd Science, 2025, 9(2): 126-132. https://doi.org/10.26599/IJCS.2023.9100004

473

Views

28

Downloads

0

Crossref

0

Scopus

Altmetrics

Received: 27 December 2022
Revised: 12 March 2023
Accepted: 21 March 2023
Published: 13 May 2025
© The author(s) 2025.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return