Open Access
Issue
Published:
30 November 2022
User Experience Adaptation of Complex Game Interface for User Behaviour Modeling Using RNN
),
Download citation
3425
Views
59
Downloads
0
Crossref
N/A
WoS
0
Scopus
N/A
CSCD
In a video game review, the main focus is the narratives, characters, graphics, and mechanics in the gameplay. Some recent research mentions the user interface only when it comes into light as a creative platform for simple interactive narratives from a technical point of view; this narrative is mainly a software tool that requires traditionally modernized inputs from the user. The user needs to interact with the navigational controls or menus in order to start a basic game play. A complex game interface as stimulus is generally considered as having a feeling of immersion that allows for visual tracking of user behavioural patterns and use it to predict the next strategy of the user using robust computational models. A number of users have limited sensory perception in a gameplay and hence rely on complex game stimulus and an adaptive model is paramount when considering behavioural expectations that place the user in a digital environment with more expressive perceptions. We developed a custom based eye tracking and 3D object detection algorithm which was utilised by recruiting users to interact with visual 3D objects and trace their eye movement behaviour to generated data. We then applied the use of recurrent neural network (RNN) for direct tracing of user behavioural activities in a sequential manner to predict their behaviour for interface adaptation. Result indicates that redundant user attributes are flexible and flawless for identifying predicted response of the user in a controlled environment. This would lead to prototypical representation of user behavioural analytics as an embedded platform in the confined digital environment. One of the limitations of the project is its inability to basically specify the 3D gaze point at the inner boundaries of the visual field. Data visualisation is strictly based on combined object flow detection. The originality of the work is its ability to redefine fixation point to a rendered cascaded 3D gaze point and space-defined saccade which is indicated by the distance between one gaze points to the other. The 3D gaze point would be well suited for fixation generalisation on 3D as well as on 2D digital oriented environment.
menu
User Experience Adaptation of Complex Game Interface for User Behaviour Modeling Using RNN
),
Abstract
In a video game review, the main focus is the narratives, characters, graphics, and mechanics in the gameplay. Some recent research mentions the user interface only when it comes into light as a creative platform for simple interactive narratives from a technical point of view; this narrative is mainly a software tool that requires traditionally modernized inputs from the user. The user needs to interact with the navigational controls or menus in order to start a basic game play. A complex game interface as stimulus is generally considered as having a feeling of immersion that allows for visual tracking of user behavioural patterns and use it to predict the next strategy of the user using robust computational models. A number of users have limited sensory perception in a gameplay and hence rely on complex game stimulus and an adaptive model is paramount when considering behavioural expectations that place the user in a digital environment with more expressive perceptions. We developed a custom based eye tracking and 3D object detection algorithm which was utilised by recruiting users to interact with visual 3D objects and trace their eye movement behaviour to generated data. We then applied the use of recurrent neural network (RNN) for direct tracing of user behavioural activities in a sequential manner to predict their behaviour for interface adaptation. Result indicates that redundant user attributes are flexible and flawless for identifying predicted response of the user in a controlled environment. This would lead to prototypical representation of user behavioural analytics as an embedded platform in the confined digital environment. One of the limitations of the project is its inability to basically specify the 3D gaze point at the inner boundaries of the visual field. Data visualisation is strictly based on combined object flow detection. The originality of the work is its ability to redefine fixation point to a rendered cascaded 3D gaze point and space-defined saccade which is indicated by the distance between one gaze points to the other. The 3D gaze point would be well suited for fixation generalisation on 3D as well as on 2D digital oriented environment.
References(30)
M. D. M. G. -D. L. Salmones, A. Herrero, and P. Martnez, Determinants of electronic word-of-mouth on social networking sites about negative news on CSR, Journal of Business Ethics, vol. 171, no. 3, pp. 583–597, 2021.
N. S. Safa, M. Sookhak, R. V. Solms, S. Furnell, N. A. Ghani, and T. Herawan, Information security conscious care behaviour formation in organizations, Computers and Security, vol. 53, pp. 65–78, 2015.
G. Krug, K. Drasch, and M. Jungbauer-Gans, The social stigma of unemployment: Consequences of stigma consciousness on job search attitudes, behaviour and success, Journal for Labour Market Research, vol. 53, no. 1, pp. 1–27, 2019.
P. Wang, W. B. Hawk, and C. Tenopir, Users’ interaction with world wide web resources: An exploratory study using a holistic approach, Information Processing and Management, vol. 36, no. 2, pp. 229–251, 2000.
E. Papatheocharous, M. Belk, P. Germanakos, and G. Samaras, Towards implicit user modeling based on artificial intelligence, cognitive styles and web interaction data, International Journal on Artificial Intelligence Tools, vol. 23, no. 2, p. 1440009, 2014.
Y. Lee and S. Cho, Abnormal usage sequence detection for identification of user needs via recurrent neural network semantic variational autoencoder, International Journal of Human—Computer Interaction, vol. 36, no. 7, pp. 631–640, 2020.
K. Lee, S. Lee, and J. Lee, Interactive character animation by learning multi-objective control, ACM Transactions on Graphics, vol. 37, no. 6, pp. 1–10, 2018.
T. Man, R. D. Yoshinov, V. Osipov, N. Zhukova, M. Schukina, and E. Evnevich, Problems of human secure interaction with the internet space, Problems of Engineering Cybernetics and Robotics, vol. 75, pp. 15–34, 2021.
P. Chakraborty, S. Ahmed, M. A. Yousuf, A. Azad, S. A. Alyami, and M. A. Moni, A human-robot interaction system calculating visual focus of human’s attention level, IEEE Access, vol. 9, pp. 93409–93421, 2021.
L. Gong, M. Yu, S. Jiang, V. Cutsuridis, and S. Pearson, Deep learning based prediction on greenhouse crop yield combined TCN and RNN, Sensors, vol. 21, no. 13, p. 4537, 2021.
M. Xia, H. Shao, X. Ma, and C. W. D. Silva, A stacked GRU-RNN-based approach for predicting renewable energy and electricity load for smart grid operation, IEEE Transactions on Industrial Informatics, vol. 17, no. 10, pp. 7050–7059, 2021.
K. Vivekanandan and N. Praveena, Hybrid convolutional neural network (CNN) and long-short term memory (LSTM) based deep learning model for detecting shilling attack in the social-aware network, Journal of Ambient Intelligence and Humanized Computing, vol. 12, pp. 1197–1210, 2021.
P. K. Jain, V. Saravanan, and R. Pamula, A hybrid CNN-LSTM: A deep learning approach for consumer sentiment analysis using qualitative user-generated contents, Transactions on Asian and Low-Resource Language Information Processing, vol. 20, no. 5, pp. 1–15, 2021.
I. E. Livieris, S. Stavroyiannis, E. Pintelas, T. Kotsilieris, and P. Pintelas, A dropout weight-constrained recurrent neural network model for forecasting the price of major cryptocurrencies and CCi30 index, Evolving Systems, vol. 13, pp. 85–100, 2022.
J. Chung, S. Hong, S. Kang, and C. Kim, Sequential UI behaviour prediction system based on long short-term memory networks, Behaviour and Information Technology, vol. 41, no. 6, pp. 1258–1269, 2022.
T. Tancogne-Dejean, M. B. Gorji, J. Zhu, and D. Mohr, Recurrent neural network modeling of the large deformation of lithium-ion battery cells, International Journal of Plasticity, vol. 146, p. 103072, 2021.
S. Laato, S. Rauti, A. Laato, T. H. Laine, E. Sutinen, and E. Lehtinen, Learning history with location-based applications: An architecture for points of interest in multiple layers, Sensors, vol. 21, no. 1, p. 129, 2021.
I. BlečIć, S. Cuccu, F. A. Fanni, V. Frau, R. Macis, V. Saiu, M. Senis, L. D. Spano, and A. Tola, First-person cinematographic videogames: Game model, authoring environment, and potential for creating affection for places, Journal on Computing and Cultural Heritage, vol. 14, no. 2, pp. 1–29, 2021.
O. Bendel, Love dolls and sex robots in unproven and unexplored fields of application, Paladyn, Journal of Behavioral Robotics, vol. 12, no. 1, pp. 1–12, 2021.
A. Farmaki, H. Olya, and B. Taheri, Unpacking the complex interactions among customers in online fan pages, Journal of Business Research, vol. 125, pp. 164–176, 2021.
M. A. Friehs, M. Dechant, S. Vedress, C. Frings, and R. L. Mandryk, Shocking advantage! Improving digital game performance using non-invasive brain stimulation, International Journal of Human-Computer Studies, vol. 148, p. 102582, 2021.
L. Steenbergen, M. J. Maraver, R. Actis-Grosso, P. Ricciardelli, and L. S. Colzato, Recognizing emotions in bodies: Vagus nerve stimulation enhances recognition of anger while impairing sadness, Cognitive, Affective, and Behavioral Neuroscience, vol. 21, pp. 1246–1261, 2021.
Z. Esmaeilpour, G. Kronberg, D. Reato, L. C. Parra, and M. Bikson, Temporal stimulation targets deep brain regions by modulating neural oscillations, Brain Stimulation, vol. 14, no. 1, pp. 55–65, 2021.
J. A. Villacorta-Atienza, C. C. Tapia, S. Díez-Hermano, A. Sánchez-Jiménez, S. Lobov, N. Krilova, A. Murciano, G. E. López-Tolsa, R. Pellón, and V. A. Makarov, Static internal representation of dynamic situations reveals time compaction in human cognition, Journal of Advanced Research, vol. 28, pp. 111–125, 2021.
M. Schoemann, D. O’Hora, R. Dale, and S. Scherbaum, Using mouse cursor tracking to investigate online cognition: Preserving methodological ingenuity while moving toward reproducible science, Psychonomic Bulletin and Review, vol. 28, no. 3, pp. 766–787, 2021.
Publication history
Copyright
Acknowledgements
We wish to acknowledge Nasarawa State University for their contribution to this paper.
Rights and permissions
The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
FEEDBACK 
TOP