AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (1.7 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Review Article | Open Access

Algorithm contest of motor imagery BCI in the World Robot Contest 2022: A survey

Jiayu An1,2,§Xinru Chen1,2,§Dongrui Wu1,2( )
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, Hubei, China
Shenzhen Huazhong University of Science and Technology Research Institute, Shenzhen, Guangdong, China

§ These authors contributed equally to this work.

Show Author Information

Abstract

From August 19 to 21, 2022, the BCI Controlled Robot Contest finals in the World Robot Contest 2022 were held in Beijing, China. Fifteen teams participated in the finals in the Algorithm Contest of Motor Imagery BCI. This paper introduces the algorithms in the motor imagery (MI) classification area, describes the competition content and set, and summarizes the algorithms and results of the top five teams in the finals.

First, the MI paradigm and the overview of the existing motor imagery brain–computer interface classification algorithms are introduced, followed by the introduction of the algorithms of the top five teams in the final step by step, including electroencephalography channel selection, data length selection, data preprocessing, data augmentation, classification network, training, and testing settings. Finally, the highlights and results of each algorithm are discussed.

References

[1]
Singh A, Hussain AA, Lal S, et al. A comprehensive review on critical issues and possible solutions of motor imagery based electroencephalography brain-computer interface. Sensors 2021, 21(6): 2173.
[2]
Binnie CD, Prior PF. Electroencephalography. J Neurol Neurosurg Psychiatry 1994, 57(11): 13081319.
[3]
Lotze M, Halsband U. Motor imagery. J Physiol Paris 2006, 99(4/5/6): 386395.
[4]
Brunner C, Leeb R, Müller-Putz G, et al. BCI Competition 2008–Graz data set A. http://www.bbci.de/competition/iv
[5]
Leeb R, Brunner C, Muller-Putz GR, et al. BCI Competition 2008{Graz data set B. https://www.researchgate.net/publication/238115253_BCI_Competition_2008_Graz_data_set_B
[6]
Grangeon M, Guillot A, Sancho PO, et al. Rehabilitation of the elbow extension with motor imagery in a patient with quadriplegia after tendon transfer. Arch Phys Med Rehabil 2010, 91(7): 11431146.
[7]
Miao MM, Zeng H, Wang AM, et al. Index finger motor imagery EEG pattern recognition in BCI applications using dictionary cleaned sparse representation-based classification for healthy people. Rev Sci Instrum 2017, 88(9): 094305.
[8]
Rim B, Sung NJ, Min SD, et al. Deep learning in physiological signal data: a survey. Sensors 2020, 20(4): 969.
[9]
Ron-Angevin R, Velasco-Álvarez F, Fernández-Rodríguez Á, et al. Brain–computer interface application: auditory serial interface to control a two-class motor-imagery-based wheelchair. J Neuroeng Rehabil 2017, 14(1): 49.
[10]
Fernández-Rodríguez Á, Velasco-Álvarez F, Ron-Angevin R. Review of real brain-controlled wheelchairs. J Neural Eng 2016, 13(6): 061001.
[11]
López-Larraz E, Sarasola-Sanz A, Irastorza-Landa N, et al. Brain–machine interfaces for rehabilitation in stroke: a review. NeuroRehabilitation 2018, 43(1): 7797.
[12]
van Erp J, Lotte F, Tangermann M. Brain–computer interfaces: beyond medical applications. Computer 2012, 45(4): 2634.
[13]
LaFleur K, Cassady K, Doud A, et al. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface. J Neural Eng 2013, 10(4): 046003.
[14]
Yu Y, Zhou ZT, Yin EW, et al. Toward brain-actuated car applications: self-paced control with a motor imagery-based brain-computer interface. Comput Biol Med 2016, 77: 148155.
[15]
Zhang X, Yao L, Kanhere SS, et al. MindID: Person identification from brain waves through attention-based recurrent neural network. Proc ACM Interact Mob Wearable Ubiquitous Technol 2018, 2(3): 123.
[16]
Pfurtscheller G, Brunner C, Schlögl A, et al. Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage 2006, 31(1): 153159.
[17]
Neuper C, Wörtz M, Pfurtscheller G. ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog Brain Res 2006, 159: 211222.
[18]
Pfurtscheller G, Neuper C. Future prospects of ERD/ERS in the context of brain-computer interface (BCI) developments. Prog Brain Res 2006, 159: 433437.
[19]
George O, Smith R, Madiraju P, et al. Motor imagery: a review of existing techniques, challenges and potentials. In 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC). Madrid, Spain, 2021, pp 18931899.
[20]
Asensio-Cubero J, Gan JQ, Palaniappan R. Multiresolution analysis over simple graphs for brain computer interfaces. J Neural Eng 2013, 10(4): 046014.
[21]
Feng JK, Jin J, Daly I, et al. An optimized channel selection method based on multifrequency CSP-rank for motor imagery-based BCI system. Comput Intell Neurosci 2019, 2019: 8068357.
[22]
Jin J, Miao YY, Daly I, et al. Correlation-based channel selection and regularized feature optimization for MI-based BCI. Neural Netw 2019, 118: 262270.
[23]
Varsehi H, Firoozabadi SMP. An EEG channel selection method for motor imagery based brain-computer interface and neurofeedback using Granger causality. Neural Netw 2021, 133: 193206.
[24]
Han JQ, Zhao YW, Sun HJ, et al. A fast, open EEG classification framework based on feature compression and channel ranking. Front Neurosci 2018, 12: 217.
[25]
Meng M, Dong ZC, Gao YY, et al. Correlation and sparse representation based channel selection of motor imagery electroencephalogram (in Chinese). J Electron Inf Technol 2022, 44(2): 477485.
[26]
Shajil N, Mohan S, Srinivasan P, et al. Multiclass classification of spatially filtered motor imagery EEG signals using convolutional neural network for BCI based applications. J Med Biol Eng 2020, 40(5): 663672.
[27]
Jia ZY, Lin YF, Wang J, et al. MMCNN: a multi-branch multi-scale convolutional neural network for motor imagery classification. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020. Lecture Notes in Computer Science, vol 12459. Hutter F, Kersting K, Lijffijt J, et al. Eds. Cham: Springer, 2021, pp 736751.
[28]
Pawar D, Dhage S. Feature extraction methods for electroencephalography based brain-computer interface: a review. IAENG Int J Comput Sci 2020, 47(3): 501515.
[29]
Djamal EC, Abdullah MY, Renaldi F. Brain computer interface game controlling using fast Fourier transform and learning vector quantization. J Telecomm Electron Comput Eng (JETC) 2017, 9(2–5): 7174.
[30]
Wang ZJ, Cao L, Zhang Z, et al. Short time Fourier transformation and deep neural networks for motor imagery brain computer interface recognition. Concurrency Computat Pract Exper 2018, 30(23): e4413.
[31]
Hsu WY, Sun YN. EEG-based motor imagery analysis using weighted wavelet transform features. J Neurosci Methods 2009, 176(2): 310318.
[32]
Lotte F, Guan CT. Regularizing common spatial patterns to improve BCI designs: unified theory and new algorithms. IEEE Trans Biomed Eng 2011, 58(2): 355362.
[33]
Arvaneh M, Guan CT, Ang KK, et al. Optimizing the channel selection and classification accuracy in EEG-based BCI. IEEE Trans Biomed Eng 2011, 58(6): 18651873.
[34]
Wang HX, Tang Q, Zheng WM. L1-norm-based common spatial patterns. IEEE Trans Biomed Eng 2012, 59(3): 653662.
[35]
Samek W, Vidaurre C, Müller KR, et al. Stationary common spatial patterns for brain–computer interfacing. J Neural Eng 2012, 9(2): 026013.
[36]
Samek W, Kawanabe M, Müller KR. Divergence-based framework for common spatial patterns algorithms. IEEE Rev Biomed Eng 2014, 7: 5072.
[37]
Wu W, Chen Z, Gao XR, et al. Probabilistic common spatial patterns for multichannel EEG analysis. IEEE Trans Pattern Anal Mach Intell 2015, 37(3): 639653.
[38]
Ang KK, Chin ZY, Zhang HH, et al. Filter bank common spatial pattern (FBCSP) in brain-computer interface. In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). Hong Kong, China, 2008, pp 23902397.
[39]
Barachant A, Bonnet S, Congedo M, et al. Multiclass brain–computer interface classification by Riemannian geometry. IEEE Trans Biomed Eng 2012, 59(4): 920928.
[40]
Xie XF, Yu ZL, Lu HP, et al. Motor imagery classification based on bilinear sub-manifold learning of symmetric positive-definite matrices. IEEE T Neur Sys Reh 2017, 25(6): 504516.
[41]
Chu YQ, Zhao XG, Zou YJ, et al. Decoding multiclass motor imagery EEG from the same upper limb by combining Riemannian geometry features and partial least squares regression. J Neural Eng 2020, 17(4): 046029.
[42]
Larzabal C, Auboiroux V, Karakas S, et al. The Riemannian spatial pattern method: mapping and clustering movement imagery using Riemannian geometry. J Neural Eng 2021, 18(5): 056014.
[43]
Jin J, Qu TN, Xu R, et al. Motor imagery EEG classification based on Riemannian sparse optimization and dempster-shafer fusion of multi-time-frequency patterns. IEEE T Neur Sys Reh 2023, 31: 5867.
[44]
Singh A, Lal S, Guesgen HW. Motor imagery classification based on subject to subject transfer in Riemannian manifold. In 2019 7th International Winter Conference on Brain-Computer Interface (BCI). Gangwon, Korea (South), 2019, pp 16.
[45]
Mishra PK, Jagadish B, Kiran MPRS, et al. A novel classification for EEG based four class motor imagery using kullback-leibler regularized Riemannian manifold. In 2018 IEEE 20th International Conference on e-Health Networking, Applications and Services (Healthcom). Ostrava, Czech Republic, 2018, pp 15.
[46]
Guan S, Zhao K, Yang SN. Motor imagery EEG classification based on decision tree framework and Riemannian geometry. Comput Intell Neurosci 2019, 2019: 5627156.
[47]
Luo TJ, Zhou CL, Chao F. Exploring spatial-frequency-sequential relationships for motor imagery classification with recurrent neural network. BMC Bioinformatics 2018, 19(1): 344.
[48]
Liao JJ, Luo JJ, Yang T, et al. Effects of local and global spatial patterns in EEG motor-imagery classification using convolutional neural network. Brain Comput Interfaces 2020, 7(3/4): 4756.
[49]
Al-Saegh A, Dawwd SA, Abdul-Jabbar JM. Deep learning for motor imagery EEG-based classification: a review. Biomed Signal Process Contr 2021, 63: 102172.
[50]
Altaheri H, Muhammad G, Alsulaiman M, et al. Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: a review. Neural Comput Appl 2023, 35(20): 1468114722.
[51]
Lawhern VJ, Solon AJ, Waytowich NR, et al. EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J Neural Eng 2018, 15(5): 056013.
[52]
Schirrmeister RT, Springenberg JT, Fiederer LDJ, et al. Deep learning with convolutional neural networks for EEG decoding and visualization. Hum Brain Mapp 2017, 38(11): 53915420.
[53]
Riyad M, Khalil M, Adib A. MI-EEGNET: a novel convolutional neural network for motor imagery classification. J Neurosci Methods 2021, 353: 109037.
[54]
Ingolfsson TM, Hersche M, Wang XY, et al. EEG-TCNet: an accurate temporal convolutional network for embedded motor-imagery brain–machine interfaces. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Toronto, ON, Canada, 2020, pp 29582965.
[55]
Sakhavi S, Guan CT, Yan SC. Learning temporal information for brain-computer interface using convolutional neural networks. IEEE Trans Neural Netw Learn Syst 2018, 29(11): 56195629.
[56]
Mane R, Chew E, Chua K, et al. FBCNet: a multi-view convolutional neural network for brain-computer interface. arXiv 2021, arXiv: 2104.01233. https://arxiv.org/abs/2104.01233
[57]
Liu K, Yang MZ, Yu ZL, et al. FBMSNet: A filter-bank multi-scale convolutional neural network for EEG-based motor imagery decoding. IEEE T Bio-med Eng 2022, 70(2): 436445.
[58]
Wu H, Niu Y, Li F, et al. A parallel multiscale filter bank convolutional neural networks for motor imagery EEG classification. Front Neurosci 2019, 13: 1275.
[59]
Zhao XQ, Zhang HM, Zhu GL, et al. A multi-branch 3D convolutional neural network for EEG-based motor imagery classification. IEEE T Neur Sys Reh 2019, 27(10): 21642177.
[60]
Amin SU, Alsulaiman M, Muhammad G, et al. Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion. Future Gener Comput Syst 2019, 101: 542554.
[61]
Musallam YK, AlFassam NI, Muhammad G, et al. Electroencephalography-based motor imagery classification using temporal convolutional network fusion. Biomed Signal Proces 2021, 69: 102826.
[62]
Song YH, Zheng QQ, Liu BC, et al. EEG conformer: Convolutional transformer for EEG decoding and visualization. IEEE T Neur Sys Reh 2023, 31: 710719.
[63]
Liu XL, Shi RY, Hui QX, et al. TCACNet: temporal and channel attention convolutional network for motor imagery classification of EEG-based BCI. Inform Process Manag 2022, 59(5): 103001.
[64]
Altaheri H, Muhammad G, Alsulaiman M. Physics-informed attention temporal convolutional network for EEG-based motor imagery classification. IEEE T Ind Inform 2023, 19(2): 22492258.
[65]
Krell MM, Kim SK. Rotational data augmentation for electroencephalographic data. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Jeju, Korea (South), 2017, pp 471474.
[66]
Weiss KR, Khoshgoftaar T, Wang DD. A survey of transfer learning. J Big Data 2016, 3: 9.
[67]
Zhu XY, Li PY, Li CB, et al. Separated channel convolutional neural network to realize the training free motor imagery BCI systems. Biomed Signal Proces 2019, 49: 396403.
Brain Science Advances
Pages 166-181
Cite this article:
An J, Chen X, Wu D. Algorithm contest of motor imagery BCI in the World Robot Contest 2022: A survey. Brain Science Advances, 2023, 9(3): 166-181. https://doi.org/10.26599/BSA.2023.9050011

885

Views

120

Downloads

5

Crossref

Altmetrics

Received: 16 February 2023
Revised: 07 April 2023
Accepted: 19 April 2023
Published: 05 September 2023
© The authors 2023.

This article is published with open access at journals.sagepub.com/home/BSA

Creative Commons Non Commercial CC BY-NC: This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (http://www.creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).

Return