Journal Home > Volume 17 , Issue 5

Human–machine interactions (HMIs) have advanced rapidly in recent decades in the fields of healthcare, work, and life. However, people with disabilities and other mobility problems do not have corresponding high-tech aids for them to enjoy the convenience of HMIs. In this paper, we propose a sensor with a wave-shaped (corrugated) electrode embedded in a friction layer, which exhibits high sensitivity to skin fold excitation and enormous potential in HMIs. Attributing to the wave-shaped electrode design, it has no built-in cavities, and its small size allows it to flexibly cope with folds at different angles. By specifying the carbon nanotube hybrid silicone film as the electrode layer material and silicone film as the friction layer, good electrical output performance, tensile properties, and biocompatibility can be achieved. Then, the sensor is tested on various joints and skin folds of the human body, the output signals of which can be distinguished between normal physiological behavior and test behavior. Based on this sensor, we designed a medical alarm system, a robotic arm assistive system, and a cell phone application control system for the disabled to help them in the fields of healthcare, work, and life. In conclusion, our research presents a feasible technology to enhance HMIs and makes a valuable contribution to the development of high-tech aids for the disabled.


menu
Abstract
Full text
Outline
Electronic supplementary material
About this article

A wave-shaped electrode flexible sensor capable of sensitively responding to wrinkle excitation for a multifunctional human–computer interaction system

Show Author's information Yongyang Chen1,2Zhiyi Wu2( )Chengcheng Han2Zhi Cao2Yiran Hu2Ping Zhao3( )Yuanyu Wang1( )
College of Materials and Metallurgy, Guizhou University, Guizhou 550025, China
Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, China
Geological Brigade 105, Bureau of Geology and Mineral Exploration and Development of Guizhou Province, Guiyang 550018, China

Abstract

Human–machine interactions (HMIs) have advanced rapidly in recent decades in the fields of healthcare, work, and life. However, people with disabilities and other mobility problems do not have corresponding high-tech aids for them to enjoy the convenience of HMIs. In this paper, we propose a sensor with a wave-shaped (corrugated) electrode embedded in a friction layer, which exhibits high sensitivity to skin fold excitation and enormous potential in HMIs. Attributing to the wave-shaped electrode design, it has no built-in cavities, and its small size allows it to flexibly cope with folds at different angles. By specifying the carbon nanotube hybrid silicone film as the electrode layer material and silicone film as the friction layer, good electrical output performance, tensile properties, and biocompatibility can be achieved. Then, the sensor is tested on various joints and skin folds of the human body, the output signals of which can be distinguished between normal physiological behavior and test behavior. Based on this sensor, we designed a medical alarm system, a robotic arm assistive system, and a cell phone application control system for the disabled to help them in the fields of healthcare, work, and life. In conclusion, our research presents a feasible technology to enhance HMIs and makes a valuable contribution to the development of high-tech aids for the disabled.

Keywords: triboelectric nanogenerator, multifunctionality, human–machine interaction, flexible sensors, wrinkle excitation

References(42)

[1]

Khan, F.; Amatya, B.; Avirmed, B.; Yi, Y. K.; Shirmen, B.; Abbott, G.; Galea, M. P. World Health Organization global disability action plan: The mongolian perspective. J. Rehabil. Med. 2018, 50, 358–366.

[2]

Brady, N. C.; Bruce, S.; Goldman, A.; Erickson, K.; Mineo, B.; Ogletree, B. T.; Paul, D.; Romski, M. A.; Sevcik, R.; Siegel, E. et al. Communication services and supports for individuals with severe disabilities: Guidance for assessment and intervention. Am J Intellect Devel Disabilit 2016, 121, 121–138.

[3]

Qu, X. C.; Liu, Y.; Liu, Z.; Li, Z. Assistive devices for the people with disabilities enabled by triboelectric nanogenerators. J. Phys. Mater. 2021, 4, 034015.

[4]

Latif, G.; Alghazo, J.; Mohammad, N.; Alghazo, R. Communicating with the deaf and hard of hearing through automatic arabic sign language translator. J. Phys. Conf. Ser. 2021, 1962, 012055.

[5]

Pettersson, I.; Berndtsson, I.; Appelros, P.; Ahlström, G. Lifeworld perspectives on assistive devices: Lived experiences of spouses of persons with stroke. Scand. J. Occup. Ther. 2005, 12, 159–169.

[6]

Sladen, R. N.; Shulman, M. A.; Javaid, A.; Amlani, A. M.; Hupf, J. C.; Naka, Y.; McGiffin, D.; Bergin, P.; Takayama, H.; Buckland, M. et al. Post-discharge quality of life with a long-term ventricular assist device: Focus on functional disability and impact of health status. J. Heart Lung Transplant. 2020, 39, S436.

[7]

Fang, K. T.; Ping, C. H. Using machine learning to explore the crucial factors of assistive technology assessments: Cases of wheelchairs. Healthcare 2022, 10, 2238.

[8]
Sigounas, V. Y. Technologies of care and the engineering imaginary: Two approaches to assistive device design for the Global South. Med. Anthropol. Quart., in press, DOI: 10.1111/maq.12818.
[9]

Tomita, M.; Mann, W. C.; Welch, T. R. Use of assistive devices to address hearing impairment by older persons with disabilities. Int. J. Rehabil. Res. 2001, 24, 279–289.

[10]

Yeung, K. T.; Lin, C. H.; Teng, Y. L.; Chen, F. F.; Lou, S. Z.; Chen, C. L. Use of and self-perceived need for assistive devices in individuals with disabilities in Taiwan. PLoS One 2016, 11, e0152707.

[11]

Zhu, P. C.; Wang, Y. L.; Wang, Y.; Mao, H. Y.; Zhang, Q.; Deng, Y. Human–machine interactions: Flexible 3d architectured piezo/thermoelectric bimodal tactile sensor array for E-skin application (Adv. Energy Mater. 39/2020). Adv. Energy Mater. 2020, 10, 2070161

[12]

Shi, Q. F.; Zhang, Z. X.; Chen, T.; Lee, C. Minimalist and multi-functional human machine interface (HMI) using a flexible wearable triboelectric patch. Nano Energy 2019, 62, 355–366.

[13]

Lei, Z. Y.; Wang, Q. K.; Sun, S. T.; Zhu, W. C.; Wu, P. Y. A bioinspired mineral hydrogel as a self-healable, mechanically adaptable ionic skin for highly sensitive pressure sensing. Adv. Mater. 2017, 29, 1700321.

[14]

Fukui, H.; Chow, R. W. Y.; Xie, J.; Foo, Y. Y.; Yap, C. H.; Minc, N.; Mochizuki, N.; Vermot, J. Bioelectric signaling and the control of cardiac cell identity in response to mechanical forces. Science 2021, 374, 351–354.

[15]

Li, J. J.; Wang, Q. Multi-modal bioelectrical signal fusion analysis based on different acquisition devices and scene settings: Overview, challenges, and novel orientation. Inf. Fus. 2022, 79, 229–247.

[16]

Sajad, A.; Godlove, D. C.; Schall, J. D. Cortical microcircuitry of performance monitoring. Nat. Neurosci. 2019, 22, 265–274.

[17]

Ji, B. W.; Ge, C. F.; Guo, Z. J.; Wang, L. C.; Wang, M. H.; Xie, Z. Q.; Xu, Y. S.; Li, H. B.; Yang, B.; Wang, X. L. et al. Flexible and stretchable opto-electric neural interface for low-noise electrocorticogram recordings and neuromodulation in vivo. Biosens. Bioelectron. 2020, 153, 112009.

[18]

Tveit, J.; Aurlien, H.; Plis, S.; Calhoun, V. D.; Tatum, W. O.; Schomer, D. L.; Arntsen, V.; Cox, F.; Fahoum, F.; Gallentine, W. B. et al. Automated interpretation of clinical electroencephalograms using artificial intelligence. JAMA Neurol. 2023, 80, 805–812.

[19]

Gans, C.; Gorniak, G. C. Electromyograms are repeatable: Precautions and limitations. Science 1980, 210, 795–797.

[20]

Jin, P. Q.; Zou, J. J.; Zhou, T.; Ding, N. Eye activity tracks task-relevant structures during speech and auditory sequence perception. Nat. Commun. 2018, 9, 5374.

[21]

Zbinden, J.; Sassu, P.; Mastinu, E.; Earley, E. J.; Munoz-Novoa, M.; Brånemark, R.; Ortiz-Catalan, M. Improved control of a prosthetic limb by surgically creating electro-neuromuscular constructs with implanted electrodes. Sci. Transl. Med. 2023, 15, eabq3665.

[22]

Cheng, L.; Li, J.; Guo, A. Y.; Zhang, J. H. Recent advances in flexible noninvasive electrodes for surface electromyography acquisition. npj Flex. Electron. 2023, 7, 39.

[23]

Patwa, H. S. Is needle electromyography safe in patients on anticoagulation or antiplatelet therapy. Nat. Clin. Pract. Neurol. 2009, 5, 78–79.

[24]

Chen, C. J.; Huang, K.; Li, D. N.; Pan, Y.; Zhao, Z. X.; Hong, J. Assembly torque data regression using sEMG and inertial signals. J. Manuf. Syst. 2021, 60, 1–10.

[25]

Ye, G. M.; Jin, T. S.; Wang, X. K.; Chen, Y.; Wu, Q.; Wan, Y. F.; Yang, P. Multimodal integrated flexible electronic skin for physiological perception and contactless kinematics pattern recognition. Nano Energy 2023, 113, 108580.

[26]

Zhang, Y. W.; Chen, Y. Q.; Yu, H. C.; Yang, X. D.; Lu, W. Learning effective spatial-temporal features for sEMG armband-based gesture recognition. IEEE Intern. Things J. 2020, 7, 6979–6992.

[27]
Li, J. L.; Liu, Z. H.; Tang, Y. T.; Xian, J. B.; He, C. F.; Wu, H.; Liu, M. J.; Li, F. Y. An interfacial gel electrode patch with tunable hydrogen bond network for electromyographic sensing and discrimination. CCS Chem., in press, DOI: 10.31635/ccschem.023.202202564.
[28]

Freitas, R. A. Nanotechnology, nanomedicine and nanosurgery. Int. J. Surg. 2005, 3, 243–246.

[29]

Wang, T.; Russo, D. P.; Bitounis, D.; Demokritou, P.; Jia, X. L.; Huang, H.; Zhu, H. Integrating structure annotation and machine learning approaches to develop graphene toxicity models. Carbon 2023, 204, 484–494.

[30]

Qian, Y.; Lin, H.; Yan, Z. W.; Shi, J. L.; Fan, C. Y. Functional nanomaterials in peripheral nerve regeneration: Scaffold design, chemical principles and microenvironmental remodeling. Mater. Today 2021, 51, 165–187.

[31]

Cao, Z.; Yuan, Z. H.; Han, C. C.; Feng, J. R.; Wang, B. C.; Wang, Z. L.; Wu, Z. Y. Hybrid triboelectric-electromagnetic nanogenerator based on a tower spring for harvesting omnidirectional vibration energy. ACS Appl. Nano Mater. 2022, 5, 11577–11585.

[32]

Wei, X. L.; Wang, B. C.; Cao, X. L.; Zhou, H. L.; Wu, Z. Y.; Wang, Z. L. Dual-sensory fusion self-powered triboelectric taste-sensing system towards effective and low-cost liquid identification. Nat. Food 2023, 4, 721–732.

[33]

Cao, X. L.; Wei, X. L.; Li, R. N.; Wang, Z. L.; Wu, Z. Y. Thermal-mechanical-electrical energy conversion system based on Curie effect and soft-contact rotary triboelectric nanogenerator. Nano Res. 2023, 16, 2502–2510.

[34]

Wang, B. C.; Zhai, X. Y.; Wei, X. L.; Shi, Y. P.; Huo, X. Q.; Li, R. N.; Wu, Z. Y.; Wang, Z. L. A self-powered and concealed sensor based on triboelectric nanogenerators for cultural-relic anti-theft systems. Nano Res. 2022, 15, 8435–8441.

[35]

Lu, Y. J.; Tian, H.; Cheng, J.; Zhu, F.; Liu, B.; Wei, S. S.; Ji, L. H.; Wang, Z. L. Decoding lip language using triboelectric sensors with deep learning. Nat. Commun. 2022, 13, 1401.

[36]

Pu, X. J.; Guo, H. Y.; Chen, J.; Wang, X.; Xi, Y.; Hu, C. G.; Wang, Z. L. Eye motion triggered self-powered mechnosensational communication system using triboelectric nanogenerator. Sci. Adv. 2017, 3, e1700694.

[37]

Pu, X.; Zhang, C.; Wang, Z. L. Triboelectric nanogenerators as wearable power sources and self-powered sensors. Nat. Sci. Rev. 2023, 10, nwac170.

[38]

Zhou, H.; Li, D. X.; He, X. M.; Hui, X. D.; Guo, H. Y.; Hu, C. G.; Mu, X. J.; Wang, Z. L. Bionic ultra-sensitive self-powered electromechanical sensor for muscle-triggered communication application. Adv. Sci. 2021, 8, 2101020.

[39]

Lu, X.; Zheng, L.; Zhang, H. D.; Wang, W. H.; Wang, Z. L.; Sun, C. W. Stretchable, transparent triboelectric nanogenerator as a highly sensitive self-powered sensor for driver fatigue and distraction monitoring. Nano Energy 2020, 78, 105359.

[40]

Preskill, J. Stephen Hawking (1942–2018). Science 2018, 360, 156.

[41]

Kang, M.; Bin Mohammed Khusrin, M. S.; Kim, Y. J.; Kim, B.; Park, B. J.; Hyun, I.; Imani, I. M.; Choi, B. O.; Kim, S. W. Nature-derived highly tribopositive ϰ-carrageenan-agar composite-based fully biodegradable triboelectric nanogenerators. Nano Energy 2022, 100, 107480.

[42]

Cheng, J. H.; Shang, J.; Yang, S. J.; Dou, J. B.; Shi, X. H.; Jiang, X. Y. Wet-adhesive elastomer for liquid metal-based conformal epidermal electronics. Adv. Funct. Mater. 2022, 32, 2200444.

Video
12274_2023_6344_MOESM1_ESM.mp4
12274_2023_6344_MOESM2_ESM.mp4
12274_2023_6344_MOESM3_ESM.mp4
12274_2023_6344_MOESM4_ESM.mp4
File
12274_2023_6344_MOESM5_ESM.pdf (1.2 MB)
Publication history
Copyright
Acknowledgements

Publication history

Received: 01 October 2023
Revised: 07 November 2023
Accepted: 17 November 2023
Published: 15 December 2023
Issue date: May 2024

Copyright

© Tsinghua University Press 2023

Acknowledgements

Acknowledgements

This research was supported by the Guizhou Provincial Science and Technology Foundation (No. ZK [2022] General 112) and the National Natural Science Foundation of China (No. 42267009). No formal approval for the experiments involving human volunteers was required. The volunteers took part following informed consent.

Return