Simulating tactile and visual multisensory behaviour in humans based on an MoS₂ field effect transistor

A visual and tactile multisensory integrated system is essential for human walking due to the demand for real-time interactions between perception and action. Here, a piezoresistor and MoS₂ field effect transistor are combined to construct an artificial integration nervous system to simulate perception and synaptic plasticity. The key characteristics of synaptic plasticity are successfully demonstrated by individual pressure signals, individual optical signals, and the synergy of optical and pressure signals, which are based on the electron trapping–detrapping mechanism at the MoS₂/SiO₂ interface. We demonstrate that perception under synergy is stronger than perception under optical or pressure signal alone, which is similar to a biological system. Moreover, various distinguishable motion scenarios (combination of the following conditions: external lighting environment of day or night, flat or rough road, and movement state of walking or running) are simulated and verified by adjusting the amplitude and frequency of the optical and pressure signals.