TY  - JOUR
AU  - Wang, Xiao
AU  - Wang, Shiao
AU  - Ding, Yuhe
AU  - Li, Yuehang
AU  - Wu, Wentao
AU  - Rong, Yao
AU  - Kong, Weizhe
AU  - Huang, Ju
AU  - Li, Shihao
AU  - Yang, Haoxiang
AU  - Wang, Ziwen
AU  - Jiang, Bo
AU  - Li, Chenglong
AU  - Wang, Yaowei
AU  - Tian, Yonghong
AU  - Tang, Jin
PY  - 2026
TI  - State space model for new generation network alternative to transformers: a survey
JO  - Visual Intelligence
SN  - 2097-3330
SP  - 29
VL  - 4
AB  - In the post-deep learning era, the Transformer architecture has demonstrated its powerful performance in pre-trained large models and various downstream tasks. However, the enormous computational demands of Transformers have deterred many researchers. To reduce the complexity of attention models, numerous efforts have been made to design more efficient methods. Among them, the state space model (SSM), as a possible replacement for the self-attention based Transformer model, has drawn more and more attention in recent years. This paper provides the first comprehensive review of SSM works and offers experimental comparisons and analyses to better demonstrate SSM’s features and advantages. First, we provide a detailed description of the principles to help the readers quickly grasp the key ideas of the SSM. Then, we will review existing SSMs and their various applications, including those in the fields of natural language processing, computer vision, graphs, multi-modal and multi-media, point cloud and event stream, and other domains. Next, we provide statistical comparisons and analyses of these models to help readers understand how different structures affect performance on various tasks. Finally, we suggest potential research directions that could further advance the development of the theoretical model and propose possible research points in this direction to better promote the application of SSMs.
UR  - https://doi.org/10.1007/s44267-026-00133-1
DO  - 10.1007/s44267-026-00133-1