Journal Home > Volume 6 , Issue 3
Journal of Geodesy and Geoinformation Science 2023, 6(3): 102-114 https://doi.org/10.11947/j.JGGS.2023.0310
Literature review | Open Access | Issue | Published: 20 September 2023

Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023

Show Author's Information Xingxing LI1,  Xiaohong ZHANG1,  Xiaoji NIU1,  Jian WANG2,  Ling PEI3,  Fangwen YU4,  Hongjuan ZHANG1,  Cheng YANG5,  Zhouzheng GAO5,  Quan ZHANG1,  Feng ZHU1,  Weisong WEN6,  Tuan LI7,8,  Jianchi LIAO9,  Xin LI1
Shool of Geodesy and Gevmatics, Wuhan University, Wuhan 430074, China
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Shanghai Jiao Tong University, Shanghai 200052, China
Center for Brain-inspired Computing Research, Tsinghua University, Beijing 100084, China
School of Land Science and Technology, China University of Geosciences (Beijing), Beijing 100084, China
Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University,Hong Kong 900777, China
School of Electronic and Information Engineering, Beihang University, Beijing 100191, China
Advanced Research Institute of Multidisciplinary Sciences, Beijing Institute of Technology, Beijing 100081, China
Hubei Luojia Laboratory, Wuhan 430074, China
Keywords:
Simultaneous Localization And Mapping (SLAM), multi-sensor fusion, integrated navigation
Cite this article:
LI X, ZHANG X, NIU X, et al. Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023. Journal of Geodesy and Geoinformation Science, 2023, 6(3): 102-114. https://doi.org/10.11947/j.JGGS.2023.0310
Download citation
EndNote(RIS)
BibTeX

501

Views

35

Downloads

Citations

0

Crossref

N/A

WoS

0

Scopus

0

CSCD

Abstract Full text About this article

Global Navigation Satellite System (GNSS) can provide all-weather, all-time, high-precision positioning, navigation and timing services, which plays an important role in national security, national economy, public life and other aspects. However, in environments with limited satellite signals such as urban canyons, tunnels, and indoor spaces, it is difficult to provide accurate and reliable positioning services only by satellite navigation. Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit (IMU), vision sensor, and LiDAR, and provide more accurate, stable and robust navigation information in complex environments. We summarizes the research status of multi-source sensor integrated navigation technology, and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.


menu
Abstract
Full text
Outline
About this article

Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023

Show Author's information Xingxing LI1, Xiaohong ZHANG1, Xiaoji NIU1, Jian WANG2, Ling PEI3, Fangwen YU4, Hongjuan ZHANG1, Cheng YANG5, Zhouzheng GAO5, Quan ZHANG1, Feng ZHU1, Weisong WEN6, Tuan LI7,8, Jianchi LIAO9, Xin LI1
Shool of Geodesy and Gevmatics, Wuhan University, Wuhan 430074, China
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Shanghai Jiao Tong University, Shanghai 200052, China
Center for Brain-inspired Computing Research, Tsinghua University, Beijing 100084, China
School of Land Science and Technology, China University of Geosciences (Beijing), Beijing 100084, China
Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University,Hong Kong 900777, China
School of Electronic and Information Engineering, Beihang University, Beijing 100191, China
Advanced Research Institute of Multidisciplinary Sciences, Beijing Institute of Technology, Beijing 100081, China
Hubei Luojia Laboratory, Wuhan 430074, China

Abstract

Global Navigation Satellite System (GNSS) can provide all-weather, all-time, high-precision positioning, navigation and timing services, which plays an important role in national security, national economy, public life and other aspects. However, in environments with limited satellite signals such as urban canyons, tunnels, and indoor spaces, it is difficult to provide accurate and reliable positioning services only by satellite navigation. Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit (IMU), vision sensor, and LiDAR, and provide more accurate, stable and robust navigation information in complex environments. We summarizes the research status of multi-source sensor integrated navigation technology, and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.

Keywords: Simultaneous Localization And Mapping (SLAM), multi-sensor fusion, integrated navigation

References(67)

[1]

OUYANG Wei, WU Yuanxin. Optimization-based strapdown attitude alignment for high-accuracy systems: covariance analysis with applications[J]. IEEE Transactions on Aerospace and Electronic systems, 2022, 58(5): 4053-4069.
DOI Google Scholar
[2]

ZHANG Quan, LI Shanshan, XU Zhengpeng, et al. Velocity-Based Optimization-Based Alignment (VBOBA) of low-end MEMS IMU/GNSS for low dynamic applications[J]. IEEE Sensors Journal, 2020, 20(10): 5527-5539.
DOI Google Scholar
[3]

HUANG Haoqian, WEI Jiaying, WANG Di, et al. In-motion initial alignment method based on vector observation and truncated vectorized K-matrix for SINS[J]. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 3000415.
DOI Google Scholar
[4]

HUANG Yulong, ZHANG Zheng, DU Siyuan, et al. A high-accuracy GPS-aided coarse alignment method for MEMS-based SINS[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(10): 7914-7932.
DOI Google Scholar
[5]

LIU Weiqian, CHENG Xianghong, DING Peng, et al. An optimal indirect in-motion coarse alignment method for GNSS-aided SINS[J]. IEEE Sensors Journal, 2022, 22(8): 7608-7618.
DOI Google Scholar
[6]

CHEN Qijin, LIN Huan, GUO Ruonan, et al. Rapid and accurate initial alignment of the low-cost MEMS IMU chip dedicated for tilted RTK receiver[J]. GPS Solutions, 2020, 24(4): 119.
DOI Google Scholar
[7]

ZHANG Xiaohong, ZHU Feng, ZHANG Yuxi, et al. The improvement in integer ambiguity resolution with INS aiding for kinematic precise point positioning[J]. Journal of Geodesy, 2019, 93(7): 993-1010.
DOI Google Scholar
[8]

MA Liye, ZHU Feng, LIU Wanke, et al. VC-LAMBDA: a baseline vector constrained LAMBDA method for integer least-squares estimation[J]. Journal of Geodesy, 2022, 96(9): 59.
DOI Google Scholar
[9]

YANG Cheng, SHI Wenzhong, CHEN Wu. Robust M-M unscented Kalman filtering for GPS/IMU navigation[J]. Journal of Geodesy, 2019, 93(8): 1093-1104.
DOI Google Scholar
[10]

ZHANG Quan, CHEN Qijin, XU Zhengpeng, et al. Evaluating the navigation performance of multi-information integration based on low-end inertial sensors for precision agriculture[J]. Precision Agriculture, 2021, 22(3): 627-646.
DOI Google Scholar
[11]

ZHANG Quan, HU Yuanqian, NIU Xiaoji. Required lever arm accuracy of non-holonomic constraint for land vehicle navigation[J]. IEEE Transactions on Vehicular Technology, 2020, 69(8): 8305-8316.
DOI Google Scholar
[12]

ZHANG Quan, HU Yuanqian, LI Shanshan, et al. Mounting parameter estimation from velocity vector observations for land vehicle navigation[J]. IEEE Transactions on Industrial Electronics, 2022, 69(4): 4234-4244.
DOI Google Scholar
[13]

CHEN Qijin, ZHANG Quan, NIU Xiaoji. Estimate the pitch and heading mounting angles of the IMU for land vehicular GNSS/INS integrated system[J]. IEEE Transactions on Intelligent Transportation Systems, 2021, 22(10): 6503-6515.
DOI Google Scholar
[14]

WANG Liqiang, NIU Xiaoji, ZHANG Tisheng, et al. Accuracy and robustness of ODO/NHC measurement models for wheeled robot positioning[J]. Measurement, 2022, 201: 111720.
DOI Google Scholar
[15]

OUYANG Wei, WU Yuanxin, CHEN Hongyue. INS/odometer land navigation by accurate measurement modeling and multiple-model adaptive estimation[J]. IEEE Transactions on Aerospace and Electronic Systems, 2021, 57(1): 245-262.
DOI Google Scholar
[16]

GAO Zhouzheng, GE Maorong, LI You, et al. Modeling of multi-sensor tightly aided BDS triple-frequency precise point positioning and initial assessments[J]. Information Fusion, 2020, 55: 184-198.
DOI Google Scholar
[17]

WU Yibin, NIU Xiaoji, KUANG Jian. A comparison of three measurement models for the wheel-mounted MEMS IMU-based dead reckoning system[J]. IEEE Transactions on Vehicular Technology, 2021, 70(11): 11193-11203.
DOI Google Scholar
[18]

XU Qiaozhuang, GAO Zhouzheng, LV Jie, et al. Tightly coupled integration of BDS-3 B2b RTK, IMU, odometer, and dual-antenna attitude[J]. IEEE Internet of Things Journal, 2023, 10(7): 6415-6427.
DOI Google Scholar
[19]

HU Jie, ZHU Feng, ZHUO Desheng, et al. Performance evaluation of stereo vision aided loosely coupled GNSS/SINS integration for land vehicle navigation in different urban environments[J]. IEEE Sensors Journal, 2023, 23(4): 4129-4142.
DOI Google Scholar
[20]

NIU Xiaoji, TANG Hailiang, ZHANG Tisheng, et al. IC-GVINS: a robust, real-time, INS-centric GNSS-visual-inertial navigation system[J]. IEEE Robotics and Automation Letters, 2023, 8(1): 216-223.
DOI Google Scholar
[21]

LIAO Jianchi, LI Xingxing, WANG Xuanbin, et al. Enhancing navigation performance through visual-inertial odometry in GNSS-degraded environment[J]. GPS Solutions, 2021, 25(2): 50.
DOI Google Scholar
[22]
XU Qiaozhuang, LV Jie, GAO Zhouzheng. Evaluation on low-cost GNSS/IMU/Vision integration system in GNSS-denied environments[C]// Proceedings of 2022 IEEE 12th International Conference on Indoor Positioning and Indoor Navigation. Beijing, China: IEEE, 2022: 1-6.
DOI
[23]

LI Xingxing, LI Shengyu, ZHOU Yuxuan, et al. Continuous and precise positioning in urban environments by tightly coupled integration of GNSS, INS and vision[J]. IEEE Robotics and Automation Letters, 2022, 7(4): 11458-11465.
DOI Google Scholar
[24]

LI Xin, LI Xingxing, HUANG Jiaxin, et al. Improving PPP-RTK in urban environment by tightly coupled integration of GNSS and INS[J]. Journal of Geodesy, 2021, 95(12): 132.
DOI Google Scholar
[25]

LI Tao, PEI Ling, XIANG Yan, et al. P3-VINS: tightly-coupled PPP/INS/Visual SLAM based on optimization approach[J]. IEEE Robotics and Automation Letters, 2022, 7(3): 7021-7027.
DOI Google Scholar
[26]

JIANG Haitao, LI Tuan, SONG Dan, et al. An effective integrity monitoring scheme for GNSS/INS/vision integration based on error state EKF model[J]. IEEE Sensors Journal, 2022, 22(7): 7063-7073.
DOI Google Scholar
[27]

LI Tao, PEI Ling, XIANG Yan, et al. P3-LINS: tightly coupled PPP-GNSS/INS/LiDAR navigation system with effective initialization[J]. IEEE Transactions on Instrumentation and Measurement, 2023, 72: 8501813.
DOI Google Scholar
[28]

LI Shengyu, WANG Shiwen, ZHOU Yuxuan, et al. Tightly coupled integration of GNSS, INS, and LiDAR for vehicle navigation in urban environments[J]. IEEE Internet of Things Journal, 2022, 9(24): 24721-24735.
DOI Google Scholar
[29]

LI Shengyu, LI Xingxing, WANG Huidan, et al. Multi-GNSS PPP/INS/Vision/LiDAR tightly integrated system for precise navigation in urban environments[J]. Information Fusion, 2023, 90: 218-232.
DOI Google Scholar
[30]

ZHOU Jian, GUO Yuan, BIAN Yaoan, et al. Lane information extraction for high definition maps using crowdsourced data[J]. IEEE Transactions on Intelligent Transportation Systems, 2023, 24(7): 7780-7790.
DOI Google Scholar
[31]

XU Qingxu, ZHU Feng, HU Jie, et al. An enhanced positioning algorithm module for low-cost GNSS/MEMS integration based on matching straight lane lines in HD maps[J]. GPS Solutions, 2023, 27(1): 22.
DOI Google Scholar
[32]

NIU Xiaoji, PENG Yitang, DAI Yuhang, et al. Camera-based lane-aided multi-information integration for land vehicle navigation[J]. IEEE/ASME Transactions on Mechatronics, 2023, 28(1): 152-163.
DOI Google Scholar
[33]

CONG Ming, ZOU Qiang, LIU Dong, et al. Review of robot navigation inspired by the localization cells’cognitive mechanism[J]. Journal of Mechanical Engineering, 2019, 55(23): 1-12.
DOI Google Scholar
[34]

YANG Chuang, LIU Jianye, XIONG Zhi, et al. Brain-inspired navigation technology integrating perception and action decision: a review and outlook[J]. Acta Aeronautica et Astronautica Sinica, 2020, 41(1): 023280.
Google Scholar
[35]

GUO Chi, LUO Binhan, LI Fei, et al. Review and verification for brain-like navigation algorithm[J]. Geomatics and Information Science of Wuhan University, 2021, 46(12): 1819-1831.
Google Scholar
[36]

LIU Jingnan, LUO Yarong, GUO Chi, et al. PNT intelligence and intelligent PNT[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(6): 811-828. DOI: 10.11947/j.AGCS.2022.20220152.
DOI Google Scholar
[37]

MENG Zhilin, ZHAO Dongye, SI Bailu, et al. A survey on robot navigation based on mammalian spatial cognition[J]. Robot, 2023, 45(4): 496-512.
Google Scholar
[38]

GONG Ziyi, YU Fangwen. A plane-dependent model of 3D grid cells for representing both 2D and 3D spaces under various navigation modes[J]. Frontiers in Computational Neuroscience, 2021, 15: 739515.
DOI Google Scholar
[39]

WANG Yihong, XU Xuying, PAN Xiaochuan, et al. Grid cell activity and path integration on 2-D manifolds in 3-D space[J]. Nonlinear Dynamics, 2021, 104(2): 1767-1780.
DOI Google Scholar
[40]

HAN Kun, WU Dewei, LAI Lei. Model of generating grid cell based on difference Hebbian learning in brain-inspired navigation[J]. Systems Engineering and Electronics, 2020, 42(3): 674-679.
Google Scholar
[41]

WANG Jiru, YAN Rui, TANG Huajin. Multi-scale extension in an entorhinal-hippocampal model for cognitive map building[J]. Frontiers in Neurorobotics, 2021, 14: 592057.
DOI Google Scholar
[42]

YANG Chuang, LIU Jianye, XIONG Zhi, et al. Brain-inspired vector navigation method based on model of multi-scale grid cells[J]. Journal of Chinese Inertial Technology, 2020, 28(2): 179-185.
Google Scholar
[43]

YANG Chuang, XIONG Zhi, LIU Jianye, et al. A path integration approach based on multiscale grid cells for large-scale navigation[J]. IEEE Transactions on Cognitive and Developmental Systems, 2022, 14(3): 1009-1020.
DOI Google Scholar
[44]

ZENG Taiping, TANG Fengzhen, JI Daxiong, et al. NeuroBayes SLAM: neurobiologically inspired Bayesian integration of multisensory information for robot navigation[J]. Neural Networks, 2020, 126: 21-35.
DOI Google Scholar
[45]

ZHAO Chenhao, WU Deiwei, HAN Kun, et al. Path integration model based on multi-scale grid cell[J]. Systems Engineering and Electronics, 2020, 43(10): 2961-2967.
Google Scholar
[46]

ZHAO Chenhao, WU Dewei, HE Jing, et al. Navigation cognitive map construction based on improved Q-learning algorithm[J]. Journal of Air Force Engineering University (Natural Science Edition), 2020, 21(2): 53-60.
Google Scholar
[47]

ZHAO Dongye, ZHANG Zheng, LU Hong, et al. Learning cognitive map representations for navigation by sensory-motor integration[J]. IEEE Transactions on Cybernetics, 2022, 52(1): 508-521.
DOI Google Scholar
[48]

ZOU Qiang, CONG Ming, LIU Dong, et al. Robotic episodic cognitive learning inspired by hippocampal spatial cells[J]. IEEE Robotics and Automation Letters, 2020, 5(4): 5573-5580.
DOI Google Scholar
[49]

YU Naigong, ZHAI Yujia, YUAN Yunhe, et al. A bionic robot navigation algorithm based on cognitive mechanism of hippocampus[J]. IEEE Transactions on Automation Science and Engineering, 2019, 16(4): 1640-1652.
DOI Google Scholar
[50]

GU Yu, ZHAO Xiubin, DAI Chuanjin. Brain-like large-scale spatial vector navigation method based on grid cell model[J]. Control Theory & Applications, 2021, 38(12): 2094-2100.
Google Scholar
[51]

LIAO Yishen, YU Hejie, YU Naigong. A brain-like navigation method inspired by the spatial cells’ cognitive mechanism[J]. Computers and Electrical Engineering, 2022, 103: 108305.
DOI Google Scholar
[52]

CHEN Mengyuan, TIAN Dehong. Bionic SLAM algorithm based on multi-scale grid cell to place cell[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(5): 712-723.
DOI Google Scholar
[53]

ZHOU Yang, WU Dewei, SONG Yi, et al. Biological inspired goal-oriented navigation model based on spatial exploration and construction of cognitive map[J]. Journal of Electronics & Information Technology, 2023, 45(5): 1817-1823.
Google Scholar
[54]

CHAO Lixun, AUGENSTEIN P, ROENNAU A, et al. Brain inspired path planning algorithms for drones[J]. Frontiers in Neurorobotics, 2023, 17: 1111861.
DOI Google Scholar
[55]

LI Xingxing, HAN Xinjuan, LI Xin, et al. GREAT-UPD: an open-source software for uncalibrated phase delay estimation based on multi-GNSS and multi-frequency observations[J]. GPS Solutions, 2021, 25(2): 66.
DOI Google Scholar
[56]
WEN Weisong, ZHOU Yiyang, ZHANG Guohao, et al. UrbanLoco: a full sensor suite dataset for mapping and localization in urban scenes[C]// Proceedings of 2020 IEEE International Conference on Robotics and Automation. Paris, France: IEEE, 2020: 2310-2316.
DOI
[57]

YIN Jie, LI Ang, LI Tao, et al. M2DGR: a multi-sensor and multi-scenario SLAM dataset for ground robots[J]. IEEE Robotics and Automation Letters, 2022, 7(2): 2266-2273.
DOI Google Scholar
[58]

YU Fangwen, SHANG Jianga, HU Youjian, et al. NeuroSLAM: a brain-inspired SLAM system for 3D environments[J]. Biological Cybernetics, 2019, 113(5): 515-545.
DOI Google Scholar
[59]

ZENG Taiping, SI Bailu. A brain-inspired compact cognitive mapping system[J]. Cognitive Neurodynamics, 2021, 15(1): 91-101.
DOI Google Scholar
[60]
LIU Kefei, CUI Xiaoxin, KUANG Yisong, et al. An all-neuron spiking 2-D path integration and map representation model implemented on neuromorphic chips[C]// Proceedings of 2022 IEEE 16th International Conference on Solid-State & Integrated Circuit Technology. Nanjing, China: IEEE, 2022: 1-3.
DOI
[61]

TANG Huajin, YAN Rui, TAN K C. Cognitive navigation by neuro-inspired localization, mapping, and episodic memory[J]. IEEE Transactions on Cognitive and Developmental Systems, 2018, 10(3): 751-761.
DOI Google Scholar
[62]

SHEN Chong, LIU Xiaochen, CAO Huiliang, et al. Brain-like navigation scheme based on MEMS-INS and place recognition[J]. Applied Sciences, 2019, 9(8): 1708.
DOI Google Scholar
[63]

ZOU Qiang, CONG Ming, LIU Dong, et al. A neurobiologically inspired mapping and navigating framework for mobile robots[J]. Neurocomputing, 2021, 460: 181-194.
DOI Google Scholar
[64]

LIU Dong, LYU Zhi, ZOU Qiang, et al. Robotic navigation based on experiences and predictive map inspired by spatial cognition[J]. IEEE/ASME Transactions on Mechatronics, 2022, 27(6): 4316-4326.
DOI Google Scholar
[65]

HUA Tong, PEI Ling, LI Tao, et al. M2C-GVIO: motion manifold constraint aided GNSS-visual-inertial odometry for ground vehicles[J]. Satellite Navigation, 2023, 4(1): 13.
DOI Google Scholar
[66]
HUA Tong, LI Tao, PEI Ling. PIEKF-VIWO: visual-inertial-wheel odometry using partial invariant extended Kalman filter[C]// Proceedings of 2023 IEEE International Conference on Robotics and Automation. London, UK: IEEE, 2023.
DOI
[67]

LI Jinquan, PEI Ling, ZOU Danping, et al. Attention-SLAM: a visual monocular SLAM learning from human gaze[J]. IEEE Sensors Journal, 2021, 21(5): 6408-6420.
DOI Google Scholar
Publication history
Copyright

Publication history

Received: 06 August 2023
Accepted: 06 August 2023
Published: 20 September 2023
Issue date: September 2023

Copyright

© 2023 Journal of Geodesy and Geoinformation Science
Return