Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
Instance segmentation plays an important role in image processing. The Deep Snake algorithm based on contour iteration deforms an initial bounding box to an instance contour end-to-end, which can improve the performance of instance segmentation, but has defects such as slow segmentation speed and sub-optimal initial contour. To solve these problems, a real-time instance segmentation algorithm based on contour learning was proposed. Firstly, ShuffleNet V2 was used as backbone network, and the receptive field of the model was expanded by using a 5×5 convolution kernel. Secondly, a lightweight up-sampling module, multi-stage aggregation (MSA), performs residual fusion of multi-layer features, which not only improves segmentation speed, but also extracts effective features more comprehensively. Thirdly, a contour initialization method for network learning was designed, and a global contour feature aggregation mechanism was used to return a coarse contour, which solves the problem of excessive error between manually initialized contour and real contour. Finally, the Snake deformation module was used to iteratively optimize the coarse contour to obtain the final instance contour. The experimental results showed that the proposed method improved the instance segmentation accuracy on semantic boundaries dataset(SBD), Cityscapes and Kins datasets, and the average precision reached 55.8 on the SBD; Compared with Deep Snake, the model parameters were reduced by 87.2%, calculation amount was reduced by 78.3%, and segmentation speed reached 39.8 frame·s-1 when instance segmentation was performed on an image with a size of 512×512 pixels on a 2080Ti GPU. The proposed method can reduce resource consumption, realize instance segmentation tasks quickly and accurately, and therefore is more suitable for embedded platforms with limited resources.
SU L, SUN Y X, YUAN S Z. A Survey of instance segmentation based on deep learning. Journal of Intelligent Systems, 2022, 17(1):16-31.
LI X X, HU X G, QUAN Y C, et al. Research progress of instance segmentation based on deep learning. Computer Engineering and Applications, 2021, 57(9): 60-67.
HAFIZ A M, BHAT G M. A survey on instance segmentation: state of the art. International Journal of Multimedia Information Retrieval, 2020, 9(3): 171-189.
REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networkrs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
WANG X, ZHANG R, KONG T, et al. Solov2: Dynamic and fast instance segmentation. Advances in Neural Information Processing Systems, 2020, 33: 17721-17732.
The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.