Research Article
Open Access
Issue
Published:
03 January 2023
Open Access
Issue
Published:
03 January 2023
Specificity-preserving RGB-D saliency detection
Deng-Ping Fan3(
),
),
Keywords:
RGB-D, salient object detection (SOD), cross-enhanced integration module (CIM), multi-modal feature aggregation (MFA)
Cite this article:
Zhou T, Fan D-P, Chen G, et al.
Specificity-preserving RGB-D saliency detection.
Computational Visual Media,
2023, 9(2): 297-317.
https://doi.org/10.1007/s41095-022-0268-6
Download citation
6648
Views
49
Downloads
Citations
2
Crossref
3
WoS
2
Scopus
0
CSCD
Salient object detection (SOD) in RGB and depth images has attracted increasing research interest. Existing RGB-D SOD models usually adopt fusion strategies to learn a shared representation from RGB and depth modalities, while few methods explicitly consider how to preserve modality-specific characteristics. In this study, we propose a novel framework, the specificity-preserving network (SPNet), which improves SOD performance by exploring both the shared information and modality-specific properties. Specifically, we use two modality-specific networks and a shared learning network to generate individual and shared saliency prediction maps. To effectively fuse cross-modal features in the shared learning network, we propose a cross-enhanced integration module (CIM) and propagate the fused feature to the next layer to integrate cross-level information. Moreover, to capture rich complementary multi-modal information to boost SOD performance, we use a multi-modal feature aggregation (MFA) module to integrate the modality-specific features from each individual decoder into the shared decoder. By using skip connections between encoder and decoder layers, hierarchical features can be fully combined. Extensive experiments demonstrate that our SPNet outperforms cutting-edge approaches on six popular RGB-D SOD and three camouflaged object detection benchmarks. The project is publicly available at https://github.com/taozh2017/SPNet.
menu
Abstract
Full text
Outline
About this article
Specificity-preserving RGB-D saliency detection
Deng-Ping Fan3(
),
),
Abstract
Salient object detection (SOD) in RGB and depth images has attracted increasing research interest. Existing RGB-D SOD models usually adopt fusion strategies to learn a shared representation from RGB and depth modalities, while few methods explicitly consider how to preserve modality-specific characteristics. In this study, we propose a novel framework, the specificity-preserving network (SPNet), which improves SOD performance by exploring both the shared information and modality-specific properties. Specifically, we use two modality-specific networks and a shared learning network to generate individual and shared saliency prediction maps. To effectively fuse cross-modal features in the shared learning network, we propose a cross-enhanced integration module (CIM) and propagate the fused feature to the next layer to integrate cross-level information. Moreover, to capture rich complementary multi-modal information to boost SOD performance, we use a multi-modal feature aggregation (MFA) module to integrate the modality-specific features from each individual decoder into the shared decoder. By using skip connections between encoder and decoder layers, hierarchical features can be fully combined. Extensive experiments demonstrate that our SPNet outperforms cutting-edge approaches on six popular RGB-D SOD and three camouflaged object detection benchmarks. The project is publicly available at https://github.com/taozh2017/SPNet.
Keywords:
RGB-D, salient object detection (SOD), cross-enhanced integration module (CIM), multi-modal feature aggregation (MFA)
References(105)
[1]
Peng, H.; Li, B.; Xiong, W.; Hu, W.; Ji, R. RGBD salient object detection: A benchmark and algorithms. In: Computer Vision – ECCV 2014. Lecture Notes in Computer Science, Vol. 8691. Fleet, D.; Pajdla, T.; Schiele, B.; Tuytelaars, T. Eds. Springer Cham, 92–109, 2014.
[2]
Zhu, J.-Y.; Wu, J.-J.; Xu, Y.; Chang, E.; Tu, Z. W. Unsupervised object class discovery via saliency-guided multiple class learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 37, No. 4, 862–875, 2015.
[3]
Rapantzikos, K.; Avrithis, Y.; Kollias, S. Dense saliency-based spatiotemporal feature points for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1454–1461, 2009.
[4]
Shimoda, W.; Yanai, K. Distinct class-specific saliency maps for weakly supervised semantic segmentation. In: Computer Vision – ECCV 2016. Lecture Notes in Computer Science, Vol. 9908. Leibe, B.; Matas, J.; Sebe, N.; Welling, M. Eds. Springer Cham, 218–234, 2016.
[5]
Wang, W. G.; Shen, J. B.; Yang, R. G.; Porikli, F. Saliency-aware video object segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 40, No. 1, 20–33, 2018.
[6]
Zhao, R.; Oyang, W.; Wang, X. Person re-identification by saliency learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 39, No. 2, 356–370, 2017.
[7]
Fan, D. P.; Lin, Z.; Zhang, Z.; Zhu, M. L.; Cheng, M. M. Rethinking RGB-D salient object detection: Models, data sets, and large-scale benchmarks. IEEE Transactions on Neural Networks and Learning Systems Vol. 32, No. 5, 2075–2089, 2021.
[8]
Zhang, J.; Fan, D.-P.; Dai, Y. C.; Yu, X.; Zhong,Y. R.; Barnes, N.; Shao, L. RGB-D saliency detection via cascaded mutual information minimization. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4318–4327, 2021.
[9]
Liu, N.; Zhang, N.; Wan, K. Y.; Shao, L.; Han, J. W. Visual saliency transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4702–4712, 2021.
[10]
Zhou, T.; Fan, D. P.; Cheng, M. M.; Shen, J. B.; Shao, L. RGB-D salient object detection: A survey. Computational Visual Media Vol. 7, No. 1, 37–69, 2021.
[11]
Fu, K. R.; Fan, D. P.; Ji, G. P.; Zhao, Q. J.; Shen, J. B.; Zhu, C. Siamese network for RGB-D salient object detection and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
[12]
Zhang, J.; Fan, D.-P.; Dai, Y. C.; Anwar, S., Saleh, F., Aliakbarian, S.; Barnes, N. Uncertainty inspired RGB-D saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
[13]
Chen, H.; Li, Y. F.; Deng, Y. J.; Lin, G. S. CNN-based RGB-D salient object detection: Learn, select, and fuse. International Journal of Computer Vision Vol. 129, No. 7, 2076–2096, 2021.
[14]
Li, G. Y.; Liu, Z.; Chen, M. Y.; Bai, Z.; Lin, W. S.; Ling, H. B. Hierarchical alternate interaction network for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 30, 3528–3542, 2021.
[15]
Zhao, Y. F.; Zhao, J. W.; Li, J.; Chen, X. W. RGB-D salient object detection with ubiquitous target awareness. IEEE Transactions on Image Processing Vol. 30, 7717–7731, 2021.
[16]
Ren, J. Q.; Gong, X. J.; Lu, Y.; Zhou, W. H.; Yang, M. Y. Exploiting global priors for RGB-D saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 25–32, 2015.
[17]
Song, H. K.; Liu, Z.; Du, H.; Sun, G. L.; Le Meur, O.; Ren, T. W. Depth-aware salient object detection and segmentation via multiscale discriminative saliency fusion and bootstrap learning. IEEE Transactions on Image Processing Vol. 26, No. 9, 4204–4216,2017.
[18]
Liu, Z. Y.; Shi, S.; Duan, Q. T.; Zhang, W.; Zhao, P. Salient object detection for RGB-D image by single stream recurrent convolution neural network. Neurocomputing Vol. 363, 46–57, 2019.
[19]
Guo, J. F.; Ren, T. W.; Bei, J. Salient object detection for RGB-D image via saliency evolution. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 1–6, 2016.
[20]
Wang, N. N.; Gong, X. J. Adaptive fusion for RGB-D salient object detection. IEEE Access Vol. 7, 55277–55284, 2019.
[21]
Ding, Y.; Liu, Z.; Huang, M. K.; Shi, R.; Wang, X. Y. Depth-aware saliency detection using convolutional neural networks. Journal of Visual Communication and Image Representation Vol. 61, 1–9, 2019.
[22]
Chen, H.; Li, Y. F. Progressively complementarity-aware fusion network for RGB-D salient object detection. In: Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition, 3051–3060, 2018.
[23]
Liu, D.; Hu, Y.; Zhang, K.; Chen, Z. Two-stream refinement network for RGB-D saliency detection. In: Proceedings of the IEEE International Conference on Image Processing, 3925–3929, 2019.
[24]
Chen, H.; Li, Y. F. Three-stream attention-aware network for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 28, No. 6, 2825–2835, 2019.
[25]
Han, J. W.; Chen, H.; Liu, N.; Yan, C. G.; Li, X. L. CNNs-based RGB-D saliency detection via cross-view transfer and multiview fusion. IEEE Transactions on Cybernetics Vol. 48, No. 11, 3171–3183, 2018.
[26]
Chen, H.; Li, Y. F.; Su, D. Attention-aware cross-modal cross-level fusion network for RGB-D salient object detection. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 6821–6826, 2018.
[27]
Ji, W.; Li, J. J.; Yu, S.; Zhang, M.; Piao, Y. R.; Yao, S. Y.; Bi, Q.; Ma, K.; Zheng, Y.; Lu, H.; et al. Calibrated RGB-D salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9466–9476, 2021.
[28]
Huang, Z.; Chen, H. X.; Zhou, T.; Yang, Y. Z.; Liu, B. Y. Multi-level cross-modal interaction network for RGB-D salient object detection. Neurocomputing Vol. 452, 200–211, 2021.
[29]
Chen, H.; Li, Y. F.; Su, D. Multi-modal fusion network with multi-scale multi-path and cross-modal interactions for RGB-D salient object detection. Pattern Recognition Vol. 86, 376–385, 2019.
[30]
Zhao, J.-X.; Cao, Y.; Fan, D.-P.; Cheng, M.-M.; Li, X.-Y.; Zhang, L. Contrast prior and fluid pyramid integration for RGBD salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3922–3931, 2019.
[31]
Zhu, C. B.; Cai, X.; Huang, K.; Li, T. H.; Li, G. PDNet: Prior-model guided depth-enhanced network for salient object detection. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 199–204, 2019.
[32]
Fan, D. P.; Zhai, Y.; Borji, A.; Yang, J.; Shao, L. BBS-Net: RGB-D salient object detection with a bifurcated backbone strategy network. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12357. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 275–292, 2020.
[33]
Zhai, Y. J.; Fan, D.-P.; Yang, J. F.; Borji, A.; Shao, L.; Han, J. W.; Wang, L. Bifurcated backbone strategy for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 30, 8727–8742, 2021.
[34]
Hu, J. L.; Lu, J. W.; Tan, Y. P. Sharable and individual multi-view metric learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 40, No. 9, 2281–2288, 2018.
[35]
Lu, Y.; Wu, Y.; Liu, B.; Zhang, T.; Li, B.; Chu, Q.; Yu, N. Cross-modality person re-identification with shared-specific feature transfer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13376–13386, 2020.
[36]
Zhou, T.; Zhang, C.; Peng, X.; Bhaskar, H.; Yang, J. Dual shared-specific multiview subspace clustering. IEEE Transactions on Cybernetics Vol. 50, No. 8, 3517–3530, 2020.
[37]
Zhou, T.; Fu, H. Z.; Chen, G.; Shen, J. B.; Shao, L. Hi-net: Hybrid-fusion network for multi-modal MR image synthesis. IEEE Transactions on Medical Imaging Vol. 39, No. 9, 2772–2781, 2020.
[38]
Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Lecture Notes in Computer Science, Vol. 9351. Navab, N.; Hornegger, J.; Wells, W.; Frangi, A. Eds. Springer Cham, 234–241, 2015.
[39]
Zhou, T.; Fu, H.; Chen, G.; Zhou, Y.; Fan, D.-P.; Shao, L. Specificity-preserving RGB-D saliency detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4661–4671, 2021.
[40]
Zhu, W. J.; Liang, S.; Wei, Y. C.; Sun, J. Saliency optimization from robust background detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2814–2821, 2014.
[41]
Achanta, R.; Hemami, S.; Estrada, F.; Susstrunk, S. Frequency-tuned salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1597–1604, 2009.
[42]
Zhou, L.; Yang, Z. H.; Yuan, Q.; Zhou, Z. T.; Hu, D. W. Salient region detection via integrating diffusion-based compactness and local contrast. IEEE Transactions on Image Processing Vol. 24, No. 11, 3308–3320, 2015.
[43]
Jiang, Z. L.; Davis, L. S. Submodular salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2043–2050, 2013.
[44]
Hou, Q. B.; Cheng, M. M.; Hu, X. W.; Borji, A.; Tu, Z. W.; Torr, P. H. S. Deeply supervised salient object detection with short connections. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 41, No. 4, 815–828, 2019.
[45]
Wang, L. Z.; Wang, L. J.; Lu, H. C.; Zhang, P. P.; Ruan, X. Salient object detection with recurrent fully convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 41, No. 7, 1734–1746, 2019.
[46]
Liu, N.; Han, J.; Yang, M. PiCANet: Learning pixel-wise contextual attention for saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3089–3098, 2018.
[47]
Deng, Z.; Hu, X.; Zhu, L.; Xu, X.; Qin, J.; Han, G.; Heng, P.-A. R
[48]
Wang, W.; Lai, Q.; Fu, H.; Shen, J.; Ling, H.; Yang, R. Salient object detection in the deep learning era: An in-depth survey. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 44, No. 6, 3239–3259, 2022.
[49]
Wang, X.; Ma, H.; Chen, X.; You, S. Edge preserving and multi-scale contextual neural network for salient object detection. IEEE Transactions on Image Processing Vol. 27, No. 1, 121–134, 2018.
[50]
Zhang, P. P.; Wang, D.; Lu, H. C.; Wang, H. Y.; Ruan, X. Amulet: Aggregating multi-level convolutional features for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, 202–211, 2017.
[51]
Zhang, L.; Dai, J.; Lu, H. C.; He, Y.; Wang, G. A bi-directional message passing model for salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1741–1750, 2018.
[52]
Pang, Y. W.; Zhao, X. Q.; Zhang, L. H.; Lu, H. C. Multi-scale interactive network for salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9410–9419, 2020.
[53]
Lang, C.; Nguyen, T. V.; Katti, H.; Yadati, K.; Kankanhalli, M.; Yan, S. Depth matters: Influence of depth cues on visual saliency. In: Computer Vision – ECCV 2012. Lecture Notes in Computer Science, Vol. 7573. Fitzgibbon, A.; Lazebnik, S.; Perona, P.; Sato, Y.; Schmid, C. Eds. Springer Berlin Heidelberg, 101–115, 2012.
[54]
Ju, R.; Ge, L.; Geng, W.; Ren, T.; Wu, G. Depth saliency based on anisotropic center-surround difference. In: Proceedings of the IEEE International Conference on Image Processing, 1115–1119, 2014.
[55]
Desingh, K.; Krishna, K. M.; Rajan, D.; Jawahar, C. V. Depth really matters: Improving visual salient region detection with depth. In: Proceedings of the British Machine Vision Conference, 98.1–98.11, 2013.
[56]
Zhu, C. B.; Li, G.; Wang, W. M.; Wang, R. G. An innovative salient object detection using center-dark channel prior. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, 1509–1515, 2017.
[57]
Liang, F. F.; Duan, L. J.; Ma, W.; Qiao, Y. H.; Cai, Z.; Qing, L. Y. Stereoscopic saliency model using contrast and depth-guided-background prior. Neurocomputing Vol. 275, 2227–2238, 2018.
[58]
Feng, D.; Barnes, N.; You, S. D.; McCarthy, C. Local background enclosure for RGB-D salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2343–2350, 2016.
[59]
Qu, L. Q.; He, S. F.; Zhang, J. W.; Tian, J. D.; Tang, Y. D.; Yang, Q. X. RGBD salient object detection via deep fusion. IEEE Transactions on Image Processing Vol. 26, No. 5, 2274–2285, 2017.
[60]
Piao, Y. R.; Ji, W.; Li, J. J.; Zhang, M.; Lu, H. C. Depth-induced multi-scale recurrent attention network for saliency detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 7253–7262, 2019.
[61]
Li, C. Y.; Cong, R. M.; Piao, Y. R.; Xu, Q. Q.; Loy, C. C. RGB-D salient object detection with cross-modality modulation and selection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12353. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 225–241, 2020.
[62]
Li, G. Y.; Liu, Z.; Ye, L. W.; Wang, Y.; Ling, H. B. Cross-modal weighting network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12362. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 665–681, 2020.
[63]
Chaudhuri, K.; Kakade, S. M.; Livescu, K.; Sridharan, K. Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, 129–136, 2009.
[64]
Ding, C. X.; Tao, D. C. Robust face recognition via multimodal deep face representation. IEEE Transactions on Multimedia Vol. 17, No. 11, 2049–2058, 2015.
[65]
Gönen, M.; Alpaydın, E. Multiple kernel learning algorithms. The Journal of Machine Learning Research Vol. 12, 2211–2268, 2011.
[66]
White, M.; Yu, Y.; Zhang, X.; Schuurmans, D. Convex multi-view subspace learning. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, Vol. 1, 1673–1681, 2012.
[67]
Zhang, C. Q.; Hu, Q. H.; Fu, H. Z.; Zhu, P. F.; Cao, X. C. Latent multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4333–4341, 2017.
[68]
Ngiam, J.; Khosla, A.; Kim, M.; Nam, J.; Lee, H.; Ng, A. Multimodal deep learning. In: Proceedings of the 28th International Conference on International Conference on Machine Learning, 689–696, 2011.
[69]
Eitel, A.; Springenberg, J. T.; Spinello, L.; Riedmiller, M.; Burgard, W. Multimodal deep learning for robust RGB-D object recognition. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 681–687, 2015.
[70]
Gao, S. H.; Cheng, M. M.; Zhao, K.; Zhang, X. Y.; Yang, M. H.; Torr, P. Res2Net: A new multi-scale backbone architecture. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 43, No. 2, 652–662, 2021.
[71]
Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; et al. ImageNet large scale visual recognition challenge. International Journal of Computer Vision Vol. 115, No. 3, 211–252, 2015.
[72]
Wu, Z.; Su, L.; Huang, Q. M. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3902–3911, 2019.
[73]
Wei, J.; Wang, S.; Huang, Q. F
[74]
Cheng, Y. P.; Fu, H. Z.; Wei, X. X.; Xiao, J. J.; Cao, X. C. Depth enhanced saliency detection method. In: Proceedings of the International Conference on Internet Multimedia Computing and Service, 23–27, 2014.
[75]
Li, G.; Zhu, C. B. A three-pathway psychobiological framework of salient object detection using stereo-scopic technology. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, 3008–3014, 2017.
[76]
Niu, Y. Z.; Geng, Y. J.; Li, X. Q.; Liu, F. Leveraging stereopsis for saliency analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 454–461, 2012.
[77]
Cheng, M. M.; Fan, D. P. Structure-measure: A new way to evaluate foreground maps. International Journal of Computer Vision Vol. 129, No. 9, 2622–2638, 2021.
[78]
Fan, D.-P.; Gong, C.; Cao, Y.; Ren, B.; Cheng, M.-M.; Borji, A. Enhanced-alignment measure for binary foreground map valuation. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, 698–704, 2018.
[79]
Perazzi, F.; Krähenbühl, P.; Pritch, Y.; Hornung, A. Saliency filters: Contrast based filtering for salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 733–740, 2012.
[80]
Cong, R. M.; Lei, J. J.; Zhang, C. Q.; Huang, Q. M.; Cao, X. C.; Hou, C. P. Saliency detection for stereoscopic images based on depth confidence analysis and multiple cues fusion. IEEE Signal Processing Letters Vol. 23, No. 6, 819–823, 2016.
[81]
Cong, R. M.; Lei, J. J.; Fu, H. Z.; Hou, J. H.; Huang, Q. M.; Kwong, S. Going from RGB to RGBD saliency: A depth-guided transformation model. IEEE Transactions on Cybernetics Vol. 50, No. 8, 3627–3639, 2020.
[82]
Jiang, B.; Zhou, Z. T.; Wang, X.; Tang, J.; Luo, B. cmSalGAN: RGB-D salient object detection with cross-view generative adversarial networks. IEEE Transactions on Multimedia Vol. 23, 1343–1353, 2021.
[83]
Li, C. Y.; Cong, R. M.; Kwong, S.; Hou, J. H.; Fu, H. Z.; Zhu, G. P.; Zhang, D.; Huang, Q. ASIF-Net: Attention steered interweave fusion network for RGB-D salient object detection. IEEE Transactions on Cybernetics Vol. 51, No. 1, 88–100, 2021.
[84]
Li, G.; Liu, Z.; Ling, H. ICNet: Information conversion network for RGB-D based salient object detection. IEEE Transactions on Image Processing Vol. 29, 4873–4884, 2020.
[85]
Piao, Y. R.; Rong, Z. K.; Zhang, M.; Ren, W. S.; Lu, H. C. A2dele: Adaptive and attentive depth distiller for efficient RGB-D salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9057–9066, 2020.
[86]
Liu, N.; Zhang, N.; Han, J. W. Learning selective self-mutual attention for RGB-D saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13753–13762, 2020.
[87]
Zhang, M.; Ren, W. S.; Piao, Y. R.; Rong, Z. K.; Lu, H. C. Select, supplement and focus for RGB-D saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3469–3478, 2020.
[88]
Pang, Y.; Zhang, L.; Zhao, X.; Lu, H. Hierarchical dynamic filtering network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12370. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 235–252, 2020.
[89]
Luo, A.; Li, X.; Yang, F.; Jiao, Z.; Cheng, H.; Lyu, S. Cascade graph neural networks for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12357. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springe Cham, 346–364, 2020.
[90]
Ji, W.; Li, J.; Zhang, M.; Piao, Y.; Lu, H. Accurate RGB-D salient object detection via collaborative learning. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12363. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 52–69, 2020.
[91]
Zhao, X.; Zhang, L.; Pang, Y.; Lu, H.; Zhang, L. A single stream network for robust and real-time RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12367. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 646–662, 2020.
[92]
Chen, S.; Fu, Y. Progressively guided alternate refinement network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12353. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 520–538, 2020.
[93]
Lin, T. Y.; Dollár, P.; Girshick, R.; He, K. M.; Hariharan, B.; Belongie, S. Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 936–944, 2017.
[94]
He, K. M.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, 2980–2988, 2017.
[95]
Zhao, H. S.; Shi, J. P.; Qi, X. J.; Wang, X. G.; Jia, J. Y. Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 6230–6239, 2017.
[96]
Qin, X. B.; Zhang, Z. C.; Huang, C. Y.; Gao, C.; Dehghan, M.; Jagersand, M. BASNet: Boundary-aware salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7471–7481, 2019.
[97]
Zhao, T.; Wu, X. Q. Pyramid feature attention network for saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3080–3089, 2019.
[98]
Wu, Z.; Su, L.; Huang, Q. M. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3902–3911, 2019.
[99]
Zhao, J. X.; Liu, J. J.; Fan, D. P.; Cao, Y.; Yang, J. F.; Cheng, M. M. EGNet: Edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 8778–8787, 2019.
[100]
Fan, D.-P.; Ji, G.-P.; Cheng, M.-M.; Shao, L. Concealed object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
[101]
Sun, Y. J.; Chen, G.; Zhou, T.; Zhang, Y.; Liu, N. Context-aware cross-level fusion network for camouflaged object detection. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence, 1025–1031, 2021.
[102]
Li, L.; Dong, B.; Rigall, E.; Zhou, T.; Dong, J. Y.; Chen, G. Marine animal segmentation. IEEE Transactions on Circuits and Systems for Video Technology Vol. 32, No. 4, 2303–2314, 2022.
[103]
Zhang, J.; Lv, Y.; Xiang, M.; Li, A.; Dai, Y.; Zhong, Y. Depth confidence-aware camouflaged object detection. arXiv preprint arXiv:2106.13217, 2021.
[104]
Le, T. N.; Nguyen, T. V.; Nie, Z. L.; Tran, M. T.; Sugimoto, A. Anabranch network for camouflaged object segmentation. Computer Vision and Image Understanding Vol. 184, 45–56, 2019.
[105]
Fan, D.-P.; Ji, G.-P.; Sun, G.; Cheng, M.-M.; Shen, J.; Shao, L. Camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2774–2784, 2020.
Publication history
Copyright
Acknowledgements
Rights and permissions
Publication history
Received: 19 October 2021
Accepted: 01 January 2022
Published:
03 January 2023
Issue date: June 2023
Copyright
© The Author(s) 2022.
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant No. 62172228, in part by an Open Project of the Key Laboratory of System Control and Information Processing, Ministry of Education (Shanghai Jiao Tong University, No. Scip202102).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduc-tion in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
FEEDBACK 
TOP