Journal Home > Volume 26 , Issue 6

The accurate segmentation of medical images is crucial to medical care and research; however, many efficient supervised image segmentation methods require sufficient pixel level labels. Such requirement is difficult to meet in practice and even impossible in some cases, e.g., rare Pathoma images. Inspired by traditional unsupervised methods, we propose a novel Chan-Vese model based on the Markov chain for unsupervised medical image segmentation. It combines local information brought by superpixels with the global difference between the target tissue and the background. Based on the Chan-Vese model, we utilize weight maps generated by the Markov chain to model and solve the segmentation problem iteratively using the min-cut algorithm at the superpixel level. Our method exploits abundant boundary and local region information in segmentation and thus can handle images with intensity inhomogeneity and object sparsity. In our method, users gain the power of fine-tuning parameters to achieve satisfactory results for each segmentation. By contrast, the result from deep learning based methods is rigid. The performance of our method is assessed by using four Computerized Tomography (CT) datasets. Experimental results show that the proposed method outperforms traditional unsupervised segmentation techniques.


menu
Abstract
Full text
Outline
About this article

A Chan-Vese Model Based on the Markov Chain for Unsupervised Medical Image Segmentation

Show Author's information Quanwei HuangYuezhi Zhou( )Linmi Tao( )Weikang YuYaoxue ZhangLi HuoZuoxiang He
BNRist; and Key Laboratory of Pervasive Computing (Ministry of Education) and the Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
School of Electronic and Information Engineering, Beihang University, Beijing 100191, China
Department of Nuclear Medicine, Peking Union Medical College Hospital, Beijing 100730, China
School of Clinical Medicine, Tsinghua University
Beijing Tsinghua Changgung Hospital, Beijing 100084, China

Abstract

The accurate segmentation of medical images is crucial to medical care and research; however, many efficient supervised image segmentation methods require sufficient pixel level labels. Such requirement is difficult to meet in practice and even impossible in some cases, e.g., rare Pathoma images. Inspired by traditional unsupervised methods, we propose a novel Chan-Vese model based on the Markov chain for unsupervised medical image segmentation. It combines local information brought by superpixels with the global difference between the target tissue and the background. Based on the Chan-Vese model, we utilize weight maps generated by the Markov chain to model and solve the segmentation problem iteratively using the min-cut algorithm at the superpixel level. Our method exploits abundant boundary and local region information in segmentation and thus can handle images with intensity inhomogeneity and object sparsity. In our method, users gain the power of fine-tuning parameters to achieve satisfactory results for each segmentation. By contrast, the result from deep learning based methods is rigid. The performance of our method is assessed by using four Computerized Tomography (CT) datasets. Experimental results show that the proposed method outperforms traditional unsupervised segmentation techniques.

Keywords: medical image, Markov chain, unsupervised segmentation

References(31)

[1]
C. T. Yeo, T. Ungi, P. U. Thainual, A. Lasso, R. C. McGraw, and G. Fichtinger, The effect of augmented reality training on percutaneous needle placement in spinal facet joint injections, IEEE Trans. Bio-Med. Eng., vol. 58, no. 7, pp. 2031-2037, 2011.
[2]
A. Y. Yang, J. Wright, Y. Ma, and S. Sastry, Unsupervised segmentation of natural images via lossy data compression, Comput. Vis. Image Underst., vol. 110, no. 2, pp. 212-225, 2008.
[3]
L. W. Goldman, Principles of CT and CT technology, J. Nucl. Med. Technol., vol. 35, no. 3, pp. 115-128, 2007.
[4]
B. Hui, Y. Liu, J. Qiu, L. Cao, L. Ji, and Z. He, Study of texture segmentation and classification for grading small hepatocellular carcinoma based on CT images, Tsinghua Science and Technology, vol. 26, no. 2, pp. 199-207, 2021.
[5]
G. Zheng, G. Han, and N. Q. Soomro, An inception module CNN classifiers fusion method on pulmonary nodule diagnosis by signs, Tsinghua Science and Technology, vol. 25, no. 3, pp. 368-383, 2020.
[6]
O. Ronneberger, P. Fischer, and T. Brox, U-net: Convolutional networks for biomedical image segmentation, arXiv preprint arXiv: 1505.04597, 2015.
[7]
X. D. Xia and B. Kulis, W-net: A deep model for fully unsupervised image segmentation, arXiv preprint arXiv: 1711.08506, 2017.
[8]
A. B. Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, S. Garcia, S. Gil-Lopez, D. Molina, R. Benjamins, et al., Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI, Inf. Fusion, vol. 58, pp. 82-115, 2020.
[9]
A. Kanezaki, Unsupervised image segmentation by backpropagation, presented at IEEE Int. Conf. Acoustics, Speech and Signal Proc. (ICASSP), Calgary, Canada, 2018, pp. 1543-1547.
DOI
[10]
T. Cour, F. Benezit, and J. B. Shi, Spectral segmentation with multiscale graph decomposition, presented at 2005 IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA, 2005, pp. 1124-1131.
[11]
J. B. Shi and J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, 2000.
[12]
Y. Zhang, M. Brady, and S. M. Smith, Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm, IEEE Trans. Med. Imag., vol. 20, no. 1, pp. 45-57, 2001.
[13]
P. Arbeláez, M. Maire, C. Fowlkes, and J. Malik, Contour detection and hierarchical image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, 2011.
[14]
D. Comaniciu and P. Meer, Mean shift: A robust approach toward feature space analysis, IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, 2002.
[15]
M. Kass, A. Witkin, and D. Terzopoulos, Snakes: Active contour models, Int. J. Comput. Vis., vol. 1, no. 4, pp. 321- 331, 1988.
[16]
T. F. Chan and L. A. Vese, Active contours without edges, IEEE Trans. Image Proc., vol. 10, no. 2, pp. 266-277, 2001.
[17]
X. Fan, M. Dai, C. Liu, F. Wu, X. Yan, Y. Feng, Y. Feng, and B. Su, Effect of image noise on the classification of skin lesions using deep convolutional neural networks, Tsinghua Science and Technology, vol. 25, no. 3, pp. 425-434, 2020.
[18]
T. Mcinerney and D. Terzopoulos, Deformable models in medical image analysis: A survey, Med. Image Anal., vol. 1, no. 2, pp. 91-108, 1996.
[19]
D. L. Pham, C. Y. Xu, and J. L. Prince, A survey of current methods in medical image segmentation, Annu. Rev. Biomed. Eng., vol. 2, pp. 315-337, 2000.
[20]
E. Shelhamer, J. Long, and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 4, pp. 640-651, 2017.
[21]
L. C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFS, IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 4, pp. 834-848, 2018.
[22]
Y. Y. Boykov and M. P. Jolly, Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images, in Proc. 8th IEEE Int. Conf. Computer Vision, Vancouver, Canada, 2001, pp. 105-112.
[23]
C. Rother, V. Kolmogorov, and A. Blake, “Grabcut”: Interactive foreground extraction using iterated graph cuts, ACM Trans. Graph., vol. 23, no. 3, pp. 309-314, 2004.
[24]
C. M. Li, C. Y. Kao, J. C. Gore, and Z. H. Ding, Implicit active contours driven by local binary fitting energy, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA, 2007, pp. 1-7.
DOI
[25]
X. F. Wang, D. S. Huang, and H. Xu, An efficient local Chan-Vese model for image segmentation, Pattern Recognit., vol. 43, no. 3, pp. 603-618, 2010.
[26]
S. G. Liu and Y. L. Peng, A local region-based Chan-Vese model for image segmentation, Pattern Recognit., vol. 45, no. 7, pp. 2769-2779, 2012.
[27]
C. M. Li, C. Y. Xu, C. F. Gui, and M. D. Fox, Distance regularized level set evolution and its application to image segmentation, IEEE Trans. Image Proc., vol. 19, no. 12, pp. 3243-3254, 2010.
[28]
R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk, SLIC superpixels compared to state-of-the-art superpixel methods, IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, 2012.
[29]
O. Veksler, Y. Boykov, and P. Mehrani, Superpixels and supervoxels in an energy optimization framework, in Computer Vision-ECCV 2010, K. Daniilidis, P. Maragos, and N. Paragios, eds. Cham, Germany: Springer, 2010, pp. 211-224.
DOI
[30]
J. B. Shen, Y. F. Du, W. G. Wang, and X. L. Li, Lazy random walks for superpixel segmentation, IEEE Trans. Image Proc., vol. 23, no. 4, pp. 1451-1462, 2014.
[31]
M. S. Aslan, A. Shalaby, and A. A. Farag, Clinically desired segmentation method for vertebral bodies, presented at 2013 IEEE 10th Int. Symp. Biomedical Imaging, San Francisco, CA, USA, 2013, pp. 840-843.
DOI
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 17 August 2020
Accepted: 23 September 2020
Published: 09 June 2021
Issue date: December 2021

Copyright

© The author(s) 2021.

Acknowledgements

This paper was supported by the National Natural Science Foundation of China (Nos. 61672017 and 61272232), and the Key-Area Research and Development Program of Guangdong Province (No. 2019B010137005).

Rights and permissions

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return