Open Access
Issue
Published:
07 October 2019
An Inception Module CNN Classifiers Fusion Method on Pulmonary Nodule Diagnosis by Signs
Guangyuan Zheng(
),
),
Keywords:
Convolutional Neural Network (CNN), lung cancer, sign, pulmonary nodule, Artificial Immune Algorithm (AIA)
Cite this article:
Zheng G, Han G, Soomro NQ.
An Inception Module CNN Classifiers Fusion Method on Pulmonary Nodule Diagnosis by Signs.
Tsinghua Science and Technology,
2020, 25(3): 368-383.
https://doi.org/10.26599/TST.2019.9010010
Download citation
650
Views
38
Downloads
Citations
29
Crossref
N/A
WoS
32
Scopus
0
CSCD
A "sign" on a lung CT image refers to a radiologic finding that suggests a pathological progression of some specific disease. Analysis of CT signs is helpful to understand the pathological origin of the lesion. In-depth study of lung nodules classification with different CT signs will help to distinguish benign and malignant nodules more clearly and accurately. To this end, we propose an Inception module-based ensemble classification method for pulmonary nodule diagnosis with different nodule signs. We first construct a Convolutional Neural Network (CNN) classifier adopting Inception modules and pre-train it on ImageNet. We then fine-tune this pre-trained classifier on 10 different lung nodule sign sample sets, and fuse these 10 classifiers with an artificial immune ensemble algorithm. The overall sensitivity, specificity, and accuracy of our proposed Artificial Immune Algorithm-based Inception Networks Fusion (AIA-INF) algorithm are 82.22%, 93.17%, and 88.67%, respectively, which are significantly higher than those of the alternative Bagging and Boosting methods. The experimental results show that our Inception-based ensemble classifier offers promising performance, and compared with other CADx systems, this scheme can offer a more detailed reference for diagnosis, and can be valuable for junior radiologist training.
menu
Abstract
Full text
Outline
About this article
An Inception Module CNN Classifiers Fusion Method on Pulmonary Nodule Diagnosis by Signs
Guangyuan Zheng(
),
),
Abstract
A "sign" on a lung CT image refers to a radiologic finding that suggests a pathological progression of some specific disease. Analysis of CT signs is helpful to understand the pathological origin of the lesion. In-depth study of lung nodules classification with different CT signs will help to distinguish benign and malignant nodules more clearly and accurately. To this end, we propose an Inception module-based ensemble classification method for pulmonary nodule diagnosis with different nodule signs. We first construct a Convolutional Neural Network (CNN) classifier adopting Inception modules and pre-train it on ImageNet. We then fine-tune this pre-trained classifier on 10 different lung nodule sign sample sets, and fuse these 10 classifiers with an artificial immune ensemble algorithm. The overall sensitivity, specificity, and accuracy of our proposed Artificial Immune Algorithm-based Inception Networks Fusion (AIA-INF) algorithm are 82.22%, 93.17%, and 88.67%, respectively, which are significantly higher than those of the alternative Bagging and Boosting methods. The experimental results show that our Inception-based ensemble classifier offers promising performance, and compared with other CADx systems, this scheme can offer a more detailed reference for diagnosis, and can be valuable for junior radiologist training.
Keywords:
Convolutional Neural Network (CNN), lung cancer, sign, pulmonary nodule, Artificial Immune Algorithm (AIA)
References(68)
[1]
A. Jones, D. Stockton, A. Simpson, and J. Murchison, Idiopathic venous thromboembolic disease is associated with a poorer prognosis from subsequent malignancy, British Journal of Cancer, vol. 101, no. 5, p. 840, 2009.
[2]
G. K. Singh and A. Jemal, Socioeconomic and racial/ethnic disparities in cancer mortality, incidence, and survival in the United States, 1950–2014: Over six decades of changing patterns and widening inequalities, Journal of Environmental and Public Health, vol. 2017, pp. 1–19, 2017.
[3]
T. B. Richards, S. J. Henley, M. C. Puckett, H. K. Weir, B. Huang, and T. C. Tucker, Abstract B29: Trends in racial disparities in five-year net survival for lung cancer, 2001–2009, in AACR, Washington, DC, USA, 2017, p. B29.
[4]
G. V. Scagliotti, Symptoms, signs and staging of lung cancer, European Respiratory Monograph, vol. 6, no. 17, pp. 86–119, 2001.
[5]
K. Alzahouri, M. Velten, P. Arveux, M.-C. Woronoff-Lemsi, D. Jolly, and F. Guillemin, Management of SPN in France. Pathways for definitive diagnosis of solitary pulmonary nodule: A multicentre study in 18 French districts, BMC Cancer, vol. 8, no. 1, p. 93, 2008.
[6]
International Early Lung Cancer Action Progrom Investigators, Survival of patients with stage I lung cancer detected on CT screening, New England Journal of Medicine, vol. 355, no. 17, pp. 1763–1771, 2006.
[7]
J. Okami, Y. Ito, M. Higashiyama, T. Nakayama, T. Tokunaga, J. Maeda, and K. Kodama, Sublobar resection provides an equivalent survival after lobectomy in elderly patients with early lung cancer, The Annals of Thoracic Surgery, vol. 90, no. 5, pp. 1651–1656, 2010.
[8]
M.-L. Chabi, I. Borget, R. Ardiles, G. Aboud, S. Boussouar, V. Vilar, C. Dromain, and C. Balleyguier, Evaluation of the accuracy of a computer-aided diagnosis (CAD) system in breast ultrasound according to the radiologist’s experience, Academic Radiology, vol. 19, no. 3, pp. 311–319, 2012.
[9]
D. S. Gierada, T. K. Pilgram, M. Ford, R. M. Fagerstrom, T. R. Church, H. Nath, K. Garg, and D. C. Strollo, Lung cancer: Interobserver agreement on interpretation of pulmonary findings at low-dose CT screening, Radiology, vol. 246, no. 1, pp. 265–272, 2008.
[10]
S. G. Armato, F. Li, M. L. Giger, H. MacMahon, S. Sone, and K. Doi, Lung cancer: Performance of automated lung nodule detection applied to cancers missed in a CT screening program, Radiology, vol. 225, no. 3, pp. 685–692, 2002.
[11]
F. Li, S. Sone, H. Abe, H. MacMahon, S. G. Armato, and K. Doi, Lung cancers missed at low-dose helical CT screening in a general population: Comparison of clinical, histopathologic, and imaging findings, Radiology, vol. 225, no. 3, pp. 673–683, 2002.
[12]
J. Collins, CT signs and patterns of lung disease., Radiol Clinics, vol. 39, no. 6, pp. 1115–1135, 2001.
[13]
S. G. Spiro, M. K. Gould, and G. L. Colice, Initial evaluation of the patient with lung cancer: Symptoms, signs, laboratory tests, and paraneoplastic syndromes: ACCP evidenced-based clinical practice guidelines (2nd edition), Chest, vol. 132, no. 3, p. 149S–160S, 2007.
[14]
C. V. Zwirewich, S. Vedal, R. R. Miller, and N. L. Müller, Solitary pulmonary nodule: High-resolution CT and radiologic-pathologic correlation, Radiology, vol. 179, no. 2, pp. 469–476, 1991.
[15]
D. E. Wood, G. A. Eapen, D. S. Ettinger, L. Hou, D. Jackman, E. Kazerooni, D. Klippenstein, R. P. Lackner, L. Leard, A. N. Leung, et al., Lung cancer screening, Journal of the National Comprehensive Cancer Network, vol. 10, no. 2, pp. 240–265, 2012.
[16]
S. G. Armato, G. McLennan, L. Bidaut, M. F. McNitt-Gray, C. R. Meyer, A. P. Reeves, B. Zhao, D. R. Aberle, C. I. Henschke, E. A. Hoffman, et al., The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans, Medical Physics, vol. 38, no. 2, pp. 915–931, 2011.
[17]
T. W. Way, B. Sahiner, H.-P. Chan, L. Hadjiiski, P. N. Cascade, A. Chughtai, N. Bogot, and E. Kazerooni, Computer-aided diagnosis of pulmonary nodules on CT scans: Improvement of classification performance with nodule surface features, Medical Physics, vol. 36, no. 7, pp. 3086–3098, 2009.
[18]
I. C. Sluimer, P. F. van Waes, M. A. Viergever, and B. van Ginneken, Computer-aided diagnosis in high resolution CT of the lungs, Medical Physics, vol. 30, no. 12, pp. 3081–3090, 2003.
[19]
P. D. Korfiatis, A. N. Karahaliou, A. D. Kazantzi, C. Kalogeropoulou, and L. I. Costaridou, Texture-based identification and characterization of interstitial pneumonia patterns in lung multidetector CT, IEEE Transactions on Information Technology in Biomedicine, vol. 14, no. 3, pp. 675–680, 2010.
[20]
L. Sørensen, P. Lo, H. Ashraf, J. Sporring, M. Nielsen, and M. De Bruijne, Learning COPD sensitive filters in pulmonary CT, in International Conference on Medical Image Computing and Computer-Assisted Intervention, London, UK, 2009, pp. 699–706.
[21]
C. Jacobs, E. M. van Rikxoort, E. T. Scholten, P. A. de Jong, M. Prokop, C. Schaefer-Prokop, and B. van Ginneken, Solid, part-solid, or non-solid?: Classification of pulmonary nodules in low-dose chest computed tomography by a computer-aided diagnosis system, Investigative Radiology, vol. 50, no. 3, pp. 168–173, 2015.
[22]
X. Ye, X. Lin, J. Dehmeshki, G. Slabaugh, and G. Beddoe, Shape-based computer-aided detection of lung nodules in thoracic CT images, IEEE Transactions on Biomedical Engineering, vol. 56, no. 7, pp. 1810–1820, 2009.
[23]
M. Firmino, G. Angelo, H. Morais, M. R. Dantas, and R. Valentim, Computer-aided detection (CADe) and diagnosis (CADx) system for lung cancer with likelihood of malignancy, Biomedical Engineering Online, vol. 15, no. 1, p. 2, 2016.
[24]
T. Sun, R. Zhang, J. Wang, X. Li, and X. Guo, Computer-aided diagnosis for early-stage lung cancer based on longitudinal and balanced data, PloS One, vol. 8, no. 5, p. e63559, 2013.
[25]
T. Sun, J. Wang, X. Li, P. Lv, F. Liu, Y. Luo, Q. Gao, H. Zhu, and X. Guo, Comparative evaluation of support vector machines for computer aided diagnosis of lung cancer in CT based on a multi-dimensional data set, Computer Methods and Programs in Biomedicine, vol. 111, no. 2, pp. 519–524, 2013.
[26]
W. Sun, B. Zheng, and W. Qian, Computer aided lung cancer diagnosis with deep learning algorithms, in Medical Imaging 2016: Computer-Aided Diagnosis, San Diege, CA, USA, 2016, vol. 9785, p. 97850Z, 2016.
[27]
F. Han, H. Wang, B. Song, G. Zhang, H. Lu, W. Moore, H. Zhao, and Z. Liang, A new 3D texture feature-based computer-aided diagnosis approach to differentiate pulmonary nodules, in Medical Imaging 2013: Computer-Aided Diagnosis, Dresden, Germany, vol. 8670, p. 86702Z, 2013.
[28]
F. Han, H. Wang, G. Zhang, H. Han, B. Song, L. Li, W. Moore, H. Lu, H. Zhao, and Z. Liang, Texture feature analysis for computer-aided diagnosis on pulmonary nodules, Journal of Digital Imaging, vol. 28, no. 1, pp. 99–115, 2015.
[29]
M. G. Penedo, M. J. Carreira, A. Mosquera, and D. Cabello, Computer-aided diagnosis: A neural-network-based approach to lung nodule detection, IEEE Transactions on Medical Imaging, vol. 17, no. 6, pp. 872–880, 1998.
[30]
M. Tan, R. Deklerck, B. Jansen, M. Bister, and J. Cornelis, A novel computer-aided lung nodule detection system for CT images, Medical Physics, vol. 38, no. 10, pp. 5630–5645, 2011.
[31]
S. E. Darmanayagam, K. N. Harichandran, S. R. R. Cyril, and K. Arputharaj, A novel supervised approach for segmentation of lung parenchyma from chest CT for computer-aided diagnosis, Journal of Digital Imaging, vol. 26, no. 3, pp. 496–509, 2013.
[32]
A. S. Abdalla, I. A. Yusuf, S. H. A. A. Mohammed, M. A. Mahmoud, and Z. A. Mustafa, A computer-aided diagnosis system for classification of lung tumors, Journal of Clinical Engineering, vol. 40, no. 3, pp. 130–134, 2015.
[33]
R. Niehaus, D. S. Raicu, J. Furst, and S. Armato, Toward understanding the size dependence of shape features for predicting spiculation in lung nodules for computer-aided diagnosis, Journal of Digital Imaging, vol. 28, no. 6, pp. 704–717, 2015.
[34]
L. Breiman, Bagging predictors, Machine Learning, vol. 24, no. 2, pp. 123–140, 1996.
[35]
B. Verma and J. Zakos, A computer-aided diagnosis system for digital mammograms based on fuzzy-neural and feature extraction techniques, IEEE Transactions on Information Technology in Biomedicine, vol. 5, no. 1, pp. 46–54, 2001.
[36]
L. Ma, X. Liu, L. Song, C. Zhou, X. Zhao, and Y. Zhao, A new classifier fusion method based on historical and on-line classification reliability for recognizing common CT imaging signs of lung diseases, Computerized Medical Imaging and Graphics, vol. 40, pp. 39–48, 2015.
[37]
J. Y. Choi, D. H. Kim, K. N. Plataniotis, and Y. M. Ro, Classifier ensemble generation and selection with multiple feature representations for classification applications in computer-aided detection and diagnosis on mammography, Expert Systems with Applications, vol. 46, pp. 106–121, 2016.
[38]
S. Hussein, K. Cao, Q. Song, and U. Bagci, Risk stratification of lung nodules using 3D CNN-based multi-task learning, in International Conference on Information Processing in Medical Imaging, Boone, NC, USA, 2017, pp. 249–260.
[39]
W. Shen, M. Zhou, F. Yang, D. Yu, D. Dong, C. Yang, Y. Zang, and J. Tian, Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification, Pattern Recognition, vol. 61, pp. 663–673, 2017.
[40]
G. Wei, H. Ma, W. Qian, F. Han, H. Jiang, S. Qi, and M. Qiu, Lung nodule classification using local kernel regression models with out-of-sample extension, Biomedical Signal Processing and Control, vol. 40, pp. 1–9, 2018.
[41]
Q. Song, L. Zhao, X. Luo, and X. Dou, Using deep learning for classification of lung nodules on computed tomography images, Journal of Healthcare Engineering, vol. 2017, pp. 1–7, 2017.
[42]
K. Liu and G. Kang, Multiview convolutional neural networks for lung nodule classification, International Journal of Imaging Systems and Technology, vol. 27, no. 1, pp. 12–22, 2017.
[43]
A. Tartar, N. Kilic, and A. Akan, Bagging support vector machine approaches for pulmonary nodule detection, in 2013 International Conference of Control, Decision and Information Technologies (CoDIT), Hammamet, Tunisia, 2013, pp. 047–050.
[44]
A. Tartar and A. Akan, Ensemble learning approaches to classification of pulmonary nodules, in 2016 International Conference of Control, Decision and Information Technologies (CoDIT), Saint Julian’s, Malta, 2016, pp. 472–477.
[45]
M. A. Jaffar, A. B. Siddiqui, and M. Mushtaq, Ensemble classification of pulmonary nodules using gradient intensity feature descriptor and differential evolution, Cluster Computing, vol. 231, no. 1, pp. 393–407, 2018.
[46]
Y. Xie, Y. Xia, J. Zhang, D. D. Feng, M. Fulham, and W. Cai, Transferable multi-model ensemble for benign-malignant lung nodule classification on chest CT, in International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City, Canada, 2017, pp. 656–664.
[47]
F. V. Farahani, A. Ahmadi, and M. F. Zarandi, Lung nodule diagnosis from CT images based on ensemble learning, in 2015 IEEE Conference of Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), Niagara Falls, Canada, 2015, pp. 1–7.
[48]
L. K. Hansen and P. Salamon, Neural network ensembles, IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 12, no. 10, pp. 993–1001, 2002.
[49]
Z. H. Zhou, J. Wu, and W. Tang, Ensembling neural networks: Many could be better than all, Artificial Intelligence, vol. 137, nos. 1&2, pp. 239–263, 2002.
[50]
[51]
A. Krizhevsky, I. Sutskever, and G. E. Hinton, Imagenet classification with deep convolutional neural networks, in Proceedings of Advances in Neural Information Processing Systems, Lake Tahoe, NE, USA, 2012, pp. 1097–1105.
[52]
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, and M. Bernstein, ImageNet large scale visual recognition challenge, International Journal of Computer Vision, vol. 115, no. 3, pp. 211–252, 2015.
[53]
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, ImageNet: A large-scale hierarchical image database, in IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 2009, pp. 248–255.
[54]
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, Going deeper with convolutions, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 2015, pp. 1–9.
[55]
K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556, 2014.
[56]
K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 2016, pp. 770–778.
[57]
C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, Inception-v4, Inception-resnet and the impact of residual connections on learning, in 31th AAAI Conference on Artificaial Intelligence, San Francisco, CA, USA, 2017, vol. 4, p. 12.
[58]
B. Van Ginneken, S. G. Armato III, B. de Hoop, S. van Amelsvoort-van de Vorst, T. Duindam, M. Niemeijer, K. Murphy, A. Schilham, A. Retico, M. E. Fantacci, et al., Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study, Medical Image Analysis, vol. 14, no. 6, pp. 707–722, 2010.
[59]
D. E. Ost and M. K. Gould, Decision making in patients with pulmonary nodules, American Journal of Respiratory and Critical Care Medicine, vol. 185, no. 4, pp. 363–372, 2012.
[60]
P. Opulencia, D. S. Channin, D. S. Raicu, and J. D. Furst, Mapping LIDC, RadLexTM, and lung nodule image features, Journal of Digital Imaging, vol. 24, no. 2, pp. 256–270, 2011.
[61]
M. F. Mcnitt-Gray, E. M. Hart, N. Wyckoff, J. W. Sayre, J. G. Goldin, and D. R. Aberle, A pattern classification approach to characterizing solitary pulmonary nodules imaged on high resolution CT: Preliminary results, Medical Physics, vol. 26, no. 6, p. 880, 1999.
[62]
G. Han, X. Liu, F. Han, I. Santika, Y. Zhao, X. Zhao, and C. Zhou, The LISS—A public database of common imaging signs of lung diseases for computer-aided detection and diagnosis research and medical education, IEEE Transactions on Biomedical Engineering, vol. 62, no. 2, pp. 648–656, 2015.
[63]
D. Bertsimas and J. Tsitsiklis, Simulated annealing, Statistical Science, vol. 8, no. 1, pp. 10–15, 1993.
[64]
L. B. Booker, D. E. Goldberg, and J. H. Holland, Classifier systems and genetic algorithms, Artificial Intelligence, vol. 40, no. 1–3, pp. 235–282, 1989.
[65]
R. E. Schapire, The strength of weak learnability, Machine Learing, vol. 5, no. 2, pp. 1979–227, 1990.
[66]
Z.-H. Zhou, Y. Jiang, Y.-B. Yang, and S.-F. Chen, Lung cancer cell identification based on artificial neural network ensembles, Artificial Intelligence in Medicine, vol. 24, no. 1, pp. 25–36, 2002.
[67]
H. Chen, W. Wu, H. Xia, J. Du, M. Yang, and B. Ma, Classification of pulmonary nodules using neural network ensemble, in International Symposium on Neural Networks, Guilin, China, 2011, pp. 460–466.
[68]
R. Paul, L. Hall, D. Goldgof, M. Schabath, and R. Gillies, Predicting nodule malignancy using a CNN ensemble approach, in 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, France, 2018, pp. 1–8.
Publication history
Copyright
Rights and permissions
Publication history
Received: 08 November 2018
Revised: 11 March 2019
Accepted: 12 March 2019
Published:
07 October 2019
Issue date: June 2020
Copyright
© The author(s) 2020
Rights and permissions
The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
FEEDBACK 
TOP