AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Plant Phenomics Article
Article Link
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

An Effective Image-Based Tomato Leaf Disease Segmentation Method Using MC-UNet

Yubao Deng1, Haoran Xi2, Guoxiong Zhou1( ), Aibin Chen1, Yanfeng Wang3, Liujun Li4, Yahui Hu5
College of Computer & Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
College of Mechanical & Electrical Engineering, Central South University of Forestry and Technology, Changsha, 410004, Hunan, China
National University of Defense Technology, 410015, Changsha, Hunan, China
Department of Soil and Water Systems, University of Idaho, Moscow, ID, 83844, USA
Plant Protection Research Institute, Academy of Agricultural Sciences, 410125, Changsha, Hunan, China
Show Author Information

Abstract

Tomato disease control is an urgent requirement in the field of intellectual agriculture, and one of the keys to it is quantitative identification and precise segmentation of tomato leaf diseases. Some diseased areas on tomato leaves are tiny and may go unnoticed during segmentation. Blurred edge also makes the segmentation accuracy poor. Based on UNet, we propose an effective image-based tomato leaf disease segmentation method called Cross-layer Attention Fusion Mechanism combined with Multi-scale Convolution Module (MC-UNet). First, a Multi-scale Convolution Module is proposed. This module obtains multiscale information about tomato disease by employing 3 convolution kernels of different sizes, and it highlights the edge feature information of tomato disease using the Squeeze-and-Excitation Module. Second, a Cross-layer Attention Fusion Mechanism is proposed. This mechanism highlights tomato leaf disease locations via gating structure and fusion operation. Then, we employ SoftPool rather than MaxPool to retain valid information on tomato leaves. Finally, we use the SeLU function appropriately to avoid network neuron dropout. We compared MC-UNet to the existing segmentation network on our self-built tomato leaf disease segmentation dataset and MC-UNet achieved 91.32% accuracy and 6.67M parameters. Our method achieves good results for tomato leaf disease segmentation, which demonstrates the effectiveness of the proposed methods.

References

1

Chen X, Zhou G, Chen A, Yi J, Zhang W, Hu Y. Identification of tomato leaf diseases based on combination of ABCK-BWTR and B-ARNet. Comput Electron Agric. 2020;178:105730.
Crossref Google Scholar
2

Benelli A, Cevoli C, Fabbri A. In-field hyperspectral imaging: An overview on the ground-based applications in agriculture. J Agric Eng. 2020;51(3):129–139.
Crossref Google Scholar
3

Liu J, Wang X. Tomato diseases and pests detection based on improved Yolo V3 convolutional neural network. Front Plant Sci. 2020;11:898.
Crossref Google Scholar
4

Wang Q, Qi F, Sun M, Qu J, Xue J. Identification of tomato disease types and detection of infected areas based on deep convolutional neural networks and object detection techniques. Comput Intell Neurosci. 2019;2019: e9142753.
Crossref Google Scholar
5

Conrad AO, Li W, Lee D-Y, Wang G-L, Rodriguez-Saona L, Bonello P. Machine learning-based presymptomatic detection of rice sheath blight using spectral profiles. Plant Phenomics. 2020;2020:8954085.
Crossref Google Scholar
6
Mokhtar U, Bendary NE, Hassenian AE, Emary E, Mahmoud MA, Hefny H, Tolba MF, SVM-based detection of tomato leaves diseases. In: Intelligent Systems’2014. Cham: Springer; 2015. p. 641–652.
Crossref
7

Tian H, Wang T, Liu Y, Qiao X, Li Y. Computer vision technology in agricultural automation —A review. Inf Process. Agric. 2020;7(1):1–19.
Crossref Google Scholar
8

Pan Y. Heading toward Artificial Intelligence 2.0. Engineering. 2016;2(4):409–413.
Crossref Google Scholar
9
Zhang X, Wang Y. Application Prospect of Internet of Things Technology in Rural Revitalization. Paper presented at IEEE: Proceedings of the 2020 5th International Conference on Mechanical, Control and Computer Engineering (ICMCCE 2020); 2020 December 25–27; Harbin, China.
Crossref
10

Zhang L, Zhou G, Lu C, Chen A, Wang Y, Li L, Cai W. MMDGAN: A fusion data augmentation method for tomato-leaf disease identification. Appl Soft Comput. 2022;123:108969.
Crossref Google Scholar
11

Johnson J, Sharma G, Srinivasan S, Masakapalli SK, Sharma S, Sharma J, Dua VK. Enhanced field-based detection of potato blight in complex backgrounds using deep learning. Plant Phenomics. 2021;2021:9835724.
Crossref Google Scholar
12

Liu Y, Hu Y, Cai W, Zhou G, Zhan J, Li L. DCCAM-MRNet: Mixed residual connection network with dilated convolution and coordinate attention mechanism for tomato disease identification. Comput Intell Neurosci. 2022;2022:e4848425.
Crossref Google Scholar
13

Zhang C, Zhou L, Xiao Q, Bai X, Wu B, Wu N, Zhao Y, Wang J, Feng L. End-to-end fusion of hyperspectral and chlorophyll fluorescence imaging to identify rice stresses. Plant Phenomics. 2022;2022:9851096.
Crossref Google Scholar
14

Ghosh S, Das N, Das I, Maulik U. Understanding deep learning techniques for image segmentation. ACM Comput Surv. 2019;52(4):1–35.
Crossref Google Scholar
15

Wang C, Du P, Wu H, Li J, Zhao C, Zhu H. A cucumber leaf disease severity classification method based on the fusion of DeepLabV3+ and U-Net. Comput Electron Agric. 2021;189:106373.
Crossref Google Scholar
16

Ji T, Li Z, Zhao J, Yao Y, Huang J. Segmentation method for plant leaves disease based on color difference. Hubei Agric Sci. 2018;57(18):94–97.
Google Scholar
17

Cheng C, Koschan A, Chen C-H, Page DL, Abidi MA. Outdoor scene image segmentation based on background recognition and perceptual organization. IEEE Trans Image Process. 2012;21(3):1007–1019.
Crossref Google Scholar
18
Wang M, Yu K, Xu X, Zhou Y, Peng Y, Xu Y, Goh RSM, Liu Y, Fu H. Tiny-lesion segmentation in OCT via multi-scale wavelet enhanced transformer. In: Antony B, Fu H, Lee CS, MacGillivray T, Xu Y, Zheng Y. editors. Ophthalmic medical image analysis. Cham (Switzerland): Springer; 2022. p. 125–134.
Crossref
19

Yuan Y, Li M, Chen S, Jiang H, Dong J. Segmentation of cucumber leaf disease lmages with complex background. Trans Chin Soc Agric Mach. 2013;44(10):233–237.
Google Scholar
20

Wu A, Li Y, He Y, Wang Y, Zhu J. Developing lmage segmentation system of maize leaf disease. Hubei Agric Sci. 2014;53(17):4178–4181.
Google Scholar
21

Lin K, Si H, Zhou Q, Wu J, Chen J. Plant leaf edge detection based on fuzzy logic. Trans Chin Soc Agric Mach. 2013;44(06):227–231.
Google Scholar
22
Zhou R, Kaneko S, Tanaka F, Kayamori M, Shimizu M. Early detection and continuous quantization of plant disease using template matching and support vector machine algorithms. Paper presented at: IEEE: Proceedings of the 2013 First International Symposium on Computing and Networking; 2013 December 4–6: Matsuyama, Japan.
Crossref
23

Verdi S, Barat JM, Grau R. Laser scattering imaging combined with CNNs to model the textural variability in a vegetable food tissue. J Food Eng. 2023;336:111199.
Crossref Google Scholar
24

Liu L, Cheng X, Lai J. Segmentation method for cotton canopy image based on improved fully convolutional network model. Trans Chin Soc Agric Eng. 2018;34(12):193–201.
Google Scholar
25

Xiong X, Duan L, Liu L, Tu H, Yang P, Wu D, Chen G, Xiong L, Yang W, Liu Q. Panicle-SEG: A robust image segmentation method for rice panicles in the field based on deep learning and superpixel optimization. Plant Methods. 2017;13(1):104.
Crossref Google Scholar
26

Ma J, Du K, Zheng F, Zhang L, Sun Z. Disease recognition system for greenhouse cucumbers based on deep convolutional neural network. Trans Chin Soc Agric Eng. 2018;34(12):186–192.
Google Scholar
27

Pound MP, Atkinson JA, Townsend AJ, Wilson MH, Griffiths M, Jackson AS, Bulat A, Tzimiropoulos G, Wells DM, Murchie EH, et al. Deep machine learning provides state-of-the-art performance in image-based plant phenotyping. GigaScience. 2017;6(10):gix083.
Crossref Google Scholar
28

Zhao B, Feng Q. Segmentation of grape diseases leaf based on full convolution network. J Nanjing Agric Univ. 2018;41(4):752–759.
Google Scholar
29

Ren S, Jia F, Gu X, Yuan P, Xue W, Xu H. Recognition and segmentation model of tomato leaf diseases based on deconvolution-guiding. Trans Chin Soc Agric Eng. 2020;36(12):186–195.
Google Scholar
30

Chowdhury MEH, Rahman T, Khandakar A, Ayari MA, Khan AU, Khan MS, al-Emadi N, Reaz MBI, Islam MT, Ali SHM. Automatic and reliable leaf disease detection using deep learning techniques. AgriEngineering. 2021;3(2):294–312.
Crossref Google Scholar
31

Liang Q, Xiang S, Hu Y, Coppola G, Zhang D, Sun W. PD2SE-Net: Computer-assisted plant disease diagnosis and severity estimation network. Comput Electron Agric. 2019;157:518–529.
Crossref Google Scholar
32

Xiong Y, Liang L, Wang L, She J, Wu M. Identification of cash crop diseases using automatic image segmentation algorithm and deep learning with expanded dataset. Comput Electron Agric. 2020;177:105712.
Crossref Google Scholar
33
Ronneberger O, Fischer P, Brox T. U-Net: Convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A, editors. Medical image computing and computer-assisted intervention. Cham (Switzerland): Springer; 2015; vol. 9351; p. 234–241.
Crossref
34

Wang S, Hou X, Zhao X. Automatic building extraction from high-resolution aerial imagery via fully convolutional encoder-decoder network with non-local block. IEEE Access. 2020;8:7313–7322.
Crossref Google Scholar
35

Xu L, Liu Y, Yang P, Chen H, Zhang H, Wang D, Zhang X. HA U-Net: Improved model for building extraction from high resolution remote sensing imagery. IEEE Access. 2021;9:101972–101984.
Crossref Google Scholar
36

Liu W, Xu J, Guo Z, Li E, Li X, Zhang L, Liu W. Building footprint extraction from unmanned aerial vehicle images Via PRU-Net: Application to change detection. IEEE J Sel Top Appl Earth Obs Remote Sens. 2021;14:2236–2248.
Crossref Google Scholar
37

Zhang R, Zhu F, Liu J, Liu G. Depth-wise separable convolutions and multi-level pooling for an efficient spatial CNN-based steganalysis. IEEE Trans Inf Forensics Secur. 2020;15:1138–1150.
Crossref Google Scholar
38

Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging. 2020;39(6):1856–1867.
Crossref Google Scholar
39
Vuola AO, Akram SU, Kannala J. Mask-RCNN and U-Net ensembled for nuclei segmentation. Paper presented at IEEE: Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019); 2019 April 8–11; Venice, Italy.
Crossref
40
Iglovikov V, Shvets A. TernausNet: U-Net with VGG11 encoder pre-trained on imagenet for image segmentation. arXiv. 2018. https://doi.org/10.48550/arXiv.1801.05746
41
Hughes DP, Salathe M. An open access repository of images on plant health to enable the development of mobile disease diagnostics arXiv. 2016. https://doi.org/10.48550/arXiv.1511.08060
42
Hu J, Shen L, Sun G. Squeeze-and-excitation networks. Paper presented at IEEE: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; Salt Lake City, UT USA; 2018 June 18–23.
Crossref
43

Obeso AM, Benois-Pineau J, Vazquez MSG, Acosta AAR. Visual vs internal attention mechanisms in deep neural networks for image classification and object detection. Pattern Recogn. 2022;123:108411.
Crossref Google Scholar
44
Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X. Residual attention network for image classification. Paper presented at: IEEE: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 July 21–26; Honolulu, HI.
Crossref
45
Eriguchi A, Tsuruoka Y, Cho K. Learning to parse and translate improves neural machine translation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Vol 2, Stroudsburg, 2017, pp. 72–78.
Crossref
46
Anderson P, He X, Buehler C, Teney D, Johnson M, Gould S, Zhang L. Bottom-up and top-down attention for image captioning and visual question answering. Paper presented at: IEEE:2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; Salt Lake City, UT.
Crossref
47

Derrac J, García S, Molina D, Herrera F. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput. 2011;1(1):3–18.
Crossref Google Scholar
48
Woo S, Park J, Lee JY, Kweon IS. Cbam: Convolutional block attention module. Paper presented at: Proceedings of the European Conference on Computer Vision (ECCV); 2018.
Crossref
49
Hou Q, Zhou D, Feng J. Coordinate attention for efficient mobile network design. Paper presented at: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2021.
Crossref
50
Wang Q, Wu B, Zhu P, Li P, Zuo W, Hu Q. ECA-Net: Efficient channel attention for deep convolutional neural networks. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2020; Seattle (WA).
Crossref
51
Chen J, Lu Y, Yu Q, Luo X, Adeli E, Wang Y, Lu L, Yuille AL, Zhou Y. TransUNet: Transformers make strong encoders for medical image segmentation. arXiv. 2021. https://doi.org/10.48550/arXiv.2102.04306
52
Oktay O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, Donagh SM, Hammerla NY, Kainz B, Attention U-Net: Learning where to look for the pancreas. arXiv. 2018. https://doi.org/10.48550/arXiv.1804.03999
53

Badrinarayanan V, Kendall A, Cipolla R. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2017;39(12):2481–2495.
Crossref Google Scholar
54
Chen L-C, Papandreou G, Schroff F, Adam H. Rethinking atrous convolution for semantic image segmentation. arXiv, 2017. https://doi.org/10.48550/arXiv.1706.05587
Crossref
55
Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. Paper presented at: IEEE:2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 July 21–26; Honolulu, HI.
Crossref
56

Cai M, Yi X, Wang G, Mo L, Wu P, Mwanza C, Kapula KE. Image segmentation method for sweetgum leaf spots based on an improved DeeplabV3+ network. Forests. 2022;13(12):2095.
Crossref Google Scholar
57

Yu H, Men Z, Bi C, Liu H. Research on field soybean weed identification based on an improved UNet model combined with a channel attention mechanism. Front Plant Sci. 2022;13:890051.
Crossref Google Scholar
58

Zhang S, Zhang C. Modified U-Net for plant diseased leaf image segmentation. Comput Electron Agric. 2023;204:107511.
Crossref Google Scholar
59

Barbedo JGA. Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng. 2018;172:84–91.
Crossref Google Scholar
Plant Phenomics
Volume 5,
2023
Article number: 0049
DOI: 10.34133/plantphenomics.0049
Cite this article:
Deng Y, Xi H, Zhou G, et al. An Effective Image-Based Tomato Leaf Disease Segmentation Method Using MC-UNet. Plant Phenomics, 2023, 5: 0049. https://doi.org/10.34133/plantphenomics.0049

249

Views

47

Crossref

38

Web of Science

46

Scopus

0

CSCD

Altmetrics
Received: 18 November 2022
Accepted: 21 April 2023
Published: 15 May 2023
© 2023 Yubao Deng et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License (CC BY 4.0).
Return