AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Plant Phenomics Article
Article Link
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

PDDD-PreTrain: A Series of Commonly Used Pre-Trained Models Support Image-Based Plant Disease Diagnosis

Xinyu Dong1, Qi Wang1( ), Qianding Huang1, Qinglong Ge1, Kejun Zhao1, Xingcai Wu1, Xue Wu1, Liang Lei2, Gefei Hao1,3( )
State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang 550025, China
The School of Physics and Optoelectronic Engineering, Guangdong University of Technology, Guangzhou 510006, China
National Key Laboratory of Green Pesticide, Key Laboratory of Green Pesticide and Agricultural Bioengineering, Ministry of Education, Guizhou University, Guiyang 550025, China
Show Author Information

Abstract

Plant diseases threaten global food security by reducing crop yield; thus, diagnosing plant diseases is critical to agricultural production. Artificial intelligence technologies gradually replace traditional plant disease diagnosis methods due to their time-consuming, costly, inefficient, and subjective disadvantages. As a mainstream AI method, deep learning has substantially improved plant disease detection and diagnosis for precision agriculture. In the meantime, most of the existing plant disease diagnosis methods usually adopt a pre-trained deep learning model to support diagnosing diseased leaves. However, the commonly used pre-trained models are from the computer vision dataset, not the botany dataset, which barely provides the pre-trained models sufficient domain knowledge about plant disease. Furthermore, this pre-trained way makes the final diagnosis model more difficult to distinguish between different plant diseases and lowers the diagnostic precision. To address this issue, we propose a series of commonly used pre-trained models based on plant disease images to promote the performance of disease diagnosis. In addition, we have experimented with the plant disease pre-trained model on plant disease diagnosis tasks such as plant disease identification, plant disease detection, plant disease segmentation, and other subtasks. The extended experiments prove that the plant disease pre-trained model can achieve higher accuracy than the existing pre-trained model with less training time, thereby supporting the better diagnosis of plant diseases. In addition, our pre-trained models will be open-sourced at https://pd.samlab.cn/ and Zenodo platform https://doi.org/10.5281/zenodo.7856293.

References

1
Food and Agriculture Organization. World food and agriculture—statistical yearbook 2020. Rome (Italy): FAO; 2020.
2
Bruinsma J. The resource outlook to 2050: By how much do land, water and crop yields need to increase by 2050? How to feed the World in 2050. Paper presnted at: Proceedings of a Technical Meeting of Experts; 2009 Jun 24–26; Rome, Italy.
3

Li Z, Paul R, Ba Tis T, Saville AC, Hansel JC, Yu T, Ristaino JB, Wei Q. Non-invasive plant disease diagnostics enabled by smartphone-based fingerprinting of leaf volatiles. Nat Plants. 2019;5(8):856–866.
Crossref Google Scholar
4

Liu B, Zhang Y, He D, Li Y. Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry. 2017;10(1):11.
Crossref Google Scholar
5

Ebrahimi M, Khoshtaghaza MH, Minaei S, Jamshidi B. Vision-based pest detection based on SVM classification method. Comput Electron Agric. 2017;137:52–58.
Crossref Google Scholar
6

Dutot M, Nelson L, Tyson R. Predicting the spread of postharvest disease in stored fruit, with application to apples. Postharvest Biol Technol. 2013;85:45–56.
Crossref Google Scholar
7

Mahlein A-K, Rumpf T, Welke P, Dehne H-W, Plümer L, Steiner U, Oerke E-C. Development of spectral indices for detecting and identifying plant diseases. Remote Sens Environ. 2013;128:21–30.
Crossref Google Scholar
8

Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Commun ACM. 2017;60(6):84–90.
Crossref Google Scholar
9
Simonyan K, Zisserman A, Very deep convolutional networks for large-scale image recognition. arXiv. 2014. arXiv.1409.1556.
10
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A, Going deeper with convolutions. Paper presented at: IEEE: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2015 Jun 7–12; Boston, MA.
Crossref
11

Zhou H, Zhao H, Wang Q, Lei L, Hao G, Xu Y, Ye Z. Emo-mvs: Error-aware multi-scale iterative variable optimizer for efficient multi-view stereo. Remote Sens. 2022;14(23):6085.
Crossref Google Scholar
12

Wang F, Yang J-F, Wang M-Y, Jia C-Y, Shi X-X, Hao G-F, Yang G-F. Graph attention convolutional neural network model for chemical poisoning of honey bees’ prediction. Sci Bull. 2020;65(14):1184–1191.
Crossref Google Scholar
13

Wang Q, Lai J, Yang Z, Xu K, Kan P, Liu W, Lei L. Improving cross-dimensional weighting pooling with multi-scale feature fusion for image retrieval. Neurocomputing. 2019;363:17–26.
Crossref Google Scholar
14

Xie G-S, Zhang X-Y, Yan S, Liu C-L. Hybrid cnn and dictionary-based models for scene recognition and domain adaptation. IEEE Trans Circuits Syst Video Technol. 2015;27(6):1263–1274.
Crossref Google Scholar
15

Wang Q, Lai J, Claesen L, Yang Z, Lei L, Liu W. A novel feature representation: Aggregating convolution kernels for image retrieval. Neural Netw. 2020;130:1–10.
Crossref Google Scholar
16

Sladojevic S, Arsenovic M, Anderla A, Culibrk D, Stefanovic D. Deep neural networks based recognition of plant diseases by leaf image classification. Comput Intell Neurosci. 2016;2016:3289801.
Crossref Google Scholar
17

Mohanty SP, Hughes DP, Salathé M. Using deep learning for image-based plant disease detection. Front Plant Sci. 2016;7:1419.
Crossref Google Scholar
18

Brahimi M, Boukhalfa K, Moussaoui A. Deep learning for tomato diseases: Classification and symptoms visualization. Appl Artif Intell. 2017;31(4):299–315.
Crossref Google Scholar
19

Lu Y, Yi S, Zeng N, Liu Y, Zhang Y. Identification of rice diseases using deep convolutional neural networks. Neurocomputing. 2017;267:378–384.
Crossref Google Scholar
20

Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, et al. Imagenet large scale visual recognition challenge. Int J Comput Vis. 2015;115(3):211–252.
Crossref Google Scholar
21
He K, Zhang X, Ren S, Sun J, Deep residual learning for image recognition. Paper presented at: IEEE: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016 Jun 27–30; Las Vegas, NV.
22

Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes DP. Deep learning for image-based cassava disease detection. Front Plant Sci. 2017;8:1852.
Crossref Google Scholar
23

Wang G, Sun Y, Wang J. Automatic image-based plant disease severity estimation using deep learning. Comput Intell Neurosci. 2017;2017:2917536.
Google Scholar
24

Fuentes A, Yoon S, Kim SC, Park DS. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors. 2017;17(9):2022.
Crossref Google Scholar
25
Guo W, Zheng B, Potgieter AB, Diot J, Watanabe K, Noshita K, Jordan DR, Wang X, Watson J, Ninomiya S, et al. Aerial imagery analysis–quantifying appearance and number of sorghum heads for applications in breeding and agronomy. Front Plant Sci. 2018;1544.
26

Ferentinos KP. Deep learning models for plant disease detection and diagnosis. Comput Electron Agric. 2018;145:311–318.
Crossref Google Scholar
27

Zheng C, Abd-Elrahman A, Whitaker VM, Dalid C. Deep learning for strawberry canopy delineation and biomass prediction from high-resolution images. Plant Phenomics. 2022;2022:9850486.
Google Scholar
28

Johnson J, Sharma G, Srinivasan S, Masakapalli SK, Sharma S, Sharma J, Dua VK. Enhanced field-based detection of potato blight in complex backgrounds using deep learning. Plant Phenomics. 2021;2021:9835724.
Google Scholar
29

Zhang W, Wang J, Liu Y, Chen K, Li H, Duan Y, Wu W, Shi Y, Guo W. Deep-learning-based in-field citrus fruit detection and tracking. Hortic Res. 2022;9:uhac003.
Crossref Google Scholar
30
Redmon J, Farhadi A. Yolo9000: Better, faster, stronger. Paper presented at: IEEE: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 Jul 21–26; Honolulu, HI.
31

Liu X, Min W, Mei S, Wang L, Jiang S. Plant disease recognition: A large-scale benchmark dataset and a visual region and loss reweighting approach. IEEE Trans Image Process. 2021;30:2003–2015.
Crossref Google Scholar
32
Mwebaze E, Gebru T, Frome A, Nsumba S, Tusubira J. iCassava 2019 fine-grained visual categorization challenge. arXiv. 2019. arXiv: 1908.02900.
33
Hughes DP, Salathé M. An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv. 2015. arXiv: 1511.08060.
34
Wu X, Zhan C, Lai Y-K, Cheng M-M, Yang J. IP102: A large-scale benchmark dataset for insect pest recognition. Paper presented at: IEEE: Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2019 Jun 15–20; Long Beach, CA.
Crossref
35
Kaeser-Chen C, Fruit P, Maggie, Sohler D. Plant pathology 2020 fgvc7. 2020; https://kaggle.com/competitions/plant-pathology-2020-fgvc7.
36
Fruit pathology, Dane S. Plant pathology 2021 - fgvc8, 2021; https://kaggle.com/competitions/plant-pathology-2021-fgvc8.
37
Chouhan SS, Singh UP, Kaul A, Jain S. A data repository of leaf images: Practice towards plant conservation with plant pathology. Paper presented at: IEEE: Proceedings of the 2019 4th International Conference on Information Systems and Computer Networks (ISCON); 2019 Nov 21–22; Mathura, India.
Crossref
38

Abade A, Ferreira PA, de Barros Vidal F. Plant diseases recognition on images using convolutional neural networks: A systematic review. Comput Electron Agric. 2021;185: 106125.
Crossref Google Scholar
39

Singh AK, Ganapathysubramanian B, Sarkar S, Singh A. Deep learning for plant stress phenotyping: Trends and future perspectives. Trends Plant Sci. 2018;23(10):883–898.
Crossref Google Scholar
40

Jiang Y, Li C. Convolutional neural networks for image-based high-throughput plant phenotyping: A review. Plant Phenomics. 2020;2020:4152816.
Crossref Google Scholar
41
Wu X, Deng H, Wang Q, Lei L, Gao Y, Hao G. Meta-learning shows great potential in plant diseases recognition under few available samples. Plant J. 10.1111/tpj.1617. 2023.
Crossref
42
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. Paper presented at: IEEE: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017 Jul 21–26; Honolulu, HI.
Crossref
43
Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. Paper presented at: Proceedings of the International Conference on Machine Learning. PMLR; 2019 Jun 9–15; Long Beach, CA.
44
Wang Q, Wang J, Deng H, Wu X, Wang Y, Hao G. Aa-trans: Core attention aggregating transformer with information entropy selector for fine-grained visual classification. Pattern Recogn. 2023; 109547.
Crossref
45

Wang Q, Liu X, Liu W, Liu A-A, Liu W, Mei T. Metasearch: Incremental product search via deep meta-learning. IEEE Trans Image Process. 2020;29:7549–7564.
Crossref Google Scholar
46
Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N. Plantdoc: A dataset for visual plant disease detection. Paper presented at: Proceedings of the 7th ACM IKDD CoDS and 25th COMAD; 2020 Jan 5–7; Hyderabad, India.
Crossref
47

Kim B, Han Y-K, Park J-H, Lee J. Improved vision-based detection of strawberry diseases using a deep neural network. Front Plant Sci. 2021;11: 559172.
Crossref Google Scholar
48
Yu H-J, Son C-H, Apple leaf disease identification through region-of-interest-aware deep convolutional neural network. arXiv. 2019. arXiv: 1903.10356.
49

Thapa R, Zhang K, Snavely N, Belongie S, Khan A. The plant pathology challenge 2020 data set to classify foliar disease of apples. Appl Plant Sci. 2020;8(9): e11390.
Crossref Google Scholar
50

Xie C, Wang R, Zhang J, Chen P, Dong W, Li R, Chen T, Chen H. Multi-level learning features for automatic classification of field crop pests. Comput Electron Agric. 2018;152:233–241.
Crossref Google Scholar
51
Tan M, Le, Q. Efficientnetv2: Smaller models and faster training. Paper presented at: Proceedings of the International Conference on Machine Learning. PMLR; 2021 Apr 13–15; online.
52
Zhang X, Zhou X, Lin M, Sun J. Shufflenet: An extremely efficient convolutional neural network for mobile devices. Paper presented at: IEEE: Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition; 2018 Jun 18–23; Salt Lake City, UT.
Crossref
53
Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H, MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv. 2017. arXiv: 1704.04861.
54
Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C. MobileNetV2: Inverted residuals and linear bottlenecks. Paper presented at: IEEE: Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition; 2018 Jun 18–23; Salt Lake City, UT.
Crossref
55
Howard A, Sandler M, Chu G, Chen L-C, Chen B, Tan M, Wang W, Zhu Y, Pang R, Vasudevan V, et al. Searching for mobilenetv3. Paper presented at: IEEE: Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV); 2019 Oct 27–Nov 2; Seoul, South Korea.
Crossref
56
Ma N, Zhang X, Zheng H-T, Sun J. Shufflenet v2: Practical guidelines for efficient cnn architecture design. Paper presented at: Proceedings of the European Conference on Computer Vision (ECCV); 2018 Sep 8–14; Munich, Germany.
Crossref
57
Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv. 2020. arXiv: 2010.11929.
58
Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, Jégou H. Training data-efficient image transformers & distillation through attention. Paper presnted at: Proceedings of the 38th International Conference on Machine Learning. PMLR; 2021 Apr 13–15; online.
59
Liu Z, Mao H, Wu C-Y, Feichtenhofer C, Darrell T, Xie S. A convnet for the 2020s. Paper presented at: IEEE: Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022 Jun 18–24; New Orleans, LA.
Crossref
60
Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B. Swin transformer: Hierarchical vision transformer using shifted windows. Paper presented at: IEEE: Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV); 2021 Oct 10–17; Montreal, QC, Canada.
Crossref
61
Xu J, Pan Y, Pan X, Hoi S, Yi Z, Xu Z. Regnet: Self-regulated network for image classification. IEEE Trans Neural Netw Learn Syst. 2022;1–6.
62
Yuan L, Chen Y, Wang T, Yu W, Shi Y, Jiang Z-H, Tay FE, Feng J, Yan S. Tokens-to-token vit: Training vision transformers from scratch on imagenet. Paper presented at: Proceedings of the IEEE/CVF International Conference on Computer Vision; 2021 Oct 10–17; online.
Crossref
Plant Phenomics
Volume 5,
2023
Article number: 0054
DOI: 10.34133/plantphenomics.0054
Cite this article:
Dong X, Wang Q, Huang Q, et al. PDDD-PreTrain: A Series of Commonly Used Pre-Trained Models Support Image-Based Plant Disease Diagnosis. Plant Phenomics, 2023, 5: 0054. https://doi.org/10.34133/plantphenomics.0054

266

Views

23

Crossref

18

Web of Science

23

Scopus

0

CSCD

Altmetrics
Received: 18 January 2023
Accepted: 25 April 2023
Published: 18 May 2023
© 2023 Xinyu Dong et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License (CC BY 4.0).
Return