AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

From Laboratory to Field: Unsupervised Domain Adaptation for Plant Disease Recognition in the Wild

Xinlu Wu1Xijian Fan1( )Peng Luo2,3Sruti Das Choudhury4Tardi Tjahjadi5Chunhua Hu1
College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China
Institute of Forest Resource Information Techniques, Chinese Academy of Forestry, Beijing 100091, China
Key Laboratory of Forestry Remote Sensing and Information System, National Forestry and Grassland Administration, Beijing 100091, China
Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, NE 68588, USA
School of Engineering, University of Warwick, Coventry CV4 7AL, UK
Show Author Information

Abstract

Plant disease recognition is of vital importance to monitor plant development and predicting crop production. However, due to data degradation caused by different conditions of image acquisition, e.g., laboratory vs. field environment, machine learning-based recognition models generated within a specific dataset (source domain) tend to lose their validity when generalized to a novel dataset (target domain). To this end, domain adaptation methods can be leveraged for the recognition by learning invariant representations across domains. In this paper, we aim at addressing the issues of domain shift existing in plant disease recognition and propose a novel unsupervised domain adaptation method via uncertainty regularization, namely, Multi-Representation Subdomain Adaptation Network with Uncertainty Regularization for Cross-Species Plant Disease Classification (MSUN). Our simple but effective MSUN makes a breakthrough in plant disease recognition in the wild by using a large amount of unlabeled data and via nonadversarial training. Specifically, MSUN comprises multirepresentation, subdomain adaptation modules and auxiliary uncertainty regularization. The multirepresentation module enables MSUN to learn the overall structure of features and also focus on capturing more details by using the multiple representations of the source domain. This effectively alleviates the problem of large interdomain discrepancy. Subdomain adaptation is used to capture discriminative properties by addressing the issue of higher interclass similarity and lower intraclass variation. Finally, the auxiliary uncertainty regularization effectively suppresses the uncertainty problem due to domain transfer. MSUN was experimentally validated to achieve optimal results on the PlantDoc, Plant-Pathology, Corn-Leaf-Diseases, and Tomato-Leaf-Diseases datasets, with accuracies of 56.06%, 72.31%, 96.78%, and 50.58%, respectively, surpassing other state-of-the-art domain adaptation techniques considerably.

References

1

Argüeso D, Picon A, Irusta U, Medela A, San-Emeterio MG, Bereciartua A, Alvarez-Gila A. Few-shot learning approach for plant disease classification using images taken in the field. Comput Electron Agric. 2020;175:105542.

2

Jiang Y, Li C. Convolutional neural networks for image-based high-throughput plant phenotyping: A review. Plant Phenomics. 2020;2020:Article 4152816.

3

Fan X, Luo P, Mu Y, Zhou R, Tjahjadi T, Ren Y. Leaf image based plant disease identification using transfer learning and feature fusion. Comput Electron Agric. 2022;196:106892.

4

Singh AK, Ganapathysubramanian B, Sarkar S, Singh A. Deep learning for plant stress phenotyping: Trends and future perspectives. Trends Plant Sci. 2018;23(10):883–898.

5

Liu J, Wang X. Plant diseases and pests detection based on deep learning: A review. Plant Methods. 2021;17(1):Article 22.

6

Toda Y, Okura F. How convolutional neural networks diagnose plant disease. Plant Phenomics. 2019;2019(3):Article 9237136.

7

Jin S, Sun X, Wu F, Su Y, Li Y, Song S, Xu K, Ma Q, Baret F, Jiang D, et al. Lidar sheds new light on plant phenomics for plant breeding and management: Recent advances and future prospects. ISPRS J Photogramm Remote Sens. 2021;171:202–223.

8

Grinblat GL, Uzal LC, Larese MG, Granitto PM. Deep learning for plant identification using vein morphological patterns. Comput Electron Agric. 2016;127:418–424.

9

David E, Serouart M, Smith D, Madec S, Velumani K, Liu S, Wang X, Pinto F, Shafiee S, Tahir ISA, et al. Global wheat head detection 2021:An improved dataset for benchmarking wheat head detection methods. Plant Phenomics. 2021;3(1):Article 9846158.

10

Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes DP. Deep learning for image-based cassava disease detection. Front Plant Sci. 1852;2017(8):2017.

11

Sun C, Yun T. Individual tree crown segmentation and crown width extraction from a heightmap derived from aerial laser scanning data using a deep learning framework. Front Plant Sci. 2022;13:Article 914974.

12

Hartley Z, Jackson AS, Pound M, French AP. GANana: Unsupervised domain adaptation for volumetric regression of fruit. Plant Phenomics. 2021;3(1):Article 9874597.

13

Yan K, Guo X, Ji Z, Zhou X. Deep transfer learning for cross-species plant disease diagnosis adapting mixed subdomains. IEEE/ACM Trans Comput Biol Bioinform. 2021. https://doi.org/10.1109/TCBB.2021.31335882

14

Pan SJ, Tsang IW, Kwok JT, Yang Q. Domain adaptation via transfer component analysis. IEEE Trans Neural Netw. 2010;22(2):199–210.

15

Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng. 2009;22(10):1345–1359.

16
Long M, Cao Y, Wang J, Jordan MI. Learning transferable features with deep adaptation networks. Paper presented at: International Conference on Machine Learning (ICML);2015 Jul 7–9; Lile, France.
17
Murez Z, Kolouri S, Kriegman D, Ramamoorthi R, Kim K. Image to image translation for domain adaptation. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2018 Jun 18–23; Salt Lake City, USA.
18

Fuentes A, Yoon S, Kim T, Park DS. Open set self and across domain adaptation for tomato disease recognition with deep learning techniques. Front Plant Sci. 2021;12:Article 758027.

19

Wang M, Deng W. Deep visual domain adaptation: A survey. Neurocomputing. 2018;312:135–153.

20

Duan L, Tsang IW, Xu D. Domain transfer multiple kernel learning. IEEE Trans Pattern Anal Mach Intell. 2012;34(3):465–479.

21
Long M, Wang J, Ding G, Sun J, Yu PS. Transfer joint matching for unsupervised domain adaptation. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2014 Jun 23–28; Columbus, OH.
22
Long M, Zhu H, Wang J, Jordan MI. Unsupervised domain adaptation with residual transfer networks. Paper presented at: Advances in Neural Information Processing Systems (NeurIPS); 2016 Dec 5–10; Barcelona, Spain.
23
Ghifary M, Kleijn WB, Zhang M, Balduzzi D, Li W. Deep reconstruction-classification networks for unsupervised domain adaptation. Paper presented at: European Conference on Computer Vision (ECCV); 2016 Oct 11–14; Amsterdam, The Netherlands.
24
Tzeng E, Hoffman J, Saenko K, Darell T. Adversarial discriminative domain adaptation. Paper presented at: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR); 2017 Jul 21–26; Honolulu, HI.
25
Bousmalis K, Silberman N, Dohan D, Erhan D, Krishnan D. Unsupervised pixel-level domain adaptation with generative adversarial networks. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 Jul 21–26; Honolulu, HI.
26

Wilson G, Cook DJ. A survey of unsupervised deep domain adaptation. ACM Trans Intell Syst Technol. 2020;11(51):1–46.

27
Yu C, Wang J, Chen Y, Huang M. Transfer learning with dynamic adversarial adaptation network. Paper presented at: IEEE International Conference on Data Mining (ICDM); 2019 Nov 8–11; Beijing, China.
28

Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V. Domain-adversarial training of neural networks. J Mach Learn Res. 2016;17(1):1–35.

29
Ganin Y, Lempitsky V. Unsupervised domain adaptation by backpropagation. Paper presented at: International Conference on Machine Learning (PMLR), 2015 Jul 7–09; Lille, France.
30
Wang S, Zhang L, Self-adaptive re-weighted adversarial domain adaptation. arXiv. 2020. https://doi.org/10.24963/ijcai.2020/440
31

Zhu Y, Zhuang F, Wang J, Ke G, Chen J, Bian J, Xiong H, He Q. Deep subdomain adaptation network for image classification. IEEE Trans Neural Netw Learn Syst. 2020;32(4):1713–1722.

32

Wang X, Li L, Ye W, Long M, Wang J. Transferable attention for domain adaptation. Proc AAAI Conf Artif Intell. 2020;33(1):5345–5352.

33
Long M, Cao Z, Wang J, Jordan MI. Conditional adversarial domain adaptation. Paper presented at: Advances in Neural Information Processing Systems (NeurIPS); 2018 Dec 2–08; Montréal, Canada.
34

Zhu Y, Zhuang F, Wang J, Chen J, Shi Z, Wu W, He Q. Multi-representation adaptation network for cross-domain image classification. Neural Netw. 2019;119:214–221.

35

Elhamifar E, Vidal R. Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell. 2013;35(11):2765–2781.

36

Chapelle O, Scholkopf B, Zien A. Semi-supervised learning. IEEE Trans Neural Netw. 2009;20(3):542–542.

37
Grandvalet Y, Bengio Y. Semi-supervised learning by entropy minimization. Paper presented at: Advances in Neural Information Processing Systems (NIPS); 2004;Vancouver, Canada.
38
Shu R, Bui H, Narui H, Ermon S. A DIRT-T approach to unsupervised domain adaptation. arXiv. 2018. https://doi.org/10.48550/arXiv.1802.08735
39

Ben-David S, Blitzer J, Crammer K, Kulesza A, Pereira F, Vaughan JW. A theory of learning from different domains. Mach Learn. 2010;79(1):151–175.

40
Zhou L, Fan X, Ma Y, Tjahjadi T, Ye Q. Uncertainty-aware cross-dataset facial expression recognition via regularized conditional alignment. Paper presented at Proceedings of the 28th ACM International Conference on Multimedia; 2020 Oct 12–16; Seattle, WA.
41
Chen C, Xie W, Huang W, Rong Y, Ding X, Huang Y, Xu T, Huang J. Progressive feature alignment for unsupervised domain adaptation. Paper presented at: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019 Jun 15–20; Salt Lake City, UT.
42

Mohanty SP, Hughes DP, Salathé M. Using deep learning for image-based plant disease detection. Front Plant Sci. 2016;7:1419.

43
Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N. Plantdoc: A dataset for visual plant disease detection. Paper presented at: Proceedings of the 7th ACM IKDD CoDS and 25th COMAD; 2020 Jan 5–07; Hyderabad, India.
44

Thapa R, Zhang K, Snavely N, Belongie S, Khan A. The plant pathology challenge 2020 data set to classify foliar disease of apples. Appl Plant Sci. 2020;8(9):e11390.

45
Long M, Cao Y, Wang J, Jordan MI. Learning transferable features with deep adaptation networks. Paper presented at: International Conference on Machine Learning (PMLR), 2015 Jul 7–9; Lille, France.
46
Sun B, Saenko K. Deep coral: Correlation alignment for deep domain adaptation. Paper presented at: European Conference on Computer Vision (ECCV), 2016 Oct 8–16; Amsterdam, The Netherlands.
47
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016 Jun 27–30; Las Vegas, NV.
Plant Phenomics
Article number: 0038
Cite this article:
Wu X, Fan X, Luo P, et al. From Laboratory to Field: Unsupervised Domain Adaptation for Plant Disease Recognition in the Wild. Plant Phenomics, 2023, 5: 0038. https://doi.org/10.34133/plantphenomics.0038

185

Views

23

Crossref

24

Web of Science

25

Scopus

0

CSCD

Altmetrics

Received: 28 August 2022
Accepted: 28 February 2023
Published: 28 March 2023
© 2023 Xinlu Wu et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License (CC BY 4.0).

Return