AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Exploring the Close-Range Detection of UAV-Based Images on Pine Wilt Disease by an Improved Deep Learning Method

Xinquan Ye1Jie Pan1,2( )Gaosheng Liu1Fan Shao1
College of Forestry, Nanjing Forestry University, Nanjing 210037, China
Co-Innovation Center for Sustainable Forestry in Southern China, Nanjing Forestry University, Nanjing 210037, China
Show Author Information

Abstract

Pine wilt disease (PWD) is a significantly destructive forest disease. To control the spread of PWD, an urgent need exists for a real-time and efficient method to detect infected trees. However, existing object detection models have often faced challenges in balancing lightweight design and accuracy, particularly in complex mixed forests. To address this, an improvement was made to the YOLOv5s (You Only Look Once version 5s) algorithm, resulting in a real-time and efficient model named PWD-YOLO. First, a lightweight backbone was constructed, composed of multiple connected RepVGG Blocks, significantly enhancing the model’s inference speed. Second, a C2fCA module was designed to incorporate rich gradient information flow and concentrate on key features, thereby preserving more detailed characteristics of PWD-infected trees. In addition, the GSConv network was utilized instead of conventional convolutions to reduce network complexity. Last, the Bidirectional Feature Pyramid Network strategy was used to enhance the propagation and sharing of multiscale features. The results demonstrate that on a self-built dataset, PWD-YOLO surpasses existing object detection models with respective measurements of model size (2.7 MB), computational complexity (3.5 GFLOPs), parameter volume (1.09 MB), and speed (98.0 frames/s). The Precision, Recall, and F1-score on the test set are 92.5%, 95.3%, and 93.9%, respectively, which confirms the effectiveness of the proposed method. It provides reliable technical support for daily monitoring and clearing of infected trees by forestry management departments.

References

1

Robinet C, Roques A, Pan H, Fang G, Ye J, Zhang Y, Sun J. Role of human-mediated dispersal in the spread of the pinewood nematode in China. PLoS One. 2009;4(2):Article e4646.

2

Kim N, Jeon HW, Mannaa M, Jeong SI, Kim J, Kim J, Lee C, Park A, Kim JC, Seo YS. Induction of resistance against pine wilt disease caused by Bursaphelenchus xylophilus using selected pine endophytic bacteria. Plant Pathol. 2019;68:434–444.

3

Ikegami M, Jenkins TA. Estimate global risks of a forest disease under current and future climates using species distribution model and simple thermal model–pine wilt disease as a model case. For Ecol Manag. 2018;409:343–352.

4

Gao R, Wang Z, Wang H, Hao Y, Shi J. Relationship between pine wilt disease outbreaks and climatic variables in the three gorges reservoir region. Forests. 2019;10:816.

5

Ye JR. Epidemic status of pine wilt disease in China and its prevention and control techniques and counter measures. Sci Silvae Sin. 2019;55:1–10.

6

Wu W, Zhang Z, Zheng L, Han C, Wang X, Xu J, Wang X. Research progress on the early monitoring of pine wilt disease using hyperspectral techniques. Sensors. 2020;20(13):3729.

7

Hao Z, Huang J, Li X, Sun H, Fang G. A multi-point aggregation trend of the outbreak of pine wilt disease in China over the past 20 years. For Ecol Manag. 2022;505:Article 119890.

8

Wang J, Deng J, Yan W, Zheng Y. Habitat suitability of pine wilt disease in Northeast China under climate change scenario. Forests. 2023;14(8):1687.

9
National Forestry and Grassland Administration. Announcement of pine wood nematode epidemic area. 2023. [accessed 13 April 2023] http://www.forestry.gov.cn/c/www/gkzfwj/380005.jhtml.
10

Cha D, Kim D, Choi W, Park S, Han H. Point-of-care diagnostic (POCD) method for detecting Bursaphelenchus xylophilus in pinewood using recombinase polymerase amplification (RPA) with the portable optical isothermal device (POID). PLoS One. 2020;15(1):Article e0227476.

11

Hao Z, Huang J, Zhou Y, Fang G. Spatiotemporal pattern of pine wilt disease in the Yangtze river basin. Forests. 2021;12(6):731.

12

Ye JR, Wu XQ. Research progress of pine wood nematode disease. For Dis Insects China. 2022;41:1–10.

13

Kwon T-S, Shin JH, Lim J-H, Kim Y-K, Lee EJ. Management of pine wilt disease in Korea through preventative silvicultural control. For Ecol Manag. 2011;261(3):562–569.

14

Syifa M, Park S-J, Lee C-W. Detection of the pine wilt disease tree candidates for drone remote sensing using artificial intelligence techniques. Engineering. 2020;6(8):919–926.

15

Dash JP, Watt MS, Pearse GD, Heaphy M, Dungey HS. Assessing very high resolution UAV imagery for monitoring forest health during a simulated disease outbreak. ISPRS J Photogramm Remote Sens. 2017;131:1–14.

16

Stone C, Mohammed C. Application of remote sensing technologies for assessing planted forests damaged by insect pests and fungal pathogens: A review. Curr For Rep. 2017;3:75–92.

17

Dennison PE, Brunelle AR, Carter VA. Assessing canopy mortality during a mountain pine beetle outbreak using GeoEye-1 high spatial resolution satellite data. Remote Sens Environ. 2010;114(11):2431–2435.

18

Zhang B, Ye H, Lu W, Huang W, Wu B, Hao Z, Sun H. A spatiotemporal change detection method for monitoring pine wilt disease in a complex landscape using high-resolution remote sensing imagery. Remote Sens. 2021;13(11):2083.

19

Hicke JA, Logan J. Mapping whitebark pine mortality caused by a mountain pine beetle outbreak with high spatial resolution satellite imagery. Int J Remote Sens. 2009;30(17):4427–4441.

20

Liang X, Kukko A, Balenovic I, Saarinen N, Junttila S, Kankare V, Holopainen M, Mokroš M, Surový P, Kaartinen H, et al. Close-range remote sensing of forests: The state of the art, challenges, and opportunities for systems and data acquisitions. IEEE Geosci Remote Sens Mag. 2022;10(3):32–71.

21

Zhang Y, Dian Y, Zhou J, Peng S, Hu Y, Hu L, Han Z, Fang X, Cui H. Characterizing spatial patterns of pine wood nematode outbreaks in subtropical zone in China. Remote Sens. 2021;13(22):4682.

22

Guimarães N, Pádua L, Marques P, Silva N, Peres E, Sousa JJ. Forestry remote sensing from unmanned aerial vehicles: A review focusing on the data, processing and potentialities. Remote Sens. 2020;12(6):1046.

23

Iordache M-D, Mantas V, Baltazar E, Pauly K, Lewyckyj N. A machine learning approach to detecting pine wilt disease using airborne spectral imagery. Remote Sens. 2020;12(14):2280.

24

Yu R, Luo Y, Zhou Q, Zhang X, Wu D, Ren L. A machine learning algorithm to detect pine wilt disease using UAV-based hyperspectral imagery and LiDAR data at the tree level. Int J Appl Earth Obs Geoinf. 2021;101:Article 102363.

25

Pan J, Lin J, Xie T. Exploring the potential of UAV-based hyperspectral imagery on pine wilt disease detection: Influence of spatio-temporal scales. Remote Sens. 2023;15(9):2281.

26

Hu G, Wang T, Wan M, Bao W, Zeng W. UAV remote sensing monitoring of pine forest diseases based on improved mask R-CNN. Int J Remote Sens. 2022;43(4):1274–1305.

27
Girshick R. Fast R-CNN. Paper presented at: Proceedings of the IEEE International Conference on Computer Vision (ICCV); 2015 Jul 07–13; Santiago, Chile.
28

Ren S, He K, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39(6):1137–1149.

29
He K, Gkioxari G, Dollár P, Girshick R. Mask R-CNN. Paper presented at: Proceedings of the IEEE International Conference on Computer Vision (ICCV); 2017 Oct 22–29; Venice, Italy.
30
Redmon J, Farhadi A. Yolov3: An incremental improvement. arXiv. 2018. https://doi.org/10.48550/arXiv.1804.02767.
31
Bochkovskiy A, Wang C-Y, Liao H-YM. Yolov4: Optimal speed and accuracy of object detection. arXiv. 2020. https://doi.org/10.48550/arXiv.2004.10934.
32
Wang C-Y, Bochkovskiy A, Liao H-YM. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv. 2020. https://doi.org/10.48550/arXiv.2207.02696.
33

Zhu Z, Li D, Hu Y, Li J, Liu D, Li J. Indoor scene segmentation algorithm based on full convolutional neural network. Neural Comput Applic. 2021;33:8261–8273.

34

Hu W, Huang Y, Wei L, Zhang F, Li H. Deep convolutional neural networks for hyperspectral image classification. J Sens. 2015;2015:258619.

35

Yu R, Luo Y, Zhou Q, Zhang X, Wu D, Ren L. Early detection of pine wilt disease using deep learning algorithms and UAV-based multispectral imagery. For Ecol Manag. 2021;497:Article 119493.

36

Pan J, Xie T, You C, Xia X. Dynamic analysis of early stage pine wilt disease in Pinus massoniana using ground-level hyperspectral imaging. For Sci. 2023;69(5):529–537.

37

Sun Z, Wang Y, Pan L, Xie Y, Zhang B, Liang R, Sun Y. Pine wilt disease detection in high-resolution UAV images using object-oriented classification. J For Res. 2021;33:1377–1389.

38

You J, Zhang R, Lee J. A deep learning-based generalized system for detecting pine wilt disease using RGB-based UAV images. Remote Sens. 2021;14(1):150.

39

Han Z, Hu W, Peng S, Lin H, Zhang J, Zhou J, Wang P, Dian Y. Detection of standing dead trees after pine wilt disease outbreak with airborne remote sensing imagery by multi-scale spatial attention deep learning and Gaussian kernel approach. Remote Sens. 2022;14(13):3075.

40

Deng X, Tong Z, Lan Y, Huang Z. Detection and location of dead trees with pine wilt disease based on deep learning and UAV remote sensing. AgriEngineering. 2020;2(2):294–307.

41

Hu G, Yin C, Wan M, Zhang Y, Fang Y. Recognition of diseased Pinus trees in UAV images using deep learning and AdaBoost classifier. Biosyst Eng. 2020;194:138–151.

42

Qin J, Wang B, Wu Y, Lu Q, Zhu H. Identifying pine wood nematode disease using UAV images and deep learning algorithms. Remote Sens. 2021;13(2):162.

43

dos Santos CSS, de Vasconcelos MW. Identification of genes differentially expressed in Pinus pinaster and Pinus pinea after infection with the pine wood nematode. Eur J Plant Pathol. 2012;132:407–418.

44
Jocher, G. Ultralytics-YOLOv5. GitHub. 2020. [accessed 2 October 2022] https://github.com/ultralytics/yolov5.
45
Ding X, Zhang X, Ma N, Han J, Ding G, Sun J. Repvgg: Making VGG-style convnets great again. Paper presented at: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2021 Jun 20–25; Nashville, TN, USA.
46
Jocher G, Chaurasia A, Qiu J. YOLO by ultralytics. GitHub. 2023. [accessed 25 January 2023] https://github.com/ultralytics/ultralytics.
47
Hou Q, Zhou D, Feng J. Coordinate attention for efficient mobile network design. Paper presented at: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2021 Jun 20–25; Nashville, TN, USA.
48
Zhang X, Zhou X, Lin M, Sun J. Shufflenet: An extremely efficient convolutional neural network for mobile devices. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2018 Jun 18–23; Salt Lake City, UT.
49
Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S. Feature pyramid networks for object detection. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 Jun 17–22; Honolulu, HI, USA.
50
Tan M, Pang R, Le QV. Efficientdet: Scalable and efficient object detection. Paper presented at: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2020 Jun 13–19; Seattle, WA, USA.
51

Tao H, Li C, Zhao D, Deng S, Hu H, Xu X, Jing W. Deep learning-based dead pine tree detection from unmanned aerial vehicle images. Int J Remote Sens. 2020;41(21):8238–8255.

52

Qin B, Sun F, Shen W, Dong B, Ma S, Huo X, Lan P. Deep learning-based pine nematode trees’ identification using multispectral and visible UAV imagery. Drones. 2023;7(3):183.

53

Zhang P, Wang Z, Rao Y, Zheng J, Zhang N, Wang D, Zhu J, Fang Y, Gao X. Identification of pine wilt disease infected wood using UAV RGB imagery and improved YOLOv5 models integrated with attention mechanisms. Forests. 2023;14(3):588.

54

Wu Q, Zhang B, Xu C, Zhang H, Wang C. Dense oil tank detection and classification via YOLOX-TR network in large-scale SAR images. Remote Sens. 2022;14(14):3246.

55

Xia L, Zhang R, Chen L, Li L, Yi T, Wen Y, Ding C, Xie C. Evaluation of deep learning segmentation models for detection of pine wilt disease in unmanned aerial vehicle images. Remote Sens. 2021;13(18):3594.

56

Jiang X, Wu Z, Han S, Yan H, Zhou B, Li J. A multi-scale approach to detecting standing dead trees in UAV RGB images based on improved faster R-CNN. PLoS One. 2023;18(2):Article e0281084.

57

Yu R, Ren L, Luo Y. Early detection of pine wilt disease in Pinus tabuliformis in North China using a field portable spectrometer and UAV-based hyperspectral imagery. For Ecosyst. 2021;8:44.

58

Wu D, Yu L, Yu R, Zhou Q, Li J, Zhang X, Ren L, Luo Y. Detection of the monitoring window for pine wilt disease using multi-temporal UAV-based multispectral imagery and machine learning algorithms. Remote Sens. 2023;15(2):444.

Plant Phenomics
Article number: 0129
Cite this article:
Ye X, Pan J, Liu G, et al. Exploring the Close-Range Detection of UAV-Based Images on Pine Wilt Disease by an Improved Deep Learning Method. Plant Phenomics, 2023, 5: 0129. https://doi.org/10.34133/plantphenomics.0129

192

Views

12

Crossref

11

Web of Science

11

Scopus

0

CSCD

Altmetrics

Received: 05 September 2023
Accepted: 23 November 2023
Published: 15 December 2023
© 2023 Xinquan Ye et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return