AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Plant Phenomics Article
Article Link
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

CountShoots: Automatic Detection and Counting of Slash Pine New Shoots Using UAV Imagery

Xia Hao1, Yue Cao1, Zhaoxu Zhang1, Federico Tomasetto2, Weiqi Yan3, Cong Xu4, Qifu Luan5, Yanjie Li5( )
College of Information Science and Engineering, Shandong Agricultural University, No. 61, Daizong Road, Taian 271018, Shandong Province, China
AgResearch Ltd., Christchurch 8140, New Zealand
Department of Computer Science, Auckland University of Technology, Auckland 1010, New Zealand
School of Forestry, University of Canterbury, Private Bag 4800, 8041 Christchurch, New Zealand
Research Institute of Subtropical Forestry, Chinese Academy of Forestry, No. 73, Daqiao Road, Fuyang, Hangzhou 311400, Zhejiang Province, China
Show Author Information

Abstract

The density of new shoots on pine trees is an important indicator of their growth and photosynthetic capacity. However, traditional methods to monitor new shoot density rely on manual and destructive measurements, which are labor-intensive and have led to fewer studies on new shoot density. Therefore, in this study, we present user-friendly software called CountShoots, which extracts new shoot density in an easy and convenient way using unmanned aerial vehicles based on the YOLOX and Slash Pine Shoot Counting Network (SPSC-net) models. This software mainly consists of 2 steps. Firstly, we deployed a modified YOLOX model to identify the tree species and location from complex RGB background images, which yielded a high recognition accuracy of 99.15% and 95.47%. These results showed that our model produced higher detection accuracy compared to YOLOv5, Efficientnet, and Faster-RCNN models. Secondly, we constructed an SPSC-net. This methodology is based on the CCTrans network, which outperformed DM-Count, CSR-net, and MCNN models, with the lowest mean squared error and mean absolute error results among other models (i.e., 2.18 and 1.47, respectively). To our best knowledge, our work is the first research contribution to identify tree crowns and count new shoots automatically in slash pine. Our research outcome provides a highly efficient and rapid user-interactive pine tree new shoot detection and counting system for tree breeding and genetic use purposes.

References

1

Ding X, Diao S, Luan Q, Wu HX, Zhang Y, Jiang J. A transcriptome-based association study of growth, wood quality, and oleoresin traits in a slash pine breeding population. PLoS Genet. 2022;18(2):Article e1010017.
Crossref Google Scholar
2

Lai M, Zhang L, Lei L, Liu S, Jia T, Yi M. Inheritance of resin yield and main resin components in Pinus elliottii Engelm. At three locations in southern China. Ind Crop Prod. 2020;144:Article 112065.
Crossref Google Scholar
3

Pagliarini MK, Kieras WS, Moreira JP, Sousa VA, Shimizu JY, Moraes MLT, Furlani Junior E, Aguiar AV. Genetic divergence among slash pine second generation progenies at early age. Scientia Forestalis. 2020;48: (126):e2848.
Crossref Google Scholar
4

DN F, Nambiar E. Accumulation and retranslocation of mineral nutrients in developing needles in relation to seasonal growth of young radiata pine trees. Ann Bot. 1982;50(6):817–829.
Crossref Google Scholar
5

Kellomäki S, Strandman H. A model for the structural growth of young scots pine crowns based on light interception by shoots. Ecol Model. 1995;80(2-3):237–250.
Crossref Google Scholar
6

Fife D, Nambiar E. Movement of nutrients in radiata pine needles in relation to the growth of shoots. Ann Bot. 1984;54(3):303–314.
Crossref Google Scholar
7

Whitmore F, Zahner R. Development of the xylem ring in stems of young red pine trees. For Sci. 1966;12(2):198–210.
Google Scholar
8

Li Z, Guo R, Li M, Chen Y, Li G. A review of computer vision technologies for plant phenotyping. Comput Electron Agric. 2020;176:Article 105672.
Crossref Google Scholar
9

Zweifel R, Etzold S, Sterck F, Gessler A, Anfodillo T, Mencuccini M, von Arx G, Lazzarin M, Haeni M, Feichtinger L, et al. Determinants of legacy effects in pine trees–implications from an irrigation-stop experiment. New Phytol. 2020;227(4):1081–1096.
Crossref Google Scholar
10

Stadler B, Müller T, Orwig D, Cobb R. Hemlock woolly adelgid in New England forests: Canopy impacts transforming ecosystem processes and landscapes. Ecosystems. 2005;8:233–247.
Crossref Google Scholar
11

Rosati A, Paoletti A, Al Hariri R, Famiani F. Fruit production and branching density affect shoot and whole-tree wood to leaf biomass ratio in olive. Tree Physiol. 2018;38(9):1278–1285.
Crossref Google Scholar
12

Dalla Corte AP, Rex FE, de Almeida DRA, Sanquetta CR, Silva CA, Moura MM, Wilkinson B, Zambrano AMA, da Cunha Neto EM, Veras HFP, et al. Measuring individual tree diameter and height using GatorEye high-density UAV-Lidar in an integrated crop-livestock-forest system. Remote Sens. 2020;12(5):863.
Crossref Google Scholar
13

Picos J, Bastos G, Míguez D, Alonso L, Armesto J. Individual tree detection in a eucalyptus plantation using unmanned aerial vehicle (UAV)-LiDAR. Remote Sens. 2020;12(5):885.
Crossref Google Scholar
14

López-Granados F, Torres-Sánchez J, Jiménez-Brenes FM, Arquero O, Lovera M, de Castro AI. An efficient RGB-UAV-based platform for field almond tree phenotyping:3-D architecture and flowering traits. Plant Methods. 2019;15(1):1–16.
Crossref Google Scholar
15

Xie C, Yang C. A review on plant high-throughput phenotyping traits using UAV-based sensors. Comput Electron Agric. 2020;178:Article 105731.
Crossref Google Scholar
16

Pound MP, Atkinson JA, Wells DM, Pridmore TP, French AP. Deep learning for multi-task plant phenotyping. Agric Scipp. 2017;2055–2063.
Crossref Google Scholar
17

Sun J, Yang K, Chen C, Shen J, Yang Y, Wu X, Norton T. Wheat head counting in the wild by an augmented feature pyramid networks-based convolutional neural network. Comput Electron Agric. 2022;193:Article 106705.
Crossref Google Scholar
18

Bayraktar E, Basarkan ME, Celebi N. A low-cost UAV framework towards ornamental plant detection and counting in the wild. ISPRS J Photogramm Remote Sens. 2020;167:1–11.
Crossref Google Scholar
19

Su J, Liu C, Coombes M, Hu X, Wang C, Xu X, Li Q, Guo L, Chen WH. Wheat yellow rust monitoring by learning from multispectral UAV aerial imagery. Comput Electron Agric. 2018;155:157–166.
Crossref Google Scholar
20

Barrero O, Perdomo SA. RGB and multispectral UAV image fusion for Gramineae weed detection in rice fields. Precis Agric. 2018;19(5):809–822.
Crossref Google Scholar
21
Evgeniou T, Pontil M. Support vector machines: Theory and applications. Berlin, Heidelberg (Germany): Springer; 2005.
22

Breiman L. Random forests. Mach Learn. 2001;45(1):5–32.
Crossref Google Scholar
23

Singh AK, Ganapathysubramanian B, Sarkar S, Singh A. Deep learning for plant stress phenotyping: Trends and future perspectives. Trends Plant Sci. 2018;23(10):883–898.
Crossref Google Scholar
24

van Dijk ADJ, Kootstra G, Kruijer W, de Ridder D. Machine learning in plant science and plant breeding. Iscience. 2021;24(1):Article 101890.
Crossref Google Scholar
25

Chlingaryan A, Sukkarieh S, Whelan B. Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: A review. Comput Electron Agric. 2018;151:61–69.
Crossref Google Scholar
26

Li H, Wang P, Huang C. Comparison of deep learning methods for detecting and counting sorghum heads in UAV imagery. Remote Sens. 2022;14(13):3143.
Crossref Google Scholar
27

LeCun Y, Bengio Y, Hinton 7553. Deep learning. Nature. 2015;521(2):436–444.
Crossref Google Scholar
28

Bengio Y, Courville A, Vincent P. Representation learning: A review and new perspectives. IEEE Trans Pattern Anal Mach Intell. 2013;35(8):1798–1828.
Crossref Google Scholar
29

Kamilaris A, Prenafeta-Boldú FX. Deep learning in agriculture: A survey. Comput Electron Agric. 2018;147:70–90.
Crossref Google Scholar
30

Chen Y, Li W, Sakaridis C. Multi-scale fusion with CNNs for enhancing crowd counting. Pattern Recogn. 2019;90:119–130.
Crossref Google Scholar
31
Dosovitskiy A, Beyer, L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, et al. An image is worth 16x16 words: Transformers for image recognition at scale. ArXiv. 2020.https://doi.org/10.48550/arXiv.2010.11929
32

Liang D, Chen X, Xu W, Zhou Y, Bai X. TransCrowd: Weakly-supervised crowd counting with transformers. Sci China Inf Sci. 2022;65(6):1–14.
Crossref Google Scholar
33
Sun G, Liu Y, Probst T, Paudel DP, Popovic N, Van Gool L. Boosting crowd counting with transformers. ArXiv. 2021. https://doi.org/10.48550/arXiv.2105.10926
34
Tian Y, Chu X, Wang H. Cctrans: Simplifying and improving crowd counting with transformer. ArXiv. 2021. https://doi.org/10.48550/arXiv.2109.14483
35

Chu X, Tian Z, Wang Y, Zhang B, Ren H, Wei X. Twins: Revisiting the design of spatial attention in vision transformers. Adv Neural Inf Proces Syst. 2021;34:9355–9366.
Google Scholar
36

Song Z, Tomasetto F, Niu X, Yan WQ, Jiang J, Li Y. Enabling breeding selection for biomass in slash pine using UAV-based imaging. Plant Phenomics. 2022;2022:Article 9783785.
Crossref Google Scholar
37
Tzutalin D. LabelImg. GitHub repository. 2015. [accessed 15 March 2023]. https://github.com/heartexlabs/labelImg
38

Yin X, Chen S, Hu E, Zhang D. Semi-supervised clustering with metric learning: An adaptive kernel method. Pattern Recogn. 2010;43(4):1320–1333.
Crossref Google Scholar
39
Ge Z, Liu S, Wang F, Li Z, Sun, J. Yolox: Exceeding yolo series in 2021. ArXiv. 2021. https://doi.org/10.48550/arXiv.2107.08430
40
Redmon, J. Farhadi, A. Yolov3: An incremental improvement. ArXiv. 2018. https://doi.org/10.48550/arXiv.1804.02767
41
Zhu M, Han K, Yu C, Wang Y. Dynamic feature pyramid networks for object detection. ArXiv. 2012. https://doi.org/10.48550/arXiv.2012.00779
42
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A, Kaiser L, Plosukhin I. Attention is all you need. Paper presented at: Proceedings of the 31st International Conference on Neural Information Processing Systems; 2017 Dec 4; Red Hook, NY.
43

Liang J, Chen X, Liang C, Long T, Tang X, Shi Z, Zhou M, Zhao J, Lan Y, Long Y. A detection approach for late-autumn shoots of litchi based on unmanned aerial vehicle (UAV) remote sensing. Comput Electron Agric. 2023;204:Article 107535.
Crossref Google Scholar
44

Wang B, Liu H, Samaras D, Nguyen MH. Distribution matching for crowd counting. Adv Neural Inf Proces Syst. 2020;33:1595–1607.
Google Scholar
45
Özleyen SY, Aptoula E. Crowd counting with distribution matching and dilated networks. Paper presented at: 2021 29th Signal Processing and Communications Applications Conference (SIU); 2021 Jun 9–11; Istanbul, Turkey.
Crossref
46
Li Y, Zhang X, Chen D. Csrnet: Dilated convolutional neural networks for understanding the highly congested scenes. Paper presented at: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2018 Jun 18–23; Salt Lake City, UT.
Crossref
47

Aggarwal S. Flask framework cookbook. Birmingham (UK): Packt Publishing Ltd; 2014.
48

Yang L, Yuan G, Zhou H, Liu H, Chen J, Wu H. RS-YOLOX: A high-precision detector for object detection in satellite remote sensing images. Appl Sci. 2022;12(17):Article 8707.
Crossref Google Scholar
49

Zhang Y, Zhang W, Yu J, He L, Chen J, He Y. Complete and accurate holly fruits counting using YOLOX object detection. Comput Electron Agric. 2022;198:Article 107062.
Crossref Google Scholar
50

Ge J, Wang C, Zhang B, Xu C, Wen X. Azimuth-sensitive object detection of high-resolution SAR images in complex scenes by using a spatial orientation attention enhancement network. Remote Sens. 2022;14(9):Article 2198.
Crossref Google Scholar
51

Wu W, Fan X, Qu H, Yang X, Tjahjadi T. TCDNet: Tree crown detection from UAV optical images using uncertainty-aware one-stage network. IEEE Geosci Remote Sens Lett. 2022;19:1–5.
Crossref Google Scholar
52

Hong Q, Jiang L, Zhang Z, Ji S, Gu C, Mao W, Li W, Liu T, Li B, Tan C. A lightweight model for wheat ear fusarium head blight detection based on RGB images. Remote Sens. 2022;14(14):Article 3481.
Crossref Google Scholar
Plant Phenomics
Volume 5,
2023
Article number: 0065
DOI: 10.34133/plantphenomics.0065
Cite this article:
Hao X, Cao Y, Zhang Z, et al. CountShoots: Automatic Detection and Counting of Slash Pine New Shoots Using UAV Imagery. Plant Phenomics, 2023, 5: 0065. https://doi.org/10.34133/plantphenomics.0065

163

Views

6

Crossref

5

Web of Science

6

Scopus

0

CSCD

Altmetrics
Received: 16 February 2023
Accepted: 12 June 2023
Published: 10 July 2023
© 2023 Xia Hao et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).
Return