AI Chat Paper
Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
{{expandStatus?'Exit ':''}}Advanced Search
Accurate detection and reconstruction of branches aid the accuracy of harvesting robots and extraction of plant phenotypic information. However, the complex orchard background and twisting growing branches of vine fruit trees make this challenging. To solve these problems, this study adopted a Mask Region-based convolutional neural network (Mask R-CNN) architecture incorporating deformable convolution to segment branches in complex backgrounds. Based on the growth posture, a branch reconstruction algorithm with bidirectional sector search was proposed to adaptively reconstruct the segmented branches obtained by an improved model. The average precision, average recall, and F1 scores of the improved Mask R-CNN model for passion fruit branch detection were found to be 64.30%, 76.51%, and 69.88%, respectively, and the average running time on the test dataset was 0.75 s per image, which is better than the compared model. We randomly selected 40 images from the test dataset to evaluate the branch reconstruction. The branch reconstruction accuracy, average error, average relative error of reconstructed diameter, and mean intersection-over-union (mIoU) were 88.83%, 1.98 px, 7.98, and 83.44%, respectively. The average reconstruction time for a single image was 0.38 s. This would promise the proposed method to detect and reconstruct plant branches under complex orchard backgrounds.
Lin G, Tang Y, Zou X, Wang C. Three-dimensional reconstruction of guava fruits and branches using instance segmentation and geometry analysis. Comput Electron Agric. 2021;184:Article 106107.
Zhao Y, Gong L, Huang Y, Liu C. A review of key techniques of vision-based control for harvesting robot. Comput Electron Agric. 2016;127:311–323.
Bargoti S, Underwood JP. Image segmentation for fruit detection and yield estimation in apple orchards. J Field Robot. 2017;34(6):1039–1060.
Ren G, Lin T, Ying Y, Chowdhary G, Ting KC. Agricultural robotics research applicable to poultry production: A review. Comput Electron Agric. 2020;169:Article 105216.
Ji W, Qian Z, Xu B, Tao Y, Zhao D, Ding S. Apple tree branch segmentation from images with small gray-level difference for agricultural harvesting robot. Optik. 2016;127(23):11173–11182.
He L, Wu C, Du X. Fruit tree extraction based on simultaneous tracking of two edges for 3D reconstruction. Trans Chin Soc Agric Eng. 2014;30(7):182–189.
Tabb A, Medeiros H. Automatic segmentation of trees in dynamic outdoor environments. Comput Ind. 2018;98:90–99.
Juman MA, Wong YW, Rajkumar RK, Goh LJ. A novel tree trunk detection method for oil-palm plantation navigation. Comput Electron Agric. 2016;128:172–180.
You A, Grimm C, Silwal A, Davidson JR. Semantics-guided skeletonization of upright fruiting offshoot trees for robotic pruning. Comput Electron Agric. 2022;192:Article 106622.
Ma B, Du J, Wang L, Wang L, Jiang H, Zhou M. Automatic branch detection of jujube trees based on 3D reconstruction for dormant pruning using the deep learning-based method. Comput Electron Agric. 2021;190:Article 106484.
Westling F, Underwood J, Bryson M. Graph-based methods for analyzing orchard tree structure using noisy point cloud data. Comput Electron Agric. 2021;187:Article 106270.
Kamilaris A, Prenafeta-Boldu FX. Deep learning in agriculture: A survey. Comput Electron Agric. 2018;147:70–90.
Dias PA, Tabb A, Medeiros H. Apple flower detection using deep convolutional networks. Comput Ind. 2018;99:17–28.
Yu Y, Zhang K, Yang L, Zhang D. Fruit detection for strawberry harvesting robot in non-structural environment based on mask-RCNN. Comput Electron Agric. 2019;163:Article 104846.
Majeed Y, Zhang J, Zhang X, Fu L, Karkee M, Zhang Q, Whiting MD. Apple tree trunk and branch segmentation for automatic trellis training using convolutional neural network based semantic segmentation. IFAC-Pap. 2018;51(17):75–80.
Majeed Y, Zhang J, Zhang X, Fu L, Karkee M, Zhang Q, Whiting MD. Deep learning-based segmentation for automated training of apple trees on trellis wires. Comput Electron Agric. 2020;170:Article 105277.
Zhang J, He L, Karkee M, Zhang Q, Zhang X, Gao Z. Branch detection for apple trees trained in fruiting wall architecture using depth features and regions-convolutional neural network (R-CNN). Comput Electron Agric. 2018;155:386–393.
Zhang X, Karkee M, Zhang Q, Whiting MD. Computer vision-based tree trunk and branch identification and shaking points detection in dense-foliage canopy for automated harvesting of apples. J Field Robot. 2021;38(3):476–493.
Yang C, Xiong L, Wang Z, Wang Y, Shi G, Kuremot T, Zhao W, Yang Y. Integrated detection of citrus fruits and branches using a convolutional neural network. Comput Electron Agric. 2020;174:Article 105469.
Wan H, Fan Z, Yu X, Kang M, Wang P, Zeng X. A real-time branch detection and reconstruction mechanism for harvesting robot via convolutional neural network and image segmentation. Comput Electron Agric. 2022;192:Article 106609.
Ren S, He K, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39(6):1137–1149.
Amatya S, Karkee M, Gongal A, Zhang Q, Whiting MD. Detection of cherry tree branches with full foliage in planar architecture for automated sweet-cherry harvesting. Biosyst Eng. 2016;146:3–15.
Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).
京公网安备11010802044758号