Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
Although deep learning-based fruit detection techniques are becoming popular, they require a large number of labeled datasets to support model training. Moreover, the manual labeling process is time-consuming and labor-intensive. We previously implemented a generative adversarial network-based method to reduce labeling costs. However, it does not consider fitness among more species. Methods of selecting the most suitable source domain dataset based on the fruit datasets of the target domain remain to be investigated. Moreover, current automatic labeling technology still requires manual labeling of the source domain dataset and cannot completely eliminate manual processes. Therefore, an improved EasyDAM_V3 model was proposed in this study as an automatic labeling method for additional classes of fruit. This study proposes both an optimal source domain establishment method based on a multidimensional spatial feature model to select the most suitable source domain, and a high-volume dataset construction method based on transparent background fruit image translation by constructing a knowledge graph of orchard scene hierarchy component synthesis rules. The EasyDAM_V3 model can automatically obtain fruit label information from the dataset, thereby eliminating manual labeling. To test the proposed method, pear was used as the selected optimal source domain, followed by orange, apple, and tomato as the target domain datasets. The results showed that the average precision of annotation reached 90.94%, 89.78%, and 90.84% for the target datasets, respectively. The EasyDAM_V3 model can obtain the optimal source domain in automatic labeling tasks, thus eliminating the manual labeling process and reducing associated costs and labor.
Neupane C, Koirala A, Wang Z, Walsh KB. Evaluation of depth cameras for use in fruit localization and sizing: Finding a successor to Kinect v2. Agronomy. 2021;11(9):1780.
Liu Y, Gao P, Zheng C, Tian L, Tian Y. A deep reinforcement learning strategy combining expert experience guidance for a fruit-picking manipulator. Electronics. 2022;11(3):311.
He L, Fang W, Zhao G, Wu Z, Fu L, Li R, Majeed Y, Dhupia J. Fruit yield prediction and estimation in orchards: A state-of-the-art comprehensive review for both direct and indirect methods. Comput Electron Agric. 2022;195:106812.
Dewi T, Mulya Z, Risma P, Oktarina Y. BLOB analysis of an automatic vision guided system for a fruit picking and placing robot. Int J Comput Vis Robot. 2021;11(3):315–327.
Koh JCO, Spangenberg G, Kant S. Automated machine learning for high-throughput image-based plant phenotyping. Remote Sens. 2021;13(5):858.
Zhang W, Chen K, Wang J, Shi Y, Guo W. Easy domain adaptation method for filling the species gap in deep learning-based fruit detection. Hortic Res. 2021;8:119.
Zhang W, Chen K, Zheng C, Liu Y, Guo W. EasyDAM_V2: Efficient data labeling method for multishape, cross-species fruit detection. Plant Phenomics. 2022;2022:9761674.
Eitz M, Hays J, Alexa M. How do humans sketch objects? ACM Trans Graph. 2012;31(4):1–10.
Wang X, Tang X. Face photo-sketch synthesis and recognition. IEEE Trans Pattern Anal Mach Intell. 2009;31(11):1955–1967.
Laffont P-Y, Ren Z, Tao X, Qian C, Hays J. Transient attributes for high-level understanding and editing of outdoor scenes. ACM Trans Graph. 2014;33(4):1–11.
Nie X, Ding H, Qi M, Wang Y, Wong EK. URCA-GAN: UpSample residual channel-wise attention generative adversarial network for image-to-image translation. Neurocomputing. 2021;443:75–84.
Langner O, Dotsch R, Bijlstra G, Wigboldus DHJ, Hawk ST,van Knippenberg A. Presentation and validation of the radboud face database. Cognit Emot. 2010;24(8):1377–1388.
Liu J, Qu F, Hong X, Zhang H. A small-sample wind turbine fault detection method with synthetic fault data using generative adversarial nets. IEEE Trans Industr Inform. 2018;15(7):3877–3888.
Gao H, Zhang Y, Lv W, Yin J, Qasim T, Wang D. A deep convolutional generative adversarial networks-based method for defect detection in small sample industrial parts images. Appl Sci. 2022;12(13):6569.
Hu X-D, Xq W, Meng F-J, Hua X, Yan Y-J, Li Y-Y, Huang J, Xl J. Gabor-CNN for object detection based on small samples. Def Technol. 2020;16(6):1116–1129.
Abbas A, Jain S, Gour M, Vankudothu S. Tomato plant disease detection using transfer learning with C-GAN synthetic images. Comput Electron Agric. 2021;187:106279.
Skovsen S, Dyrmann M, Mortensen AK, Steen KA, Green O, Eriksen J, Gislum R, Jørgensen RN, Karstoft H. Estimation of the botanical composition of clover-grass leys from RGB images using data simulation and fully convolutional neural networks. Sensors. 2017;17(12):2930.
Hani N, Roy P, Isler V. Minneapple: A benchmark dataset for apple detection and segmentation. IEEE Robot Autom Lett. 2020;5(2):852–858.
Mu Y, Chen TS, Ninomiya S, Guo W. Intact detection of highly occluded immature tomatoes on plants using deep learning techniques. Sensors. 2020;20(10):2984.
Yamamoto K, Ninomiya S, Kimura Y, Hashimoto A, Yoshioka Y, Kameoka T. Strawberry cultivar identification and quality evaluation on the basis of multiple fruit appearance features. Comput Electron Agric. 2015;110:233–240.
Li M, Coneva V, Robbins KR, Clark D, Chitwood D, Frank M. Quantitative dissection of color patterning in the foliar ornamental coleus. Plant Physiol. 2021;187(3):1310–1324.
Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).