Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
Recently, deep learning-based fruit detection applications have been widely used in the modern fruit industry; however, the training data labeling process remains a time-consuming and labor-intensive process. Auto labeling can provide a convenient and efficient data source for constructing smart orchards based on deep-learning technology. In our previous study, based on a labeled source domain fruit dataset, we used a generative adversarial network and a fruit detection model to achieve auto labeling of unlabeled target domain fruit images. However, since the current method uses one species source domain fruit to label multiple species target domain fruits, there is a problem of the domain gap in both the foreground and the background between the training data (retaining the source domain fruit label information) and the application data (target domain fruit images) of the fruit detection model. Therefore, we propose a domain-adaptive anchor-free fruit detection model, DomAda-FruitDet, and apply it to the previously proposed fruit labeling method to further improve the accuracy. It consists of 2 design aspects: (a) With a foreground domain-adaptive structure based on double prediction layers, an anchor-free method with multiscale detection capability is constructed to generate adaptive bounding boxes that overcome the foreground domain gap; (b) with a background domain-adaptive strategy based on sample allocation, we enhance the ability of the model to extract foreground object features to overcome the background domain gap. As a result, the proposed method can label actual apple, tomato, pitaya, and mango datasets, with an average precision of 90.9%, 90.8%, 88.3%, and 94.0%, respectively. In conclusion, the proposed DomAda-FruitDet effectively addressed the problem of the domain gap and improved effective auto labeling for fruit detection tasks.
Anderson NT, Walsh KB, Wulfsohn D. Technologies for forecasting tree fruit load and harvest timing—From ground, sky and time. Agronomy. 2021;11(7):1409.
Chang A, Jung J, Yeom J, Maeda MM, Landivar JA, Enciso JM, Avila CA, Anciso JR. Unmanned aircraft system- (UAS-) based high-throughput phenotyping (HTP) for tomato yield estimation. J Sens. 2021;2021:8875606.
Tang Y, Zhou H, Wang H, Zhang Y. Fruit detection and positioning technology for a Camellia oleifera C. Abel orchard based on improved YOLOv4-tiny model and binocular stereo vision. Expert Syst Appl. 2023;211:Article 118573.
Cai L, Liang J, Xu X, Duan J, Yang Z. Banana pseudostem visual detection method based on improved YOLOV7 detection algorithm. Agronomy. 2023;13(4):999.
Liu X, Li G, Chen W, Liu B, Chen M, Lu S. Detection of dense citrus fruits by combining coordinated attention and cross-scale connection with weighted feature fusion. Appl Sci. 2022;12(13):6600.
Aishwarya N, Praveena NG, Priyanka S, Pramod J. Smart farming for detection and identification of tomato plant diseases using light weight deep neural network. Multimed Tools Appl. 2023;82(12):18799–18810.
Zhang W, Chen K, Wang J, Shi Y, Guo W. Easy domain adaptation method for filling the species gap in deep learning-based fruit detection. Hortic Res. 2021;8(1):119.
Zhang W, Chen K, Zheng C, Liu Y, Guo W. EasyDAM_V2: Efficient data labeling method for multishape, cross-species fruit detection. Plant Phenomics. 2022;2022:9761674.
Zhang W, Wang J, Liu Y, Chen K, Li H, Duan Y, Wu W, Shi Y, Guo W. Deep-learning-based in-field citrus fruit detection and tracking. Hortic Res. 2022;9:uhac003.
Oza P, Sindagi VA, Sharmini VV, Patel VM, Patel VM. Unsupervised domain adaptation of object detectors: A survey. IEEE Trans Pattern Anal Mach Intell. 2023.
Shen Z, Huang M, Shi J, Liu Z, Maheshwari H, Zheng Y, Xue X, Savvides M, Huang TS. CDTD: A large-scale cross-domain benchmark for instance-level image-to-image translation and domain adaptive object detection. Int J Comput Vis. 2021;129:761–780.
Yan B, Fan P, Lei X, Liu Z, Yang F. A real-time apple targets detection method for picking robot based on improved YOLOv5. Remote Sens. 2021;13(9):1619.
Kateb FA, Monowar MM, Hamid M, Ohi AQ, Mridha MF. FruitDet: Attentive feature aggregation for real-time fruit detection in orchards. Agronomy. 2021;11(12):2440.
Cui Z, Sun HM, Yu JT, Yin RN, Jia RS. Fast detection method of green peach for application of picking robot. Appl Intell. 2022;52(2):1718–1739.
Parico AIB, Ahamed T. Real time pear fruit detection and counting using YOLOv4 models and deep SORT. Sensors. 2021;21(14):4803.
de Castro F, Gladston A. FPN-based small orange fruit detection from farm images with occlusion. IJKBO. 2022;12 (1):1–12.
Sun M, Xu L, Luo R, Lu Y, Jia W. GHFormer-net: Towards more accurate small green apple/begonia fruit detection in the nighttime. J King Saud Univ-Compt Inf Sci. 2022;27(7):4421–4432.
Yang W, Ma X, Hu W, Tang P. Lightweight blueberry fruit recognition based on multiscale and attention fusion NCBAM. Agronomy. 2022;12(10):2354.
Liu G, Hou Z, Liu H, Liu J, Zhao W, Li K. TomatoDet: Anchor-free detector for tomato detection. Front Plant Sci. 2022;13:Article 942875.
Ji W, Pan Y, Xu B, Wang J. A real-time apple targets detection method for picking robot based on ShufflenetV2-YOLOX. Agriculture. 2022;12(6):856.
Wei J, Ding Y, Liu J, Ullah MZ, Yin X, Jia W. Novel green-fruit detection algorithm based on D2D framework. Int J Agric Biol Eng. 2022;15(1):251–259.
Chen Y, Wang H, Li W, Sakaridis C, Dai D, Van Gool L. Scale-aware Domain Adaptive Faster R-CNN. Int J Comput Vis. 2021;129:2223–2243.
Li X, Wang W, Wu L, Chen S, Hu X, Li J, Tang J, Yang J. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. Adv Neural Inf Proces Syst. 2020;33:21002–21012.
Häni N, Roy P, Isler V. MinneApple: A benchmark dataset for apple detection and segmentation. IEEE Robotics and Automation Letters. 2020;5:852–858.
Mu Y, Chen TS, Ninomiya S, Guo W. Intact detection of highly occluded immature tomatoes on plants using deep learning techniques. Sensors. 2020;20(10):2984.
Koirala A, Walsh KB, Wang Z, McCarthy C. Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of ‘MangoYOLO’. Precis Agric. 2019;20:1107–1135.
Divyanth LG, Soni P, Pareek CM, Machavaram R, Nadimi M, Paliwal J. Detection of coconut clusters based on occlusion condition using attention-guided faster R-CNN for robotic harvesting. Foods. 2022;11(23):3903.
Li X, Pan J, Xie F, Zeng J, Li Q, Huang X, Liu D, Wang X. Fast and accurate green pepper detection in complex backgrounds via an improved Yolov4-tiny model. Comput Electron Agric. 2021;191:Article 106503.
Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).