AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Semi-supervised Counting of Grape Berries in the Field Based on Density Mutual Exclusion

Yanan Li1,2,Yuling Tang1,2,( )Yifei Liu1,2Dingrun Zheng1,2
School of Computer Science and Engineering, School of Artificial Intelligence, Wuhan Institute of Technology, Wuhan 430205, China
Hubei Key Laboratory of Intelligent Robot, Wuhan Institute of Technology, Wuhan 430073, China

†These authors contributed equally to this work.

Show Author Information

Abstract

Automated counting of grape berries has become one of the most important tasks in grape yield prediction. However, dense distribution of berries and the severe occlusion between berries bring great challenges to counting algorithm based on deep learning. The collection of data required for model training is also a tedious and expensive work. To address these issues and cost-effectively count grape berries, a semi-supervised counting of grape berries in the field based on density mutual exclusion (CDMENet) is proposed. The algorithm uses VGG16 as the backbone to extract image features. Auxiliary tasks based on density mutual exclusion are introduced. The tasks exploit the spatial distribution pattern of grape berries in density levels to make full use of unlabeled data. In addition, a density difference loss is designed. The feature representation is enhanced by amplifying the difference of features between different density levels. The experimental results on the field grape berry dataset show that CDMENet achieves less counting errors. Compared with the state of the arts, coefficient of determination (R2) is improved by 6.10%, and mean absolute error and root mean square error are reduced by 49.36% and 54.08%, respectively. The code is available at https://github.com/youth-tang/CDMENet-main.

References

1

Barriguinha A, de Castro Neto M, Gil A. Vineyard yield estimation, prediction, and forecasting: A systematic literature review. Agronomy. 2021;11(9):1789.

2

Laurent C, Oger B, Taylor JA, Scholasch T, Metay A, Tisseyre B. A review of the issues, methods and perspectives for yield estimation, prediction and forecasting in viticulture. Eur J Agron. 2021;130:Article 126339.

3

Shen L, Su J, He R, Song L, Huang R, Fang Y, Song Y, Su B. Real-time tracking and counting of grape clusters in the field based on channel pruning with yolov5s. Comput Electron Agric. 2023;206:Article 107662.

4

Pérez-Zavala R, Torres-Torriti M, Cheein FA, Troni G. A pattern recognition strategy for visual grape bunch detection in vineyards. Comput Electron Agric. 2018;151:136–149.

5

Zabawa L, Kicherer A, Klingbeil L, Töpfer R, Kuhlmann H, Roscher R. Counting of grapevine berries in images via semantic segmentation using convolutional neural networks. ISPRS J Photogramm Remote Sens. 2020;164:73–83.

6

Coviello L, Cristoforetti M, Jurman G, Furlanello C. Gbcnet: In-field grape berries counting for yield estimation by dilated cnns. Appl Sci. 2020;10(14):4870.

7

Liu S, Zeng X, Whitty M. A vision-based robust grape berry counting algorithm for fast calibration-free bunch weight estimation in the field. Comput Electron Agric. 2020;173:Article 105360.

8

Zabawa L, Kicherer A, Klingbeil L, Töpfer R, Roscher R, Kuhlmann H. Image-based analysis of yield parameters in viticulture. Biosyst Eng. 2022;218(9):94–109.

9

Palacios F, Melo-Pinto P, Diago MP, Tardaguila J. Deep learning and computer vision for assessing the number of actual berries in commercial vineyards. Biosyst Eng. 2022;218:175–188.

10
Cai E, Baireddy S, Yang C, Delp EJ, Crawford M. Paper presented at: 2021 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) (2021), pp. 6280–6283.
11

Li Y, Ma R, Zhang R, Cheng Y, Dong C. A tea buds counting method based on yolov5 and kalman filter tracking algorithm. Plant Phenomics. 2023;5:0030.

12

Rong J, Zhou H, Zhang F, Yuan T, Wang P. Tomato cluster detection and counting using improved yolov5 based on rgb-d fusion. Comput Electron Agric. 2023;207:Article 107741.

13
Vishal MK. Paper presented at: IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium (2020), pp. 5286–5289.
14

Lu H, Cao Z. Tasselnetv2+: A fast implementation for high-throughput plant counting from high-resolution rgb imagery. Front Plant Sci. 2020;11:541960.

15

Huang Z, Li Y, Wang H. Cotton bolls counting algorithm in field based on density level classification. Jisuanji Gongc/Comput Eng. 2020;38(5):0206.

16

Hao X, Cao Y, Zhang Z, Tomasetto F, Yan W, Xu C, Luan Q, Li Y. Countshoots: Automatic detection and counting of slash pine new shoots using uav imagery. Plant Phenomics. 2023;5:0065.

17
Jiang X. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020), pp. 4705–4714; 2020.
18
Lian D, Li J, Zheng J, Luo W, Gao S. Paper presented at: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019), pp. 1821–1830.
19

Wang P, Gao C, Wang Y, Li H, Gao Y. Mobilecount: An efficient encoder-decoder framework for real-time crowd counting. Neurocomputing. 2020;407(1):292.

20
Lin H, Ma Z, Ji R, Wang Y, Hong X. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022), pp. 19596–19605. 2022.
21
Ma Z, Wei X, Hong X, Gong Y. Paper presented at: IEEE/CVF International Conference on Computer Vision (ICCV) (2019), pp. 6141–6150. 2019.
22
Hsieh M-R, Lin Y-L, Hsu WH. Paper presented at: 2017 IEEE/CVF International Conference on Computer Vision (ICCV); 2017.
23

Zhao Y, Li W, Li Y, Qi Y, Li Z, Yue J. Lfcnet: A lightweight fish counting model based on density map regression. Comput Electron Agric. 2022;203:Article 107496.

24

Wen C, Wu J, Chen H, Su H, Chen X, Li Z, Yang C. Wheat spike detection and counting in the field based on spikeretinanet. Front Plant Sci. 2022;13:821717.

25

Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM. Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35(5):1285.

26

Zheng Y-Y, Kong JL, Jin XB, Wang XY, Zuo M. Cropdeep: The crop vision dataset for deep-learning-based classification and detection in precision agriculture. Sensors. 2019;19(5):1058.

27

Li Y, Zhan X, Liu S, Lu H, Jiang R, Guo W, Chapman S, Ge Y, Solan B, Ding Y, et al. Self-supervised plant phenotyping by combining domain adaptation with 3d plant model simulations: Application to wheat leaf counting at seedling stage. Plant Phenomics. 2023;5:0041.

28

Koirala A, Walsh KB, Wang Z, McCarthy C. Deep learning - method overview and review of use for fruit detection and yield estimation. Comput Electron Agric. 2019;162:219.

29

Zhang Y, Zhang W, Yu J, He L, Chen J, He Y. Complete and accurate holly fruits counting using yolox object detection. Comput Electron Agric. 2022;198:Article 107062.

30
Idrees H, Saleemi I, Seibert C, Shah M. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2013), pp. 2547–2554. 2013.
31

TeHran PS, Virlet N, Ampe EM, Reyns P, Hawkesford MJ. Deepcount: In-field automatic quantification of wheat spikes using simple linear iterative clustering and deep convolutional neural networks. Front Plant Sci. 2019;10:1176.

32

Bai X, Liu P, Cao Z, Lu H, Xiong H, Yang A, Cai Z, Wang J, Yao J. Rice plant counting, locating, and sizing method based on high-throughput uav rgb images. Plant Phenomics. 2023;5:0020.

33
Li Y, Zhang X, Chen D. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018), pp. 1091–1100. 2018.
34
Liu W, Salzmann M, Fua P. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019), pp. 5094–5103. 2019.
35
Xu Y. Paper presented at: IEEE/CVF International Conference on Computer Vision (ICCV) (2021), pp. 15550–15559. 2021.
36
Liu X, van de Weijer J, Bagdanov AD. Crowd Counting With Partial Annotations in an Image. Paper presented at: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018), pp. 7661–7669.
37

Liu X. Exploiting unlabeled data in cnns by self-supervised learning to rank. IEEE Trans Pattern Anal Mach Intell. 2019;41:1862.

38
Gao J. S2fpr: Crowd counting via self-supervised coarse to fine feature pyramid ranking. ArXiv. 2022. https://doi.org/10.48550/arXiv.2201.04819
39
Liu Y, Liu L, Wang P, Zhang P, Lei Y. In: Vedaldi A, Bischof H, Brox T, Frahm J-M, editors. 2020 European Conference on Computer Vision (ECCV). Cham: Springer International Publishing; 2020. p. 242–259.
40
Sindagi VA, Yasarla R, Babu DS, Babu RV, Patel VM. In: Vedaldi A, Bischof H, Brox T, Frahm J-M., editors. 2020 European Conference on Computer Vision (ECCV). Cham: Springer International Publishing; 2020. p. 212–229.
41

Peng S, Yin B, Xia Y, Yang Q, Wang L. Asia conference on algorithms. Comput Mach Learn (CACML). 2022;2022:749–755.

42
Shi Z, Mettes P, Snoek C. Paper presented at: IEEE/CVF International Conference on Computer Vision (ICCV) (2019), pp. 4199–4208. 2019.
43
Zhao M, Zhang J, Zhang C, Zhang W. Paper presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019), pp. 12728–12737. 2019.
44

Gao J, Wang Q, Li X. Pcc net: Perspective crowd counting via spatial convolutional network. IEEE Trans Circuits Syst Video Technol. 2020;30(99):3486.

45

Santos TT, de Souza LL, dos Santos AA, Avila S. Grape detection, segmentation, and tracking using deep neural networks and three-dimensional association. Comput Electron Agric. 2020;170:Article 105247.

46
Paszke A. Paper presented at: International Conference on Neural Information Processing Systems (ICONIP) (2019), vol. 32, pp. 8024–8035. 2019.
47
Kingma DP, Ba J. Adam: A method for stochastic optimization. CoRR. 2014;abs/1412.6980.
Plant Phenomics
Article number: 0115
Cite this article:
Li Y, Tang Y, Liu Y, et al. Semi-supervised Counting of Grape Berries in the Field Based on Density Mutual Exclusion. Plant Phenomics, 2023, 5: 0115. https://doi.org/10.34133/plantphenomics.0115

142

Views

6

Crossref

5

Web of Science

5

Scopus

0

CSCD

Altmetrics

Received: 26 June 2023
Accepted: 29 October 2023
Published: 28 November 2023
© 2023 Yanan Li et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return