AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Geographic-Scale Coffee Cherry Counting with Smartphones and Deep Learning

Juan Camilo Rivera-Palacio1,2,3Christian Bunn2Eric Rahn2Daisy Little-Savage4Paul Günter Schmidt2Masahiro Ryo1,3( )
Leibniz Centre for Agricultural Landscape Research (ZALF), Müncheberg, 15374, Germany
Alliance of Bioversity International and CIAT, Rome, 00153, Italy
Brandenburg University of Technology Cottbus-Senftenberg, Cottbus, 03046, Germany
Producers Direct, London, E2 8EX, UK
Show Author Information

Abstract

Deep learning and computer vision, using remote sensing and drones, are 2 promising nondestructive methods for plant monitoring and phenotyping. However, their applications are infeasible for many crop systems under tree canopies, such as coffee crops, making it challenging to perform plant monitoring and phenotyping at a large spatial scale at a low cost. This study aims to develop a geographic-scale monitoring method for coffee cherry counting, supported by an artificial intelligence (AI)-powered citizen science approach. The approach uses basic smartphones to take a few pictures of coffee trees; 2,968 trees were investigated with 8,904 pictures in Junín and Piura (Peru), Cauca, and Quindío (Colombia) in 2022, with the help of nearly 1,000 smallholder coffee farmers. Then, we trained and validated YOLO (You Only Look Once) v8 for detecting cherries in the dataset in Peru. An average number of cherries per picture was multiplied by the number of branches to estimate the total number of cherries per tree. The model's performance in Peru showed an R2 of 0.59. When the model was tested in Colombia, where different varieties are grown in different biogeoclimatic conditions, the model showed an R2 of 0.71. The overall performance in both countries reached an R2 of 0.72. The results suggest that the method can be applied to much broader scales and is transferable to other varieties, countries, and regions. To our knowledge, this is the first AI-powered method for counting coffee cherries and has the potential for a geographic-scale, multiyear, photo-based phenotypic monitoring for coffee crops in low-income countries worldwide.

References

1
Food and Agriculture Organization of the United Nations (FAO). FAOSTAT. [accessed 1 May 2023] https://www.fao.org/faostat/en/#home
2

Gay C, Estrada F, Conde C, Eakin H, Villers L. Potential impacts of climate change on agriculture: A case of study of coffee production in Veracruz, Mexico. Clim Chang. 2006;79(3):259–288.

3

Schroth G, Laderach P, Dempewolf J, Philpott S, Haggar J, Eakin H, Castillejos T, Moreno JG, Pinto LS, Hernandez R, et al. Towards a climate change adaptation strategy for coffee communities and ecosystems in the Sierra Madre de Chiapas, Mexico. Mitig Adapt Strateg Glob Chang. 2009;14(7):605–625.

4

Zullo J, Pinto HS, Assad ED, de Ávila AMH. Potential for growing Arabica coffee in the extreme south of Brazil in a warmer world. Clim Chang. 2011;109(3):535–548.

5

Cerda R, Avelino J, Gary C, Tixier P, Lechevallier E, Allinne C. Primary and secondary yield losses caused by pests and diseases: Assessment and modeling in coffee. PLoS One. 2017;12(1):1–17.

6

Bunn C, Läderach P, Ovalle Rivera O, Kirschke D. A bitter cup: Climate change profile of global production of Arabica and Robusta coffee. Clim Chang. 2015;129(1–2):89–101.

7

Maskell G, Chemura A, Nguyen H, Gornott C, Mondal P. Integration of sentinel optical and radar data for mapping smallholder coffee production systems in Vietnam. Remote Sens Environ. 2021;266:Article 112709.

8

Castro-Tanzi S, Dietsch T, Urena N, Vindas L, Chandler M. Analysis of management and site factors to improve the sustainability of smallholder coffee production in Tarrazú, Costa Rica. Agric Ecosyst Environ. 2012;155:172–181.

9
Upreti G, Bittenbender H, Ingamells JL. Rapid estimation of coffee yield. In: International Scientific Association of Coffee, editor. Proceedings of the 1991 ASIC Conference on Coffee Science. San Francisco (CA): ASIC; 1991. p. 585–593.
10

Castro-Tanzi S, Flores M, Wanner N, Dietsch TV, Banks J, Ureña-Retana N, Chandler M. Evaluation of a non-destructive sampling method and a statistical model for predicting fruit load on individual coffee (Coffea arabica) trees. Sci Hortic. 2014;167:117–126.

11

Peeters LYK, Soto-Pinto L, Perales H, Montoya G, Ishiki M. Coffee production, timber, and firewood in traditional and Inga-shaded plantations in southern Mexico. Agric Ecosyst Environ. 2003;95(2–3):481–493.

12

Soto-Pinto L, Perfecto I, Castillo-Hernandez J, Caballero-Nieto J. Shade effect on coffee production at the northern Tzeltal zone of the state of Chiapas, Mexico. Agric Ecosyst Environ. 2000;80(1):61–69.

13

Fanelli Carvalho H. The effect of bienniality on genomic prediction of yield in arabica coffee. Euphytica. 2020;216(6):101.

14

de Oliveira Aparecido LE, de Souza Rolim G, Camargo Lamparelli RA, de Souza PS, dos Santos ER. Agrometeorological models for forecasting coffee yield. Agron J. 2017;109(1):249–258.

15

Kouadio L, Deo RC, Byrareddy V, Adamowski JF, Mushtaq S, Phuong Nguyen V. Artificial intelligence approach for the prediction of Robusta coffee yield using soil fertility properties. Comput Electron Agric. 2018;155:324–338.

16

Barbosa BDS, Ferraz GAES, Costa L, Ampatzidis Y, Vijayakumar V, dos Santos LM. UAV-based coffee yield prediction utilizing feature selection and deep learning. Smart Agric Technol. 2021;1:Article 100010.

17

Rodríguez JP, Corrales DC, Aubertot JN, Corrales JC. A computer vision system for automatic cherry beans detection on coffee trees. Pattern Recogn Lett. 2020;136:142–153.

18

Ryo M, Schiller J, Stiller S, Rivera Palacio JC, Mengsuwan K, Safonova A, Wei Y. Deep learning for sustainable agriculture needs ecology and human involvement. J Sustain Agric Environ. 2023;2(1):40–44.

19
Servicio Nacional de Meteorología e Hidrología del Perú (SENHAMI). Monitoreo Meteorológico Diario. SENHAMI. [accessed 1 May 2023] https://www.senamhi.gob.pe/
20
Instituto de Hidrología, Meteorología y Estudios Ambientales (IDEAM). Tiempo y el Clima, IDEAM. [accessed 1 May 2023] http://www.ideam.gov.co
21

Maheswari P, Raja P, Apolo-Apolo OE, Pérez-Ruiz M. Intelligent fruit yield estimation for orchards using deep learning based semantic segmentation techniques—A review. Front Plant Sci. 2021;12:10.

22
Tkachenko M, Malyuk M, Holmanyuk A, Liubimov (N), Label studio: Data labeling software. Label Studio [accessed 1 May 2023] https://github.com/heartexlabs/label-studio
23

Tian Y, Yang G, Wang Z, Wang H, Li E, Liang Z. Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput Electron Agric. 2019;157:417–426.

24
Zhu X, Lyu S, Wang X, Zhao Q. TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. arXiv. 2021. https://doi.org/10.48550/arXiv.2108.11539
25
Redmon J, Santosh D, Ross G, Ali F. You Only Look Once: Unified, real-time object detection. 2016. https://doi.org/10.48550/arXiv.1506.02640
26
Redmon J, Farhadi A. YOLO9000: Better, faster, stronger. arXiv. 2016. https://doi.org/10.48550/arXiv.1612.08242
27
Li C. YOLOv6 v3.0: A full-scale reloading. arXiv. 2023. https://doi.org/10.48550/arXiv.2301.05586
28
Bochkovskiy A, Wang C-Y, Liao H-YM. YOLOv4: Optimal speed and accuracy of object detection. arXiv. 2020. https://doi.org/10.48550/arXiv.2004.10934
29
Ultralytics, “YOLOv5, ” Ultralytics. Access: May 01, 2023. [Online]. Available: https://docs.ultralytics.com/yolov5/
30
Wang C-Y, Bochkovskiy A, Liao H-YM. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv 2022. https://doi.org/10.48550/arXiv.2207.02696
31
Dosovitskiy A. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv. 2020. https://doi.org/10.48550/arXiv.2010.11929
32
Woo S, Park J, Lee J-Y, Kweon IS. CBAM: Convolutional Block Attention Module. arXiv. 2018. https://doi.org/10.48550/arXiv.1807.06521
33
Treven J, Cordova-Esparza D. A comprehensive review of yolo architectures in Computer vision: from YOLOv1 to YOLOv8 and YOLO-NAS. arXiv. 2024. https://doi.org/10.3390/make5040083
34
Paszke A. PyTorch: An imperative style, high-performance deep learning library. arXiv. 2019. https://doi.org/10.48550/arXiv.1912.01703
35
Lin T-Y. Microsoft COCO: Common Objects in Context. arXiv. 2014. https://doi.org/10.48550/arXiv.1405.0312
36
Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. In: Pereira F, Burges CJ, Bottou L, Weinberger KQ, editors. Proceedings of the 26th conference on Neural Information Processing Systems Curran Associates, Inc.; 2012. p. 1–9.
37
Wintgens JN (Ed). Coffee: Growing, processing, sustainable production: A guidebook for growers, processors, traders, and researchersWeinheim (Germany): Wiley-VCH; 2004.
38

Ying Y, Zhou D-X. Unregularized online learning algorithms with general loss functions. Appl Comput Harmon Anal. 2017;42(2):224–244.

39

Thakur A, Thapar D, Rajan P, Nigam A. Deep metric learning for bioacoustic classification: Overcoming training data scarcity using dynamic triplet loss. J Acoust Soc Am. 2019;146(1):534–547.

40
Babenko A, Slesarev A, Chigorin A, Lempitsky V. Neural codes for image retrieval. arXiv. 2014. https://doi.org/10.48550/arXiv.1404.1777
41

Wu F, Yang Z, Mo X, Wu Z, Tang W, Duan J, Zou X. Detection and counting of banana bunches by integrating deep learning and classic image-processing algorithms. Comput Electron Agric. 2023;209:107827.

42

Ramos PJ, Prieto FA, Montoya EC, Oliveros CE. Automatic fruit count on coffee branches using computer vision. Comput Electron Agric. 2017;137:9–22.

43
Farah A (Ed). Introduction to coffee plant and geneticsLondon (UK): The Royal Society of Chemistry; 2019.
Plant Phenomics
Article number: 0165
Cite this article:
Rivera-Palacio JC, Bunn C, Rahn E, et al. Geographic-Scale Coffee Cherry Counting with Smartphones and Deep Learning. Plant Phenomics, 2024, 6: 0165. https://doi.org/10.34133/plantphenomics.0165

256

Views

3

Crossref

4

Web of Science

6

Scopus

0

CSCD

Altmetrics

Received: 05 October 2023
Accepted: 07 March 2024
Published: 03 April 2024
© 2024 Juan Camilo Rivera Palacio et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return