Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
The number of leaves at a given time is important to characterize plant growth and development. In this work, we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB images. The digital plant phenotyping platform was used to simulate a large and diverse dataset of RGB images and corresponding leaf tip labels of wheat plants at seedling stages (150,000 images with over 2 million labels). The realism of the images was then improved using domain adaptation methods before training deep learning models. The results demonstrate the efficiency of the proposed method evaluated on a diverse test dataset, collecting measurements from 5 countries obtained under different environments, growth stages, and lighting conditions with different cameras (450 images with over 2,162 labels). Among the 6 combinations of deep learning models and domain adaptation techniques, the Faster-RCNN model with cycle-consistent generative adversarial network adaptation technique provided the best performance (R2 = 0.94, root mean square error = 8.7). Complementary studies show that it is essential to simulate images with sufficient realism (background, leaf texture, and lighting conditions) before applying domain adaptation techniques. Furthermore, the spatial resolution should be better than 0.6 mm per pixel to identify leaf tips. The method is claimed to be self-supervised since no manual labeling is required for model training. The self-supervised phenotyping approach developed here offers great potential for addressing a wide range of plant phenotyping problems. The trained networks are available at https://github.com/YinglunLi/Wheat-leaf-tip-detection.
Lóopez-Castañeda C, Richards RA, Farquhar GD. Variation in early vigor between wheat and barley. Crop Sci. 1995;35(2):472–479.
Lóopez-Castañeda C, Richards RA, Farquhar GD, Williamson RE. Seed and seedling characteristics contributing to variation in early vigor among temperate cereals. Crop Sci. 1996;36(5):1257–1266.
Richards RA, Lukacs Z. Seedling vigour in wheat-sources of variation for genetic and agronomic improvement. Aust J Agric Res. 2002;53(1):41–50.
McMaster GS, Wilhelm WW. Accuracy of equations predicting the phyllochron of wheat. Crop Sci. 1995;35(1):30–36.
Gauthier M, Barillot R, Andrieu B. Simulating grass phenotypic plasticity as an emergent property of growth zone responses to carbon and nitrogen metabolites. in silico Plants. 2021;3(2):diab034.
Ninomiya S, Baret F, Cheng Z-M. Plant Phenomics: Emerging transdisciplinary science. Plant Phenomics. 2019;2019:2765120.
Pasala R, Pandey BB. Plant phenomics: High-throughput technology for accelerating genomics. J Biosci. 2020;45(1).
McMaster GS. Phytomers, phyllochrons, phenology and temperate cereal development. J Agric Sci. 2005;143(2-3):137–150.
Cao W, Moss DN. Temperature effect on leaf emergence and phyllochron in wheat and Barley. Crop Sci. 1989;29:1018–1021.
Watt M, Fiorani F, Usadel B, Rascher U, Muller O, Schurr U. Phenotyping: New windows into the plant for breeders. Annu Rev Plant Biol. 2020;71:689–712.
Tardieu F, Cabrera-Bosquet L, Pridmore T, Bennett M. Plant Phenomics, from sensors to knowledge. Curr Biol. 2017;27(15):R770–R783.
Yang W, Feng H, Zhang X, Zhang J, Doonan JH, Batchelor WD, Xiong L, Yan J. Crop phenomics and high-throughput phenotyping: Past decades, current challenges, and future perspectives. Mol Plant. 2020;13(2):187–214.
Zhao C, Zhang Y, Du J, Guo X, Wen W, Gu S, Wang J, Fan J. Crop phenomics: Current status and perspectives. Front Plant Sci. 2019;10:714.
Hamuda E, Glavin M, Jones E. A survey of image processing techniques for plant extraction and segmentation in the field. Comput Electron Agric. 2016;125:184–199.
Kamilaris A, Prenafeta-Boldú FX. Deep learning in agriculture: A survey. Comput Electron Agric. 2018;147:70–90.
Kamilaris A, Prenafeta-Boldú FX. A review of the use of convolutional neural networks in agriculture. J Agric Sci. 2018;156(3):312–322.
Chandra AL, Desai SV, Balasubramanian VN, Ninomiya S, Guo W. Active learning with point supervision for cost-effective panicle detection in cereal crops. Plant Methods. 2020;16(1).
David E, Serouart M, Smith D, Madec S, Velumani K, Liu SY, Wang X, Pinto F, Shafiee S, Tahir ISA, et al. Global wheat head detection 2021: An improved dataset for benchmarking wheat head detection methods. Plant Phenomics. 2021;2021:9846158.
Lu H, Cao Z. TasselNetV2+: A fast implementation for high-throughput plant counting from high-resolution RGB imagery. Front Plant Sci. 2020;11:541960.
Dalagnol R, Wagner FH, Emilio T, Streher AS, Galvao LS, Ometto J, Aragao L. Canopy palm cover across the Brazilian Amazon forests mapped with airborne LiDAR data and deep learning. Remote Sens Ecol Conserv. 2022;8(5):601–614.
Vong CN, Conway LS, Feng AJ, Zhou JF, Kitchen NR, Sudduth KA. Corn emergence uniformity estimation and mapping using UAV imagery and deep learning. Comput Electron Agric. 2022;198.
Wang DY, Zhang DY, Yang GJ, Xu B, Luo YW, Yang XD. SSRNet: In-field counting wheat ears using multi-stage convolutional neural network. IEEE Trans Geosci Remote Sens. 2021;60.
Espejo-Garcia B, Mylonas N, Athanasakos L, Fountas S. Improving weeds identification with a repository of agricultural pre-trained deep neural networks. Comput Electron Agric. 2020;175.
Shin HC, Roth HR, Gao MC, Lu L, Xu ZY, Nogues I, Yao JH, Mollura D, Summers RM. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35(5):1285–1298.
Zheng YY, Kong JL, Jin XB, Wang XY, Su TL, Zuo M. CropDeep: The crop vision dataset for deep-learning-based classification and detection in precision agriculture. Sensors. 2019;19(5):1058.
Baek JY, Yoo YS, Bae SH. Generative adversarial ensemble learning for face forensics. IEEE Access. 2020;8:45421–45431.
Wang Y, Deng WW, Liu ZY, Wang JS. Deep learning-based vehicle detection with synthetic image data. IET Intell Transp Syst. 2019;13(7):1097–1105.
Gibbs JA, Pound M, French AP, Wells DM, Murchie E, Pridmore T. Approaches to three-dimensional reconstruction of plant shoot topology and geometry. Funct Plant Biol. 2017;44(1):62–75.
Abbas A, Jain S, Gour M, Vankudothu S. Tomato plant disease detection using transfer learning with C-GAN synthetic images. Comput Electron Agric. 2021;187.
Barth R, Ijsselmuiden J, Hemming J, Van Henten EJ. Synthetic bootstrapping of convolutional neural networks for semantic plant part segmentation. Comput Electron Agric. 2019;161:291–304.
Zhang K, Wu Q, Chen Y. Detecting soybean leaf disease from synthetic image using multi-feature fusion faster R-CNN. Comput Electron Agric. 2021;183.
Hartley ZKJ, French AP. Domain adaptation of synthetic images for wheat head detection. Plants. 2021;10(12).
Liu S, Martre P, Buis S, Abichou M, Andrieu B, Baret F. Estimation of plant and canopy architectural traits using the digital plant phenotyping platform. Plant Physiol. 2019;181(3):881–890.
Zhang WL, Chen KZ, Wang JQ, Shi Y, Guo W. Easy domain adaptation method for filling the species gap in deep learning-based fruit detection. Hortic Res. 2021;8(1).
Pradal C, Dufour-Kowalski S, Boudon F, Fournier C, Godin C. OpenAlea: A visual programming and component-based software platform for plant modelling. Funct Plant Biol. 2008;35(10):751–760.
Liu S, Baret F, Allard D, Jin X, Andrieu B, Burger P, Hemmerlé M, Comar A. A method to estimate plant density and plant spacing heterogeneity: Application to wheat crops. Plant Methods. 2017;13(1):38.
Bourgault M, Webber HA, Chenu K, O'Leary GJ, Gaiser T, Siebert S, Dreccer F, Huth N, Fitzgerald GJ, Tausz M, et al. Early vigour in wheat: Could it lead to more severe terminal drought stress under elevated atmospheric [CO2] and semi-arid conditions? Glob Chang Biol. 2020;26(7):4079–4093.
Duan T, Chapman SC, Holland E, Rebetzke GJ, Guo Y, Zheng B. Dynamic quantification of canopy structure to characterize early plant vigour in wheat genotypes. J Exp Bot. 2016;67(15):4523–4534.
Baret F, Solan BD, Lopez-Lozano R, Kai M, Weiss M. GAI estimates of row crops from downward looking digital photos taken perpendicular to rows at 57.5° zenith angle: Theoretical considerations based on 3D architecture models and application to wheat crops. Agric For Meteorol. 2010;150(11):1393–1401.
Distributed under a Creative Commons Attribution License (CC BY 4.0).