Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
Accurate and high-throughput plant phenotyping is important for accelerating crop breeding. Spectral imaging that can acquire both spectral and spatial information of plants related to structural, biochemical, and physiological traits becomes one of the popular phenotyping techniques. However, close-range spectral imaging of plants could be highly affected by the complex plant structure and illumination conditions, which becomes one of the main challenges for close-range plant phenotyping. In this study, we proposed a new method for generating high-quality plant 3-dimensional multispectral point clouds. Speeded-Up Robust Features and Demons was used for fusing depth and snapshot spectral images acquired at close range. A reflectance correction method for plant spectral images based on hemisphere references combined with artificial neural network was developed for eliminating the illumination effects. The proposed Speeded-Up Robust Features and Demons achieved an average structural similarity index measure of 0.931, outperforming the classic approaches with an average structural similarity index measure of 0.889 in RGB and snapshot spectral image registration. The distribution of digital number values of the references at different positions and orientations was simulated using artificial neural network with the determination coefficient (R2) of 0.962 and root mean squared error of 0.036. Compared with the ground truth measured by ASD spectrometer, the average root mean squared error of the reflectance spectra before and after reflectance correction at different leaf positions decreased by 78.0%. For the same leaf position, the average Euclidean distances between the multiview reflectance spectra decreased by 60.7%. Our results indicate that the proposed method achieves a good performance in generating plant 3-dimensional multispectral point clouds, which is promising for close-range plant phenotyping.
Lowe A, Harrison N, French AP. Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods. 2017;13:Article 80.
Lenk S, Chaerle L, Pfundel EE, Langsdorf G, Hagenbeek D, Lichtenthaler HK, Van Der Straeten D, Buschmann C. Multispectral fluorescence and reflectance imaging at the leaf level and its possible applications. J Exp Bot. 2007;58(4):807–814.
Sun DW, Robbins K, Morales N, Shu QY, Cen HY. Advances in optical phenotyping of cereal crops. Trends Plant Sci. 2022;27(2):191–208.
Wang JZ, Zhang Y, Gu RR. Research status and prospects on plant canopy structure measurement using visual sensors based on three-dimensional reconstruction. Agriculture. 2020;10(10):462.
Paturkar A, Sen Gupta G, Bailey D. Making use of 3D models for plant physiognomic analysis: A review. Remote Sens. 2021;13(11):2232.
Piovesan A, Vancauwenberghe V, Van de Looverbosch T, Verboven P, Nicolai B. X-ray computed tomography for 3D plant imaging. Trends Plant Sci. 2021;26(11):1171–1185.
Jurado JM, Ortega L, Cubillas JJ, Feito FR. Multispectral mapping on 3D models and multi-temporal monitoring for individual characterization of olive trees. Remote Sens. 2020;12(7):1106.
Jay S, Bendoula R, Hadoux X, Féret J-B, Gorretta N. A physically-based model for retrieving foliar biochemistry and leaf orientation using close-range imaging spectroscopy. Remote Sens Environ. 2016;177:220–236.
Behmann J, Behmann J, Mahlein A-K, Mahlein A-K, Paulus S, Paulus S, Dupuis J, Dupuis J, Kuhlmann H, Kuhlmann H, et al. Generation and application of hyperspectral 3D plant models: Methods and challenges. Mach Vis Appl. 2016;27(5):611–624.
Sun G, Wang X, Sun Y, Ding Y, Lu W. Measurement method based on multispectral three-dimensional imaging for the chlorophyll contents of greenhouse tomato plants. Sensors (Basel). 2019;19(15):3345.
Liu HJ, Lee SH, Chahl JS. Registration of multispectral 3D points for plant inspection. Precis Agric. 2018;19(3):513–536.
Hu P, Huang H, Chen Y, Qi J, Li W, Jiang C, Wu H, Tian W, Hyyppä J. Analyzing the angle effect of leaf reflectance measured by indoor hyperspectral light detection and ranging (LiDAR). Remote Sens. 2020;12(6):919.
Yang K, Pan AN, Yang Y, Zhang S, Ong SH, Tang HL. Remote sensing image registration using multiple image features. Remote Sens. 2017;9(6):581.
Meinen BU, Robinson DT. Mapping erosion and deposition in an agricultural landscape: Optimization of UAV image acquisition schemes for SfM-MVS. Remote Sens Environ. 2020;239(3):Article 111666.
Lopez A, Jurado JM, Ogayar CJ, Feito FR. A framework for registering UAV-based imagery for crop-tracking in precision agriculture. Int J Appl Earth Obs Geoinf. 2021;97:Article 102274.
Zhao JQ, Zhang XH, Gao CX, Qiu XL, Tian YC, Zhu Y, Cao WX. Rapid mosaicking of unmanned aerial vehicle (UAV) images for crop growth monitoring using the SIFT algorithm. Remote Sens. 2019;11(10):1226.
Mishra P, Polder G, Gowen A, Rutledge DN, Roger JM. Utilising variable sorting for normalisation to correct illumination effects in close-range spectral images of potato plants. Biosyst Eng. 2020;197:318–323.
Mishra P, Lohumi S, Khan HA, Nordon A. Close-range hyperspectral imaging of whole plants for digital phenotyping: Recent applications and illumination correction approaches. Comput Electron Agric. 2020;178:Article 105780.
Asaari MSM, Mishra P, Mertens S, Dhondt S, Inzé D, Wuyts N, Scheunders P. Close-range hyperspectral image analysis for the early detection of stress responses in individual plants in a high-throughput phenotyping platform. ISPRS J Photogramm Remote Sens. 2018;138:121–138.
Shi H, Xiao Z. A canopy radiative transfer model considering leaf dorsoventrality. IEEE Trans Geosci Remote Sens. 2021;60:Article 2002711.
Proctor C, Dao PD, He Y. Close-range, heavy-duty hyperspectral imaging for tracking drought impacts using the PROCOSINE model. J Quant Spectrosc Radiat Transf. 2021;263:Article 107528.
Zhang L, Jin J, Wang L, Huang P, Ma D. A 3D white referencing method for soybean leaves based on fusion of hyperspectral images and 3D point clouds. Precis Agric. 2020;21(6):1173–1186.
Bay H, Ess A, Tuytelaars T, Van Gool L. Speeded-up robust features (SURF). Comput Vis Image Underst. 2008;110(3):346–359.
Vercauteren T, Pennec X, Perchant A, Ayache N. Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage. 2009;45(1):S61–S72.
Thirion JP. Image matching as a diffusion process: An analogy with Maxwell's demons. Med Image Anal. 1998;2(3):243–260.
Al Makdessi N, Ecarnot M, Roumet P, Rabatel G. A spectral correction method for multi-scattering effects in close range hyperspectral imagery of vegetation scenes: Application to nitrogen content assessment in wheat. Precis Agric. 2019;20(2):237–259.
Ollinger SV. Sources of variability in canopy reflectance and the convergent properties of plants. New Phytol. 2011;189(2):375–394.
Ziv C, Zhao Z, Gao YG, Xia Y. Multifunctional roles of plant cuticle during plant-pathogen interactions. Front Plant Sci. 2018;9:Article 1088.
Asaari MSM, Mertens S, Dhondt S, Inzé D, Wuyts N, Scheunders P. Analysis of hyperspectral images for detection of drought stress and recovery in maize plants in a high-throughput phenotyping platform. Comput Electron Agric. 2019;162:749–758.
Li W, Sun Z, Lu S, Omasa K. Estimation of the leaf chlorophyll content using multiangular spectral reflectance factor. Plant Cell Environ. 2019;42(11):3152–3165.
Bao Y, Shah DS, Tang L. 3D perception-based collision-free robotic leaf probing for automated indoor plant phenotyping. Trans ASABE. 2018;61(3):859–872.
Makdessi NA, Jean P-A, Ecarnot M, Gorretta N, Rabatel G, Roumet P. How plant structure impacts the biochemical leaf traits assessment from in-field hyperspectral images: A simulation study based on light propagation modeling in 3D virtual wheat scenes. Field Crop Res. 2017;205:95–105.
Cook RL, Torrance KE. A reflectance model for computer graphics. ACM Trans Graph. 1987;1:7–24.
Ross JK, Marshak AL. Calculation of canopy bidirectional reflectance using the Monte Carlo method. Remote Sens Environ. 1988;24(2):213–225.
Phong BT. Illumination for computer generated pictures. Commun ACM. 1975;18(6):311–317.
Blinn JF, Newell ME. Texture and reflection in computer generated images. Commun ACM. 1976;19(10):542–547.
Ghahremani M, Williams K, Corke FMK, Tiddeman B, Liu Y, Doonan JH. Deep segmentation of point clouds of wheat. Front Plant Sci. 2021;12:Article 608732.
Distributed under a Creative Commons Attribution License (CC BY 4.0).