Plant pigment content is a crucial indicator for assessing photosynthetic efficiency, nutritional status, and physiological health. Its spatial distribution is significantly influenced by variety, location, and environmental factors. However, existing methods for measuring pigment content are often destructive, inefficient, and costly, making them unsuitable for the demands of modern precision agriculture. This study proposes a cross-scale, non-destructive detection method for lettuce pigments by integrating hyperspectral imaging (HSI) technology with deep learning algorithms, addressing the limitations of existing techniques in high-throughput and spatial resolution analysis. In this study, we built a multidimensional dataset based on eight different types of lettuce and developed a deep learning model named LPCNet to predict the contents of chlorophyll a (Chl a), chlorophyll b (Chl b), carotenoids (Car), and total pigment content (TPC) in lettuce. The LPCNet model integrates convolutional neural networks (CNN), bidirectional long short-term memory networks (BiLSTM), and multi-head self-attention (MHSA) mechanisms, enabling automatic extraction of pigment-related key features and simplifying the complex preprocessing and feature selection procedures required in traditional machine learning. Compared to multivariate analysis methods in machine learning, LPCNet demonstrated superior predictive accuracy, with coefficients of determination (RP2) of 0.9449, 0.8613, 0.9121, and 0.8476 for Chl a, Chl b, Car, and TPC, respectively. Additionally, by combining the hyperspectral reflectance of lettuce canopies with the leaf-level inversion model, we visualized the spatial distribution of pigment content on the canopy of lettuce, achieving cross-scale analysis from leaf to canopy. This study provides an innovative approach for the rapid and accurate assessment of lettuce pigment content and offers an effective visualization tool for revealing the physiological processes and growth development of lettuce.
- Article type
- Year
- Co-author
Open Access
Research Article
Issue
Open Access
Issue
In order to address the challenge of non-destructive detection of tomato fruit ripeness in controlled environments, this study proposed a real-time instance segmentation method based on the edge device. This method combined the principles of phenotype robots and machine vision based on deep learning. A compact and remotely controllable phenotype detection robot was employed to acquire precise data on tomato ripeness. The video data were then processed by using an efficient backbone and the FeatFlowNet structure for feature extraction and analysis of key-frame to non-key-frame mapping from video data. To enhance the diversity of training datasets and the generalization of the model, an innovative approach was chosen by using random enhancement techniques. Besides, the PolyLoss optimization technique was applied to further improve the accuracy of the ripeness multi-class detection tasks. Through validation, the method of this study achieved real-time processing speeds of 90.1 fps (RTX 3070Ti) and 65.5 fps (RTX 2060 S), with an average detection accuracy of 97% compared to manually measured results. This is more accurate and efficient than other instance segmentation models according to actual testing in a greenhouse. Therefore, the results of this research can be deployed in edge devices and provide technical support for unmanned greenhouse monitoring devices or fruit-picking robots in facility environments.
There's a growing demand among plant cultivators and breeders for efficient methods to acquire plant phenotypic traits at high throughput, facilitating the establishment of mappings from phenotypes to genotypes. By integrating mobile phenotyping platforms with improved instance segmentation techniques, researchers have achieved a significant advancement in the automation and accuracy of phenotypic data extraction. Addressing the need for rapid extraction of leaf age and canopy width phenotypes in strawberry plants cultivated in controlled environments, this study introduces a novel high-throughput phenotyping extraction approach leveraging a mobile phenotyping platform and instance segmentation technology.
Data acquisition was conducted using a compact mobile phenotyping platform equipped with an array of sensors, including an RGB sensor, and edge control computers, capable of capturing overhead images of potted strawberry plants in greenhouses. Targeted adjustments to the network structure were made to develop an enhanced convolutional neural network (Mask R-CNN) model for processing strawberry plant image data and rapidly extracting plant phenotypic information. The model initially employed a split-attention networks (ResNeSt) backbone with a group attention module, replacing the original network to improve the precision and efficiency of image feature extraction. During training, the model adopted the Mosaic method, suitable for instance segmentation data augmentation, to expand the dataset of strawberry images. Additionally, it optimized the original cross-entropy classification loss function with a binary cross-entropy loss function to achieve better detection accuracy of plants and leaves. Based on this, the improved Mask R-CNN description involves post-processing of training results. It utilized the positional relationship between leaf and plant masks to statistically count the number of leaves. Additionally, it employed segmentation masks and image calibration against true values to calculate the canopy width of the plant.
This research conducted a thorough evaluation and comparison of the performance of an improved Mask R-CNN model, underpinned by the ResNeSt-101 backbone network. This model achieved a commendable mask accuracy of 80.1% and a detection box accuracy of 89.6%. It demonstrated the ability to efficiently estimate the age of strawberry leaves, demonstrating a high plant detection rate of 99.3% and a leaf count accuracy of 98.0%. This accuracy marked a significant improvement over the original Mask R-CNN model and meeting the precise needs for phenotypic data extraction. The method displayed notable accuracy in measuring the canopy widths of strawberry plants, with errors falling below 5% in about 98.1% of cases, highlighting its effectiveness in phenotypic dimension evaluation. Moreover, the model operated at a speed of 12.9 frames per second (FPS) on edge devices, effectively balancing accuracy and operational efficiency. This speed proved adequate for real-time applications, enabling rapid phenotypic data extraction even on devices with limited computational capabilitie.
This study successfully deployed a mobile phenotyping platform combined with instance segmentation techniques to analyze image data and extract various phenotypic indicators of strawberry plant. Notably, the method demonstrates remarkable robustness. The seamless fusion of mobile platforms and advanced image processing methods not only enhances efficiency but also ignifies a shift towards data-driven decision-making in agriculture.
Open Access
Research Article
Issue
Plant vascular bundles are responsible for water and material transportation, and their quantitative and functional evaluation is desirable in plant research. At the single-plant level, the number, size, and distribution of vascular bundles vary widely, posing a challenge to automatically and accurately identifying and quantifying them. In this study, a deep learning-integrated phenotyping pipeline was developed to robustly and accurately detect vascular bundles in Computed Tomography (CT) images of stem internodes. Two semantic indicators were used to evaluate and identify a suitable feature extraction network for semantic segmentation models. The epidermis thickness of maize stem was evaluated for the first time and adjacent vascular bundles were improved using an adaptive watershed-based approach. The counting accuracy (R2) of vascular bundles was 0.997 for all types of stem internodes, and the measured accuracy of size traits was over 0.98. Combining sap flow experiments, multiscale traits of vascular bundles were evaluated at the single-plant level, which provided an insight into the water use efficiency of the maize plant.
Open Access
Review
Issue
With the rapid development of genetic analysis techniques and crop population size, phenotyping has become the bottleneck restricting crop breeding. Breaking through this bottleneck will require phenomics, defined as the accurate, high-throughput acquisition and analysis of multi-dimensional phenotypes during crop growth at organism-wide levels, ranging from cells to organs, individual plants, plots, and fields. Here we offer an overview of crop phenomics research from technological and platform viewpoints at various scales, including microscopic, ground-based, and aerial phenotyping and phenotypic data analysis. We describe recent applications of high-throughput phenotyping platforms for abiotic/biotic stress and yield assessment. Finally, we discuss current challenges and offer perspectives on future phenomics research.
京公网安备11010802044758号