Publications
Sort:
Issue
Development of an intelligent monitoring system for vegetation coverage and phenology in grassland
Transactions of the Chinese Society of Agricultural Engineering 2023, 39(18): 162-171
Published: 30 September 2023
Abstract PDF (3.5 MB) Collect
Downloads:1

An intelligent monitoring system was developed to continuously, rapidly and accurately identify the grassland vegetation cover and the key phenological periods. The fixed monitoring, mobile monitoring and cloud platforms were also combined to provide a solution. The innovative system consisted of three main components: the fixed and mobile monitoring subsystem, as well as the cloud platform of grassland phenology intelligent monitoring. The fixed monitoring subsystem included various components, such as phenology cameras, power modules, communication modules, edge computing controllers, and supporting poles. The mobile monitoring subsystem consisted of handheld devices with capabilities, such as dustproof, waterproof, and shockproof, along with the necessary applications. The survey plot frames of the grassland field were required for the on-site image collection. The cloud-based grassland phenology intelligent monitoring platform was designed with a browser/server architecture, and then deployed on the Alibaba Cloud’s lightweight application server. As such, the platform was connected seamlessly to a MySQL database, with a user-friendly front-end built on the LayUI framework and a robust back-end using the Spring Boot framework. The efficient storage of collected images and periodic processing was obtained from the comprehensive data, such as the grassland vegetation index, vegetation cover, and phenological parameters. The cloud platform offered a wide range of functionalities, including data querying, processing, displaying, and sharing. Both the fixed and mobile monitoring subsystem were utilized to capture the grassland vegetation images. The fixed and mobile monitoring subsystem were operated and uploaded independently to the cloud platform using a cloud server. A series of processing steps were used to extract the regions of interest, and automatically calculate the grassland vegetation index using advanced techniques of image processing. The vegetation index was then converted into a grayscale space for the single-channel grayscale image. Binarization segmentation was performed to accurately extract all vegetation pixels using the maximum interclass variance method, according to the grayscale value differences between vegetation and non-vegetation areas. This process enabled the system to identify the grassland vegetation cover, and the obtained data was stored in a dedicated database. A double logistic function was used to fit the time series of the vegetation index for the vegetation growth pattern. A precise curve of vegetation growth was formed after fitting. Furthermore, a dynamic threshold method was selected to extract the important phenological parameters suitable for the growth pattern of black oatgrass using TIMESAT software. The innovative system demonstrated that an impressive accuracy rate of 90% was achieved for the grassland vegetation cover identification using the combination of the excess green index (EXG) with the maximum interclass variance method. This performance fully met the high demands of automated and bulk extraction of grassland vegetation cover. Additionally, the extraction of vegetation indices with GCC, EXG, and NGRDI, followed by fitting the vegetation growth curve with a double logistic function, can be expected to accurately identify the crucial phenological key periods, in accordance with the growth patterns of black oatgrass. The system can provide reliable technological and data support for the intelligent monitoring and management of grassland vegetation.

Issue
Crop root segmentation and phenotypic information extraction based on images of minirhizotron
Transactions of the Chinese Society of Agricultural Engineering 2024, 40(18): 110-119
Published: 30 September 2024
Abstract PDF (4.2 MB) Collect
Downloads:18

The images of crop roots collected by the minirhizotron method have a complex soil background, and roots occupy a relatively small proportion. Common semantic segmentation models used for root extraction may misclassify pixels at the edge of roots as soil when the receptive field is small or multi-scale feature fusion is inadequate. Moreover, the long image acquisition cycle and initial difficulty in collecting a large number of valid samples with the minirhizotron method hindered the rapid deployment of root extraction models. To improve the accuracy of root phenotyping measurements and optimize extraction model deployment strategies, this study devised an in-situ automatic root imaging system to acquire minirhizotron images of crops in real time. A full-scale skip feature fusion mechanism is constructed for the U2-Net model with rich receptive fields for the effective classification of root pixels in minirhizotron images. Integrating data augmentation and fine-tuning method of transfer learning methods to achieve rapid deployment of root extraction models for target species. The full-scale skip feature fusion mechanism involved fusing the output features of the upper encoder and lower decoder of the U2-Net model across all scales, thereby serving as input features for a certain decoder layer and effectively retaining more feature information to enhance the decoder's information restoration capability. In terms of model deployment, this study compared fine tuning method of transfer learning with mixed training to address the issue of model training with limited samples. Experimental materials included self-developed in-situ automatic root imaging systems for collecting garlic sprout root system images and the publicly available minirhizotron dataset PRMI(plant root minirhizotron imagery). The experimental design included performance metric comparisons on the PRMI(plant root minirhizotron imagery)dataset, followed by analysis and validation on garlic sprout data. The control group comprised pre-improvement and post-improvement versions of the U2-Net, U-Net, SegNet, and DeeplabV3+_Resnet50 models. Finally, the predictive effects of fine-tuning and mixed training methods on the garlic sprout test set were compared to identify effective strategies for rapid model deployment. The experimental results demonstrate that on the garlic sprout dataset, the improved U2-Net model achieves average F1 score and IoU (intersection and comparison) of 86.54% and 76.28%, respectively. Compared to the pre-improvement version, U-Net, SegNet, and DeeplabV3+_Resnet50 models, the average F1 increases by 0.66、5.51、8.67 and 2.84 percentage points, respectively, while the average IoU increases by 1.02、8.18、12.52 and 4.31 percentage points, respectively. Practical segmentation shows enhanced recognition capability for root system edges, significantly reducing over-segmentation and under-segmentation phenomena. In the garlic sprout dataset with limited samples, fine-tuning of transfer learning outperformed mixed data and training, with model performance metrics F1 and IoU improving by 2.89 and 4.45 percentage points, respectively. For root length, area, and average diameter, the determination coefficient R2 values between the result of the model's predicted images and manually labeled images reached 0.965, 0.966, and 0.830, respectively. This study offers a reference for enhancing the accuracy of root phenotype measurement in minirhizotron images and the rapid deployment of root extraction models.

Total 2