Existing methods often struggle to accurately and automatically separate livestock from complex background environments and are further hindered by severe noise interference in point cloud data, which leads to insufficient segmentation accuracy and ultimately affects the precision of livestock body measurements. To address these challenges, this study proposes a livestock body measurement method based on omnidirectional spatial localization segmentation. First, an omnidirectional point cloud segmentation model (Omni-PointMamba) was designed, which adopts an eight-directional scanning strategy in 3D space and an alternating dual-module architecture that integrates Point Mamba Blocks with convolutional modules. By enhancing spatial neighborhood modeling capabilities, the model efficiently fuses region-specific geometric features with comprehensive structural context, thereby achieving precise separation of livestock from background interference. Second, a spatial localization-based measurement method was developed. This method constructs a spatial coordinate system using ground normal vectors to achieve automatic rotation and alignment of the point cloud. It employs a two-step clustering strategy to identify key body parts, including the head and tail, and determines measurement landmarks through geometric point distribution analysis, enabling accurate, non-contact estimation of body size parameters. Experiments conducted on 20 pigs and 103 cattle demonstrate that the proposed model achieves outstanding segmentation performance, with mean Intersection over Union (mIoU) values of 0.9930 for pigs and 0.9685 for cattle. Furthermore, the model yields low mean absolute percentage errors (MAPE) in morphological measurements. For pigs, the MAPE for body width, hip width, and chest girth are 1.34%, 1.99%, and 1.37%, respectively. For cattle, the MAPE for body slant length, chest width, hip height, and heart girth are 2.24%, 3.28%, 2.18%, and 4.22%, respectively. These results indicate that the proposed method provides highly accurate segmentation and morphological measurement capabilities for both pigs and cattle.
- Article type
- Year
- Co-author
Open Access
Issue
Maize (Zea mays L.) is a major crop for global food security at present. Advanced breeding is often required to enhance yield, stress resistance, and adaptability, particularly for high-throughput, non-destructive, and accurate acquisition of plant phenotypic parameters. Three-dimensional (3D) point clouds acquired by LiDAR can provide unprecedented detail of plant architecture, compared with 2D imaging. However, their widespread application has been confined to the accurate instance segmentation of individual plants within dense populations in real-world fields. Furthermore, conventional clustering or geometry algorithms cannot solve the convoluted spatial arrangement, complex plant morphologies, extensive canopy adhesion—where the leaves of adjacent plants are tightly interwoven—and mutual occlusion among plants. The efficient and reliable extraction of phenotypic data has been severely constrained to the fragmented or incorrectly merged plant instances. In this study, an instance segmentation framework, 3D-MaizeNet, was proposed to integrate LiDAR data with deep learning. Individual maize plants were accurately extracted for the high-throughput measurement of key agronomic traits, such as plant height and stem height. Three stages are included. 1) The structural integrity of the individual plant was preserved to avoid the compromise during simplistic preprocessing. An adaptive block segmentation was introduced using crop row detection. The row-planting pattern of farmlands was divided used to divide the large-scale point cloud into plant-centric blocks. This approach was used to effectively minimize the interference from overlapping canopies in adjacent rows. A high-quality, field-derived point cloud dataset was constructed for robust model training. 2) A local spatial encoding module was designed to learn fine-grained geometric features from complex canopy structures (e.g., leaf angles and stem orientations). Concurrently, an attention aggregation down-sampling module was integrated to reduce the loss of key spatial features during feature extraction. Salient information was selectively preserved to distinguish among tightly packed plants. 3) According to the high-fidelity instance segmentation, an pipeline was established for the high-throughput quantification of plant height and stem height—two pivotal phenotypic parameters closely related to yield potential and lodging resistance. Field-scanned data was were collected to validate the efficacy of the framework. Experimental results showed that the 3D-MaizeNet achieved a mean Average Precision (mAP) of 0.959 and an overall accuracy of 0.964 in instance segmentation, indicating the superior performance to identifyin identifying and delineate delineating the individual plant. Furthermore, the key traits were extracted for the strong correlations with manual ground-truth measurements, with coefficients of determination (R2) of 0.91 and 0.89 for plant height and stem height, respectively. The high-throughput and precise phenotyping platform can provide the technical support to advance the maize genomics, Genome-Wide Association Studies (GWAS), and ultimately the molecular breeding for next-generation crops.
京公网安备11010802044758号