Grassland degradation has posed a serious threat to ecological stability, forage yield, and the sustainable animal husbandry in recent years. Agricultural robots (such as unmanned aerial vehicle (UAV) platforms) can be expected to monitor and reseed the degraded grassland patches for ecological restoration. However, existing UAV operations have been limited to the low accuracy of patch identification and patch positioning, due to easy target loss or unstable tracking. In this study, a computer vision was proposed to integrate the advanced object detection and tracking algorithms for the efficient detection and positioning of grassland patches. The YOLO series model was used to detect the patch. An adaptive feature pyramid network was introduced to enhance multi-scale feature fusion, thereby improving detection accuracy in complex grassland backgrounds. Lightweight convolution was used for channel compression and nonlinear activation, while the expression of deep features was optimized for the computational efficiency. The Swin Transformer sliding window self-attention mechanism and residual convolution structure were adopted to establish long-range dependencies between patches and the grassland background within the local receptive field. Input RGB patch images were converted to the YUV color space. The single-channel luminance map was extracted as the input to enhance the luminance contrast of the grassland and patch texture structures. In terms of temporal consistency and target tracking, the DeepOCSORT algorithm was combined to perform multi-target tracking of patches in consecutive image sequences. The results showed that the improved SCTD-YOLO detector significantly outperformed the baseline YOLOv8. Ablation experiments indicated that the better performance was achieved to combine the different modules. The accuracy and recall rate increased to 94.7%, and 86.2%, respectively, using the improved SCTD-YOLO model, indicating the best performance; The average precision and mAP increased by 2.4 percentage points and 2.2 percentage points, respectively. The high robustness was also obtained to significantly reduce the missed detection and false rates under different lighting conditions, complex backgrounds of grassland texture, partial patch occlusion by plants, and significant changes in patch size. In multi-target tracking, the algorithm with the DeepOCSORT tracker was effectively maintained the consistency of patches in multi-frame sequences, with an IDF1 of 85.15%, an MOTA of 88.2%, and an MOTP of 86.71%, significantly reducing false detections and ID switches. DeepOCSORT model was still stably maintained the target trajectories in the scenarios of rapid camera panning, grass leaf shaking caused by wind, and dynamic background, significantly improving the reliability of long-term monitoring. Finally, the latitude and longitude coordinates were predicted after image modeling and external parameter calculation, compared with high-precision RTK-GPS measurement coordinates. The spatial positioning error was calculated using the Vincenty formula. The improved SCTD-YOLO and stable tracking algorithm were combined to significantly reduce the overall positioning error, with an average error of 0.316 1 m and an error range of 0.278 m to 0.423 m. The higher positioning accuracy and error stability were found in all test samples, effectively improving the overall consistency of target detection, tracking, and positioning. The overall positioning accuracy was fully met the requirement of less than 0.5m in intelligent reseeding of degraded grassland patches. The SCTD-YOLO and DeepOCSORT framework were integrated for patch detection, tracking, and positioning in complex multi-scenario and multi-interference environments for agricultural robots. The high efficiency and reliability of grassland patch reseeding can be expected for the decision-making generalization of agricultural robot vision in different agronomic models and environmental conditions, sustainable grassland, resource conservation, and ecological restoration. Further exploration can be conducted on seasonal monitoring and adaptive reseeding using multi-source remote sensing data.
- Article type
- Year
- Co-author
Multi-unmanned aerial vehicle (UAV) cooperative operations in mountainous orchards face four critical challenges: prohibitively high computational complexity due to large-scale 3D path planning, slow algorithmic convergence in rugged terrain, geometrically unstable flight path generation, and uneven energy consumption leading to premature battery depletion among heterogeneous drone fleets. To address these interconnected issues, this study proposes an integrated computational framework synergistically combining an Improved Artificial Hummingbird Algorithm (IAHA) with a recursive energy-balancing model. Empirical validation was conducted in a lychee orchard (23°9' N, 113°22' E), where centimeter-resolution digital elevation models (DEMs) were constructed via UAV photogrammetry at a spatial resolution of 5.41 cm/pixel. These DEMs enabled precise georeferencing of 57 mission-critical waypoints, comprising one depot at 25 m elevation and 56 operational points dynamically maintained at 10 m above heterogeneous tree canopies to accommodate variable crown heights. The core innovation lies in the IAHA, which significantly enhances the foundational artificial hummingbird algorithm through three algorithmic advancements: (1) Hybrid population initialization strategically injects one high-quality solution generated via nearest-neighbor greedy heuristic into a Monte Carlo-sampled population at a 1:99 ratio, simultaneously seeding solution quality while preserving population diversity. (2) Adaptive parameter control employs cosine annealing for dynamic step size modulation across iterations and exponential decay for directional perturbation coefficients, enabling nuanced exploration-exploitation tradeoffs. (3) Periodic local optimization automatically triggers a 2-opt refinement every 10 generations to eliminate topological path crossings, ensuring physically flyable trajectories. To counteract search stagnation, a visit-table-driven guidance system implements inverse probability selection to prioritize visitation of underexplored spatial regions, complemented by a tournament-based migration strategy that replaces 10% of the poorest-performing individuals per generation to maintain evolutionary pressure. For multi-UAV energy equilibrium, physics-based rotor power consumption models were extended through hierarchical recursive segmentation with bidirectional boundary adjustment. This technique recursively partitions waypoint clusters while co-optimizing segment boundaries to balance cumulative energy demands, subsequently employing weight-aware path aggregation that explicitly accounts for UAV payload differentials (e.g., spraying modules vs. sensors). The model enforces a strict upper bound of 5% total energy variance across the fleet—critical for operations in mountainous terrain where elevation changes exponentially impact power draw. Validation experiments demonstrated IAHA's superiority in single-UAV path optimization. Compared to five benchmark algorithms (AHA, ACO, GA, SA, PSO), IAHA achieved path length reductions of 25.7%, 2.0%, 20.6%, 12.74%, and 19.19%, respectively, in real-world orchard flights. Significantly, it maintained a path length standard deviation ratio of merely 1.24%, highlighting exceptional solution stability across trials. In multi-UAV deployment scenarios using a heterogeneous fleet (2×DJI Mavic 3 + 1×DJI Phantom 4 varying in thrust-to-weight ratios), the integrated IAHA-energy framework achieved an unprecedented energy consumption Coefficient of Variation (CV) of 1.16%. Concurrently, task completion time decreased by 56.52% compared to sequential single-UAV operations. The framework's efficacy stems from synergistic algorithmic innovations: dynamic parameter adaptation prevents premature convergence while maintaining exploration capability; visit-table guidance sustains population diversity; and recursive energy segmentation enables near-equitable workload distribution—the latter proving particularly critical for operations in mountainous topography where altitude variances induce nonlinear power demands. Statistical analysis confirms these components interact multiplicatively rather than additively. Theoretical contributions include establishing convergence guarantees for the modified hummingbird dynamics and proving recursive segmentation's computational tractability under constrained energy variance bounds. This study validated the feasibility of the algorithm framework through simulation. In future field flight tests, we will focus on verifying the engineering applicability of path planning and energy consumption optimization, including: three-dimensional trajectory tracking accuracy in complex mountainous environments, consistency between actual battery consumption and model predictions, and balance in flight duration among heterogeneous fleets.
Agricultural low altitude agricultural technology, with unmanned aerial vehicles (UAVs) as its primary platform, integrates 5G communication, artificial intelligence, and the Internet of Things to support data acquisition, analysis, and decision making throughout agricultural production. These advances are driving a transition from traditional experience based management toward a model in which data serve as the primary basis for decisions. As low altitude technology continues to advance in communication capacity, payload performance, and onboard processing, agricultural operations are undergoing profound changes. UAVs once used mainly for crop protection spraying have gradually evolved into multifunctional platforms capable of data collection, crop growth monitoring, image interpretation, precise input application, and operational assistance. Supported by a three dimensional integrated framework, which includes vertical integration, horizontal expansion, and spatio-temporal coordination, low altitude systems are reshaping field management structures, operational modes, and decision making processes. This transformation is accelerating the digitalization, networking, and intelligent upgrading of agriculture. The aim is to provide theoretical guidance and technical pathways for the broader application of low altitude technology in agriculture and to support the exploration of sustainable development models and industrial layouts for the low altitude agricultural economy.
The core contribution of low altitude technology to smart agriculture lies in establishing a complete sensing, decision, execution, and feedback cycle and implementing a four level structure comprising infrastructure, core technologies, application support, and scenario deployment. The infrastructure layer relies on 4G/5G networks, RTK high precision positioning, and ground based sensor systems. Multi source data are acquired through UAV mounted multi-spectral and thermal sensors working in coordination with ground monitoring devices to capture information on crop conditions and field environments. The core technology layer utilizes edge computing, cloud platforms, and analytical models to support growth assessment, pest and disease warnings, and other forms of analysis. At the application layer, UAVs operate in collaboration with ground equipment to implement precise crop protection, seeding, and irrigation, while also extending to field monitoring and agricultural logistics. This paper focuses on agricultural low altitude agricultural technology, summarizes its mechanisms and systematically reviews the associated technical system from the perspectives of operational equipment, low altitude remote sensing and recognition, data processing and analysis, and precision operation and supervision. It further examines key functions enabling agricultural intelli-gence. Drawing on recent research and representative cases, the paper discusses practical applications in depth. In smart orchards, for example, the South China Agricultural University Smart Patrol system combined with the Lichi Jun model can deliver early pest and disease warnings two to three weeks before outbreak and support yield estimation. In ecological unmanned farms, integrated sky, air, and ground monitoring enables autonomous operation across plowing, planting, management, and harvesting. In production operations, agricultural UAVs have accumulated over 7.5 billion mu (500 million hectare) times of service area globally, covering nearly one third of China's cultivated land area, saving approximately 210 million tons of water, and reducing carbon emissions by approximately 25.72 million tons. In logistics scenarios, transport assisted by UAVs in mountainous orchards improves efficiency more than tenfold while keeping damage rates below three percent.
Sensors remain fundamental tools for capturing agricultural information and reflecting crop growth conditions. Developing highly generalizable technical modules helps lower application barriers and improve operational efficiency, while fusing multi scale data partially compensates for the limitations of single source information. Despite rapid progress, the low altitude agricultural economy still faces challenges including technological maturity, application cost, standardization, industrial integration, and workforce development. Based on an analysis of these challenges, this paper proposes building a three dimensional integrated technology framework featuring vertical integration, horizontal expansion, and spatio-temporal coordination; promoting the improvement and unification of technical standards; constructing an integrated industry ecosystem spanning research, manufacturing, application, and service; and strengthening policy support, industry norms, and talent training systems. These measures are expected to accelerate the emergence of new drivers of growth in the low altitude agricultural economy.
Abstract: Grassland restoration has been a critical initiative of ecological engineering in China. Drones have effectively facilitated the reseeding in large-scale and diversified terrains at present. However, the accuracy of gap localization has been confined to the high workload during drone operations. This study aims to propose a novel approach for gap localization of degraded grassland, termed YOLOFG (YOLO for Gap), using super-resolution reconstruction and Transformer technology. Firstly, the challenges were addressed on the limited quantity and widespread distribution of gap samples in grassland scenes, in terms of sample acquisition. Drones were also employed to combine the fieldwork and simulation. A total of 132 and 282 aerial images were collected to constitute a mixed gap dataset. Secondly, three data augmentations were selected: random angular rotation, exposure adjustment, and brightness modulation, in order to enrich the mixed gap datasets. The objective of these techniques was to enhance the generalization of the model. Furthermore, 1 242 enhanced gap images were annotated to utilize the open-source labeling tool LabelImg. The annotated data was stored, according to the format specifications of the Pascal VOC dataset. Subsequently, the blurred texture was targeted in the unmanned aerial vehicle (UAV) aerial photography dataset. The modifications were made to the YOLOv5s model, thereby completing the training of the data. Finally, the spot anchor frame information was utilized to obtain from the recognition model. The imaging principles of the gimbal camera were used to obtain the conversion relationships among multiple coordinate systems. The real-time attitude information was selected from the UAV. A geodetic coordinate resolution model was established for the aerial photography targets, thus enabling precise localization of the target gaps. According to the theoretical framework of YOLOv5s target detection, a cascaded module was introduced to extract the feature texture in the neck network. The high-resolution feature maps were generated with enhanced textures, thereby enabling the model to focus on intricate feature textures. There was a great decrease in the significant scale variations and blurred textures in the drone-captured gap images. Furthermore, ShuffleNetV2 was selected as the backbone network for YOLOv5s. The number of model parameters was reduced to integrate a highly interactive Transformer self-attention structure into the backbone network. More comprehensive mid-to-high-level visual semantic information was obtained from the drone imagery. The information interaction was also enhanced among pixel blocks. More differentiated features were ultimately extracted among pixels to enhance the capture precision for the gap edge pixels. The experimental results demonstrated that the YOLOFG model achieved a mean Average Precision (mAP) of 96.57%, indicating an improvement of 11.86, 9.65, and 6.82 percentage points, respectively, compared with the YOLOv4, YOLOv7, and YOLOv8 models. The parameter count was approximately 6.24 M, with a model size of 13.9 MB. Compared with the YOLOv5s, the model size remained comparable, yet the precision was enhanced by 3.84 percentage points, and the parameter count was reduced by approximately 11.2%, thus facilitating the deployment. With an inference time of 39.6 FPS(frames per second), the improved model outperformed the baseline networks, including YOLOv5s, YOLOv8, and YOLOv4, thus demonstrating the high efficiency and robustness. Finally, 54 target points were measured with an average positioning error of 0.440 4 m between the center points of the targets and the anchor boxes. In summary, the finding can offer a better trade-off between speed and accuracy, in order to realize the rapid and efficient identification of gap distributions across different communities. Additionally, the precise localization requirements were fully met for the drone-based reseeding in grassland gaps. Thus, robust technical support was provided for the subsequent vegetation restoration and reconstruction in degraded grasslands.
Quantitative inversion is a major topic in remote sensing science. The development of visible light-based hyperspectral reconstruction techniques has opened novel prospects for low-cost, high-precision remote sensing inversion in agriculture. The aim of this study was to assess the effectiveness of hyperspectral reconstruction technology in agricultural remote sensing applications. Hyperspectral images were reconstructed using the MST++ hyperspectral reconstruction model and compared with the original visible light images in terms of their correlations with physiological parameters, the accuracy of single-feature modeling, and the accuracy of combined feature modeling. The results showed that compared to the visible light image, the reconstructed data exhibited a stronger correlation with the measured physiological parameters, and the accuracy was improved for both the single feature and combined feature inversion modes. However, compared to multispectral sensors, hyperspectral reconstruction provided limited improvement of the inversion model accuracy. The results suggest that for physiological parameters that are not easy to observe directly, deep mining of features in visible light data through hyperspectral reconstruction technology can improve the accuracy of the inversion model. However, appropriate feature selection and simple models are more suitable for the remote sensing inversion task of traditional agronomic plot experiments. To strengthen the application of hyperspectral reconstruction technology in agricultural remote sensing, further development is necessary with broader wavelength ranges and more diverse agricultural scenarios.
Open Access
Research Article
Issue
The utilization of 3-dimensional point cloud technology for non-invasive measurement of plant phenotypic parameters can furnish important data for plant breeding, agricultural production, and diverse research applications. Nevertheless, the utilization of depth sensors and other tools for capturing plant point clouds often results in missing and incomplete data due to the limitations of 2.5D imaging features and leaf occlusion. This drawback obstructed the accurate extraction of phenotypic parameters. Hence, this study presented a solution for incomplete flowering Chinese Cabbage point clouds using Point Fractal Network-based techniques. The study performed experiments on flowering Chinese Cabbage by constructing a point cloud dataset of their leaves and training the network. The findings demonstrated that our network is stable and robust, as it can effectively complete diverse leaf point cloud morphologies, missing ratios, and multi-missing scenarios. A novel framework is presented for 3D plant reconstruction using a single-view RGB-D (Red, Green, Blue and Depth) image. This method leveraged deep learning to complete localized incomplete leaf point clouds acquired by RGB-D cameras under occlusion conditions. Additionally, the extracted leaf area parameters, based on triangular mesh, were compared with the measured values. The outcomes revealed that prior to the point cloud completion, the R2 value of the flowering Chinese Cabbage’s estimated leaf area (in comparison to the standard reference value) was 0.9162. The root mean square error (RMSE) was 15.88 cm2, and the average relative error was 22.11%. However, post-completion, the estimated value of leaf area witnessed a significant improvement, with an R2 of 0.9637, an RMSE of 6.79 cm2, and average relative error of 8.82%. The accuracy of estimating the phenotypic parameters has been enhanced significantly, enabling efficient retrieval of such parameters. This development offers a fresh perspective for non-destructive identification of plant phenotypes.
京公网安备11010802044758号