Pruning is one of the most critical steps in the cultivation of fruit trees. Current pruning robots have realized to recognize the side branch, and then locate the pruning points in recent years. However, it is still lacking in the effective end-effector pose estimation in intelligent selective pruning. This study aims to propose the pruning point localization and end-effector pose estimation using RGB-D images. The research object was also selected as the dormant high spindle-shaped apple trees. A depth camera (Intel RealSense D435i) was utilized to capture the RGB and depth data. A point-to-plane mapping was introduced to derive the 3D orientation and position of the pruning pose from the detected pixel coordinates and depth information. The spatial location was predicted for the cutting plane’s orientation relative to the pruning point — a key requirement for autonomous robotic pruning. In the perception pipeline, an improved version of the YOLOv8-seg model was employed to segment the trunk and primary branch regions from the RGB images. Furthermore, it was often lacking on the clear boundary features of the branch base masks, due to the unconventional annotation. The original YOLOv8-seg model failed to accurately locate and then segment these regions. A Global Attention Mechanism (GAM) module was introduced into the neck network of YOLOv8-seg. Each C2f block was then integrated across all feature levels. The feature maps were also recalibrated using channel-wise multiplication, in order to enhance the salient features while suppressing the irrelevant ones. The multi-scale information and reasoning were significantly enhanced for the high accuracy of the segmentation. The improved YOLOv8-seg model was achieved in a mask-level precision of 95.31%, recall of 93.79%, and an mAP_0.5 of 93.86%, thus outperforming the original YOLOv8-seg by 0.79 percentage points in precision, 2.63 percentage points in recall, and 1.47 percentage points in mAP_0.5. Once the trunk and primary branches were segmented, the OpenCV-based image processing was applied to calculate the diameters and spacing of the branches. The potential pruning points were identified to fit the rectangles around the base regions of the side branches, according to the empirical pruning. Field trials were carried out to validate the effectiveness of this approach. A better performance was achieved, with a decision accuracy of 88.3% and an average processing speed of 2.1 seconds per image. Extensive testing showed that the point-to-plane mapping of the pose estimation was achieved with a success rate of 89.9%, with an average computation time of 3.3 s per image. In conclusion, a framework was presented for the intelligent selective pruning of the apple trees using RGB-D input, in order to realize the accurate pruning point localization and end-effector pose estimation. Advanced deep learning models were also integrated with the image processing. The pruning pose can be expected to align with the specific angles for the tree's health. The point-to-plane mapping can be expected to determine the spatial location of the pruning points. The optimal orientation of the cutting plane can also be calculated to fully meet the horticultural requirements of the pruning actions. Specifically, the normal vector of the cutting plane was derived, according to the detected pruning points and surrounding branch structures. The manipulator's reachability and safety distances can be considered to generate feasible pruning poses for practical execution. The pruning end-effector pose estimation can also provide strong support for developing robotic pruning.

In order to reduce the labor intensity and improve the efficiency of pruning, this study designed a multi-section luffing apple pruning equipment suitable for apple orchards in hilly and mountainous areas of China. In the essay, the structure and working principle of the equipment are expounded, the cutter was analyzed, and the parameters were determined. Using the self-made test bench to simulate the field experiment, this study selected the ratio of cutting speed to feeding speed and feeding speed as the influencing factors and took the cut-off rate, cutting efficiency and cutting power as the objectives to carry out single factor experiment and quadratic regression orthogonal experiment. The test results show that the cutting power increases with the increase of ratio of cutting speed to feeding speed, and the cut-off rate and cutting efficiency first increase and then decrease. As the feeding speed increases, the cutting efficiency and power increase, and the cut-off rate decreases. When the cut-off rate was greater than 80%, the optimal combination of operating parameters was the feeding speed of 0.55 m/s and ratio of cutting speed to feeding speed of 1.29. Under this combination, the cut-off rate was 84.9%, the cutting efficiency was 13.1, and the cutting power was 175.7 W. The error between the predicted target value of the model and the average measured target value was less than 7%, so the test results are reliable. According to the obtained optimal operating parameters, the actual cutting experiment of the pruning equipment in the field was carried out, and the cutting rate was 96.3%, which meet the design requirements. This study can also meet the needs of mechanized pruning of fruit trees with different crown shapes, improve the applicability of pruning equipment, and provide support for the development of mechanized pruning equipment in China.