Fruits are continuously subjected to the multiple mechanical loads, such as the vibration, collision, and impact during harvesting, sorting, and transportation. The coupling scenario can often lead to the fruit quality deterioration and post-harvest losses. However, the existing electronic fruit devices have been mostly designed for the single-load scenarios, such as the dropping, extrusion, and collision. The sensors and data acquisition cannot accurately capture the dynamically mechanical response of the single and clustered fruits under vibration-impact coupling scenarios. It is required to explore the evolution mechanism of the post-harvest mechanical damage to the fruits. In this study, a vibration-collision coupling electronic fruit (VCCEF) device was developed to simultaneously acquire the dynamic response of the fruit vibration acceleration and collision force. The fresh grapes were taken as the experimental object. The device was composed of a three-dimensional vibration, a three-dimensional collision measurement, and a vibration-impact data synchronous acquisition. A triaxial acceleration sensor was integrated inside a spherical shell with the piezoelectric ceramics. The synchronous and high-precision data acquisition was then achieved in the collision impact force, vibration acceleration, and coupled dynamic responses. Meanwhile, a double pedicel-fruit composite was constructed for the data acquirement. Synchronous acquisition, analysis, and verification were realized for the multi-fruit vibration-impact data. Finally, a series of tests were also carried out to explore the vibration-impact coupling evolution of the multi-fruit-pedicel systems. Three-dimensional vibration measurement was calibrated after exploration. Test results showed that the relative error of the triaxial acceleration was ranged from 4.24% to 7.27%, fully meeting the test requirements within an acceptable range. The coefficient of determination (R2) of the collision force-induction voltage fitting curve reached 0.995 7, indicating an excellent fitting. The vibration-impact coupling tests were also conducted on the double fruit under different deflection angles (30°/45°/60°/75°). The vibration-impact patterns of the fruit particles were similar among the four groups of the deflection angles. At the moment when the vibration-impact occurred, the peaks were instantaneously obtained in the collision force of the piezoelectric ceramic shell and the acceleration of the internal triaxial acceleration sensor, with a time deviation of 71 ms between the two peak moments, indicating the excellent synchrony. The collision force peak of the double pedicel-fruit device increased from 1.19 to 2.59 N, with a total increase of 117.65%. Furthermore, there was a non-linear increase in the collision force peak, as the deflection angle increased. The output signal of the piezoelectric ceramic was positively correlated with the force rate, according to the direct "mechanical-electrical energy" conversion. Its response to sudden changes in the instantaneous force then reached the microsecond level. The response of the triaxial acceleration to the collision exhibited the significant directionality, indicating the differential variations in the deflection angle. Among them, the peak value (absolute value) of the Y-axis acceleration increased by 210% in total from 30° to 75°, which was always the largest component among the three axes. There was the strongest correlation with the collision force peak. The electronic fruit was used to accurately capture the variations in the collision force under different deflection angles, fully meeting the measurement requirements of the fruit micro-collisions; Subtle differences were identified from the acceleration under various deflection angles, in order to characterize the "instantaneous loading" feature of the collisions. In conclusion, the VCCEF can be expected to accurately monitor the vibration-impact dynamic information among fruits. The finding can provide the equipment and methodological support for the time-domain response and dynamic transmission of the fruit unsteady collisions, in order to optimize the mechanical parameters of the fruit harvesting and transportation.
- Article type
- Year
- Co-author
A multimodal big data acquisition and management system is often required to reduce the reliance on manual inspection and visual annotation. This study aimed to design, implement and field-validate a cloud–edge–end coordinated system for the honeybee colonies. Non-intrusive, fully automatic, and long-term monitoring was realized on the colony behavior and environmental conditions with the reliable temporal alignment. The system consisted of an intelligent hive terminal and a cloud-based pre-annotation module. The hive terminal was integrated with a rail-mounted dual-box structure with automatic comb-shifting imaging, in order to sequentially capture the dense comb surfaces. A hive-entrance video was captured on the channel to constrain the flight trajectories, as well as the multi-point internal and external environmental sensing, including the temperature, humidity, carbon dioxide, total volatile organic compounds, particulate matter, and internal acoustic signals. A layered cloud–edge–end architecture was adopted to decouple the high-frequency video streams from the low-frequency sensor data, providing unified clock synchronization, local buffering, and stable data transmission under field network conditions. On the cloud side, a multimodal data processing was constructed to perform the timestamp alignment, automatic visual pre-annotation, and structured storage. The object detection and instance segmentation were combined with the time-series databases and relational metadata management, thereby enabling unified spatiotemporal indexing, cross-modal association, and efficient retrieval of the heterogeneous data types. A continuous 30-day field deployment was conducted at a commercial apiary in Jiangning District, Nanjing City, China. A systematic evaluation was carried out on the system stability, data accuracy, and annotation efficiency under unattended operating conditions. Stable operation was maintained after the deployment without manual intervention. The overall loss rate of the data packet remained below 6%, indicating the reliable long-term transmission of both video streams and environmental sensor data. The web interface supported five concurrent users for data browsing and downloading without observable blocking or performance degradation. Environmental measurements were recorded by the system, indicating the high consistency with the reference instruments. In external hive temperature, the mean absolute error was 0.3 °C, the root mean square error was 0.4 °C, and the Pearson correlation coefficient reached 0.995. The largest deviation of the measurement occurred in the concentration of the internal carbon dioxide, with a mean absolute error of 48 μmol/mol, a root mean square error of 62 μmol/mol, and a Pearson correlation coefficient of 0.937. Other environmental variables, including the internal temperature, humidity, and gas-related parameters, generally showed correlation coefficients above 0.98, fully meeting the accuracy requirements for the long-term apicultural monitoring and behavioral analysis. The cloud-based visual pre-annotation module was achieved in an average per-frame processing time of approximately 10 ms, covering the data loading, preprocessing, model inference, and data storage. In hive-entrance videos, the detection of the individual bees was achieved with an accuracy of 98%, thus enabling efficient extraction of the foraging activity information. In dense comb images, the instance segmentation was achieved with an average accuracy of 76% under frequent occlusion and adhesion, indicating the increasing difficulty in delineating the overlapping individuals on the crowded comb surfaces. Compared with manual labeling, the pipeline substantially improved the annotation efficiency, with sufficient accuracy for the population-level behavioral studies. Edge buffering and video compression were further compatible with the typical bandwidth of the field network, while preserving the analytical integrity of the frames and key feature segments. The system was realized for the continuous, non-intrusive acquisition, automatic pre-annotation and structured management of the multimodal honeybee colony data within a unified cloud–edge–end framework. Mechanical design, environmental sensing, and data-driven annotation were integrated to form a standardized data infrastructure in order to support the quantitative behavioral modeling and pollination efficiency assessment in intelligent apiculture. Future work can improve the instance segmentation in the densely populated comb scenes. The robustness and generalization can be enhanced to extend the long-term validation over multiple apiaries and ecological conditions.
京公网安备11010802044758号