Sort:
Open Access Review Article Issue
A survey of safety control for service robots
Journal of Automation and Intelligence 2026, 5(2): 112-125
Published: 17 October 2025
Abstract PDF (2.6 MB) Collect
Downloads:0

Safety constitutes the fundamental bottleneck in human–robot integration, particularly for service robots operating in unstructured environments. This survey systematically reviews the research progress in the field of robot safety control, focusing on injury prevention and resolution mechanisms in physical human–robot interaction scenarios. Firstly, by deconstructing the safety boundaries of robot behavior, the concept of robot safety domain was established, and safety control objectives for three distinct operational states are briefly summarized. For each hierarchical objective, the article deeply analyzes corresponding key control strategies and their efficacy. This survey not only summarizes the existing methods, but also highlights the challenges in the future, providing guidance for subsequent research in service robot safety and laying a foundation for advancing trustworthy human–robot coexistence amid escalating autonomy demands.

Open Access Research paper Issue
Sampled-data control through model-free reinforcement learning with effective experience replay
Journal of Automation and Intelligence 2023, 2(1): 20-30
Published: 01 February 2023
Abstract PDF (1.5 MB) Collect
Downloads:2

Reinforcement Learning (RL) based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it. Guided by the rewards generated by environment, a RL agent can learn the control strategy directly in a model-free way instead of investigating the dynamic model of the environment. In the paper, we propose the sampled-data RL control strategy to reduce the computational demand. In the sampled-data control strategy, the whole control system is of a hybrid structure, in which the plant is of continuous structure while the controller (RL agent) adopts a discrete structure. Given that the continuous states of the plant will be the input of the agent, the state–action value function is approximated by the fully connected feed-forward neural networks (FCFFNN). Instead of learning the controller at every step during the interaction with the environment, the learning and acting stages are decoupled to learn the control strategy more effectively through experience replay. In the acting stage, the most effective experience obtained during the interaction with the environment will be stored and during the learning stage, the stored experience will be replayed to customized times, which helps enhance the experience replay process.

The effectiveness of proposed approach will be verified by simulation examples.

Total 2