AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Full Length Article | Open Access

A policy iteration method for improving robot assembly trajectory efficiency

Qi ZHANG, Zongwu XIE( ), Baoshi CAO, Yang LIU
State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China

Peer review under responsibility of Editorial Committee of CJA.

Show Author Information

Abstract

Bolt assembly by robots is a vital and difficult task for replacing astronauts in extra-vehicular activities (EVA), but the trajectory efficiency still needs to be improved during the wrench insertion into hex hole of bolt. In this paper, a policy iteration method based on reinforcement learning (RL) is proposed, by which the problem of trajectory efficiency improvement is constructed as an issue of RL-based objective optimization. Firstly, the projection relation between raw data and state-action space is established, and then a policy iteration initialization method is designed based on the projection to provide the initialization policy for iteration. Policy iteration based on the protective policy is applied to continuously evaluating and optimizing the action-value function of all state-action pairs till the convergence is obtained. To verify the feasibility and effectiveness of the proposed method, a noncontact demonstration experiment with human supervision is performed. Experimental results show that the initialization policy and the generated policy can be obtained by the policy iteration method in a limited number of demonstrations. A comparison between the experiments with two different assembly tolerances shows that the convergent generated policy possesses higher trajectory efficiency than the conservative one. In addition, this method can ensure safety during the training process and improve utilization efficiency of demonstration data.

References

【1】
【1】
 
 
Chinese Journal of Aeronautics
Pages 436-448

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
ZHANG Q, XIE Z, CAO B, et al. A policy iteration method for improving robot assembly trajectory efficiency. Chinese Journal of Aeronautics, 2023, 36(3): 436-448. https://doi.org/10.1016/j.cja.2022.07.014

805

Views

4

Crossref

4

Web of Science

4

Scopus

3

CSCD

Received: 02 January 2022
Revised: 13 February 2022
Accepted: 09 May 2022
Published: 22 July 2022
© 2022 Chinese Society of Aeronautics and Astronautics.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).