AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline

Cart-Pole System: Practical Deployment of Model-Based Control Versus Reinforcement Learning

Qihua Chen*,† , Mingxiang Liu*,† ( ), Minyue Fu‡ 
School of Automation and Intelligent Manufacturing, Southern University of Science and Technology, Shenzhen, P. R. China
Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, Shenzhen, P. R. China
School of Automation, Guangdong University of Technology, Guangzhou, P. R. China

This paper was recommended for publication in its revised form by Special Issues Editors, Jie Chen, Ben M Chen and Zongli Lin.

Show Author Information

Abstract

This paper compares the classical model-based approach and reinforcement learning (RL) approach for nonlinear systems with known structures but unknown parameters, which represents a wide class of engineered control systems. The study is based on a benchmark cart-pole system involving both swing-up and balance control. Although the model-based approach for the cart-pole system has been studied extensively in the literature, we propose a new pseudo-energy function with a logarithmic barrier function (LBF) for smoother swing-up action. A simple feedforward compensation is used to reduce the cart friction. The subsequent balance control employs a linear quadratic regulator. The model-based approach is complemented with a real-time parameter identification scheme. For the RL approach, we adopt the deep deterministic policy gradient (DDPG) algorithm in conjunction with several simulation techniques to mitigate the simulation-to-reality (sim-to-real) gap. Experimental results on the Googoltech platform demonstrate that both design approaches are effective. The model-based approach does not require training and has higher computational efficiency, but it requires substantial system modeling and controller design knowledge. In contrast, the RL approach has higher flexibility and adaptability, but requires massive training. The results reflect the trade-offs and complementarity of the two methods in practical control tasks.

References

【1】
【1】
 
 
Unmanned Systems
Pages 573-587

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Chen Q, Liu M, Fu M. Cart-Pole System: Practical Deployment of Model-Based Control Versus Reinforcement Learning. Unmanned Systems, 2026, 14(3): 573-587. https://doi.org/10.1142/S2301385026410074

7

Views

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Received: 15 October 2025
Accepted: 06 January 2026
Published: 06 February 2026
© World Scientific Publishing Company