AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (6.4 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Regular Paper | Open Access

Real-time Dispatch via Expert Knowledge Driven Deep Reinforcement Learning

Liangcheng Cheng, Jiahao Yan( ), Jianguo Yao, Shengchun Yang, Wenbo Mao, Kedong Zhu
China Electric Power Research Institute, Nanjing 210003, China
Show Author Information

Abstract

Power system real-time dispatch (RTD) problem optimizes generator outputs considering operational constraints and high-dimensional system information such as nodal loads and network topology. Conventional deep reinforcement learning methods aim to find optimal dispatch decisions through random exploration and lead to low computational efficiency. In this paper, we decompose RTD into three subproblems, namely unit commitment, power adjustment and voltage adjustment. A reinforcement agent is constructed using an expert knowledge-based twin delayed deep deterministic policy gradient algorithm (EK-TD3) to give power adjustment decisions, while unit commitment and voltage adjustment decisions are based on capacity-rules and volt-var sensitivity rules, respectively. Regularization terms based on expert knowledge are introduced to guide exploration of the agent, including generation-load mismatch, midpoint-maintaining rule of balance generator, renewable energy consumption rate and reserve capacity availability. Weight of different regularization terms can be adjusted periodically to reflect priority of dispatch objectives. The proposed method is tested on the State Grid 126-bus system (SG-126). Results prove the proposed method has better convergence performance compared with the conventional deep reinforcement learning method, enabling its application in large-scale power systems.

References

【1】
【1】
 
 
CSEE Journal of Power and Energy Systems
Pages 2295-2307

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Cheng L, Yan J, Yao J, et al. Real-time Dispatch via Expert Knowledge Driven Deep Reinforcement Learning. CSEE Journal of Power and Energy Systems, 2026, 12(5): 2295-2307. https://doi.org/10.17775/CSEEJPES.2022.03010

10

Views

0

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Received: 07 May 2022
Revised: 09 August 2022
Accepted: 19 September 2022
Published: 27 June 2023
© 2022 CSEE.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).