AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (3.6 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Special Section Paper | Open Access

Optimal Energy Management of Networked Multi-energy Microgrids Based on Improved Multi-agent Federated Reinforcement Learning

Xiaowei Pu, Hao Xiao ( ), Wei Pei, Yanhong Yang, Li Ma, Tengfei Ma, Shuai Zhang
Institute of Electrical Engineering, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing 100190, China
Show Author Information

Abstract

The energy management of the networked multi-energy microgrids (MEMGs) contributes to promoting the consumption of renewable energy and balancing the different interests of multi-agent MEMG systems. A novel energy management method of MEMG system based on improved multi-agent federated reinforcement learning is proposed. First, this study establishes the optimization model of MEMG system considering multi-party economic benefits in P2P trading market. To solve the problems of gradient instability and low learning efficiency in traditional federated reinforcement learning with FedAvg federation strategy, a novel Federated Attention-based Multi-agent Deep Deterministic policy gradient (FA-MADDPG) framework is proposed for real-time scheduling optimization of MEMG system. In addition, this study proposes an agent exploration mechanism based on directional noise to achieve the SoC balance of distributed energy storage before and after scheduling. Finally, a numerical example is given to verify the effectiveness of the proposed method. Compared with MADDPG and federated MADDPG method, the proposed method has better convergence and energy scheduling ability, and the economic cost is reduced by 13.57% and 10.22% respectively.

References

【1】
【1】
 
 
CSEE Journal of Power and Energy Systems
Pages 2209-2220

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Pu X, Xiao H, Pei W, et al. Optimal Energy Management of Networked Multi-energy Microgrids Based on Improved Multi-agent Federated Reinforcement Learning. CSEE Journal of Power and Energy Systems, 2026, 12(5): 2209-2220. https://doi.org/10.17775/CSEEJPES.2023.05920

12

Views

0

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Received: 14 July 2023
Revised: 18 September 2023
Accepted: 23 October 2023
Published: 24 July 2024
© 2023 CSEE.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).