Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
The energy management of the networked multi-energy microgrids (MEMGs) contributes to promoting the consumption of renewable energy and balancing the different interests of multi-agent MEMG systems. A novel energy management method of MEMG system based on improved multi-agent federated reinforcement learning is proposed. First, this study establishes the optimization model of MEMG system considering multi-party economic benefits in P2P trading market. To solve the problems of gradient instability and low learning efficiency in traditional federated reinforcement learning with FedAvg federation strategy, a novel Federated Attention-based Multi-agent Deep Deterministic policy gradient (FA-MADDPG) framework is proposed for real-time scheduling optimization of MEMG system. In addition, this study proposes an agent exploration mechanism based on directional noise to achieve the SoC balance of distributed energy storage before and after scheduling. Finally, a numerical example is given to verify the effectiveness of the proposed method. Compared with MADDPG and federated MADDPG method, the proposed method has better convergence and energy scheduling ability, and the economic cost is reduced by 13.57% and 10.22% respectively.
This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Comments on this article