The energy management of the networked multi-energy microgrids (MEMGs) contributes to promoting the consumption of renewable energy and balancing the different interests of multi-agent MEMG systems. A novel energy management method of MEMG system based on improved multi-agent federated reinforcement learning is proposed. First, this study establishes the optimization model of MEMG system considering multi-party economic benefits in P2P trading market. To solve the problems of gradient instability and low learning efficiency in traditional federated reinforcement learning with FedAvg federation strategy, a novel Federated Attention-based Multi-agent Deep Deterministic policy gradient (FA-MADDPG) framework is proposed for real-time scheduling optimization of MEMG system. In addition, this study proposes an agent exploration mechanism based on directional noise to achieve the SoC balance of distributed energy storage before and after scheduling. Finally, a numerical example is given to verify the effectiveness of the proposed method. Compared with MADDPG and federated MADDPG method, the proposed method has better convergence and energy scheduling ability, and the economic cost is reduced by 13.57% and 10.22% respectively.
- Article type
- Year
Open Access
Special Section Paper
Issue
Open Access
Issue
Aggregating demand side flexibility is essential to complementing the inflexible and variable renewable energy supply in achieving low carbon energy systems. Sources of demand side flexibility, e.g., dispatchable generators, storage, and flexible loads, can be structured in a form of microgrids and collectively provided to utility grids through transactive energy in local energy markets. This paper proposes a framework of local energy markets to manage this transactive energy and facilitate the flexibility provision. The distribution system operator aims to achieve local energy balance by scheduling the operation of multi-microgrids and determining the imbalance prices. Multiple microgrid traders aim to maximize profits for their prosumers through dispatching flexibility sources and participating in localised energy trading. The decision making and interactions between a distribution system operator and multiple microgrid traders are formulated as the Stackelberg game-theoretic problem. Case studies using the IEEE 69-bus distribution system demonstrate the effectiveness of the developed model in terms of facilitating local energy balance and reducing dependency on the utility grids.
京公网安备11010802044758号