Journal Home > Volume 9 , Issue 2

Microgrids (MGs) are playing a fundamental role in the transition of energy systems towards a low carbon future due to the advantages of a highly efficient network architecture for flexible integration of various DC/AC loads, distributed renewable energy sources, and energy storage systems, as well as a more resilient and economical on/off-grid control, operation, and energy management. However, MGs, as newcomers to the utility grid, are also facing challenges due to economic deregulation of energy systems, restructuring of generation, and market-based operation. This paper comprehensively summarizes the published research works in the areas of MGs and related energy management modelling and solution techniques. First, MGs and energy storage systems are classified into multiple branches and typical combinations as the backbone of MG energy management. Second, energy management models under exogenous and endogenous uncertainties are summarized and extended to transactive energy management. Mathematical programming, adaptive dynamic programming, and deep reinforcement learning-based solution methods are investigated accordingly, together with their implementation schemes. Finally, problems for future energy management systems with dynamics-captured critical component models, stability constraints, resilience awareness, market operation, and emerging computational techniques are discussed.


menu
Abstract
Full text
Outline
About this article

Microgrid Energy Management with Energy Storage Systems: A Review

Show Author's information Xiong Liu1Tianyang Zhao1( )Hui Deng1Peng Wang2Jizhen Liu3Frede Blaabjerg4
Energy Electricity Research Center, Jinan University, Zhuhai 519070, China
School of Electrical and Electronic Engineering, Nanyang Technological University, 639798 Singapore
School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China
Department of Energy Technology at Aalborg University, Denmark

Abstract

Microgrids (MGs) are playing a fundamental role in the transition of energy systems towards a low carbon future due to the advantages of a highly efficient network architecture for flexible integration of various DC/AC loads, distributed renewable energy sources, and energy storage systems, as well as a more resilient and economical on/off-grid control, operation, and energy management. However, MGs, as newcomers to the utility grid, are also facing challenges due to economic deregulation of energy systems, restructuring of generation, and market-based operation. This paper comprehensively summarizes the published research works in the areas of MGs and related energy management modelling and solution techniques. First, MGs and energy storage systems are classified into multiple branches and typical combinations as the backbone of MG energy management. Second, energy management models under exogenous and endogenous uncertainties are summarized and extended to transactive energy management. Mathematical programming, adaptive dynamic programming, and deep reinforcement learning-based solution methods are investigated accordingly, together with their implementation schemes. Finally, problems for future energy management systems with dynamics-captured critical component models, stability constraints, resilience awareness, market operation, and emerging computational techniques are discussed.

Keywords: optimization, energy management, Architecture, microgrids, energy storage systems, uncertainty models

References(164)

[1]

X. Liu, P. Wang, and P. C. Loh, "A hybrid AC/DC microgrid and its coordination control," IEEE Transactions on Smart Grid, vol. 2, no. 2, pp. 278–286, Jun. 2011.

[2]

E. Bullich-Massagué, F. Díaz-González, M. Aragüés-Peñalba, F. Girbau-Llistuella, P. Olivella-Rosell, and A. Sumper, "Microgrid clustering architectures," Applied Energy, vol. 212, pp. 340–361, Feb. 2018.

[3]

H. Wang and J. W. Huang, "Incentivizing energy trading for interconnected microgrids," IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 2647–2657, Jul. 2018.

[4]

B. Zhou, J. T. Zou, C. Y. Chung, H. Z. Wang, N. Liu, N. Voropai, and D. S. Xu, "Multi-microgrid energy management systems: architecture, communication, and scheduling strategies," Journal of Modern Power Systems and Clean Energy, vol. 9, no. 3, pp. 463–476, May 2021.

[5]

Z. Y. Li, M. Shahidehpour, F. Aminifar, A. Alabdulwahab, and Y. Al-Turki, "Networked microgrids for enhancing the power system resilience," Proceedings of the IEEE, vol. 105, no. 7, pp. 1289–1310, Jul. 2017.

[6]

S. D. Fang, Y. Wang, B. Gou, and Y. Xu, "Toward future green maritime transportation: an overview of seaport microgrids and all-electric ships," IEEE Transactions on Vehicular Technology, vol. 69, no. 1, pp. 207–219, Jan. 2020.

[7]

B. Chen, J. H. Wang, X. N. Lu, C. Chen, and S. J. Zhao, "Networked microgrids for grid resilience, robustness, and efficiency: a review," IEEE Transactions on Smart Grid, vol. 12, no. 1, pp. 18–32, Jan. 2021.

[8]

S. L. Wen, T. Y. Zhao, Y. Tang, Y. Xu, M. Zhu, and Y. Q. Huang, "A joint photovoltaic-dependent navigation routing and energy storage system sizing scheme for more efficient all-electric ships," IEEE Transactions on Transportation Electrification, vol. 6, no. 3, pp. 1279–1289, Sep. 2020.

[9]

S. D. Fang, Y. Xu, Z. M. Li, T. Y. Zhao, and H. D. Wang, "Two-step multi-objective management of hybrid energy storage system in all-electric ship microgrids," IEEE Transactions on Vehicular Technology, vol. 68, no. 4, pp. 3361–3373, Apr. 2019.

[10]

V. Kounev, D. Tipper, A. A. Yavuz, B. M. Grainger, and G. F. Reed, "A secure communication architecture for distributed microgrid control," IEEE Transactions on Smart Grid, vol. 6, no. 5, pp. 2484–2492, Sep. 2015.

[11]

P. Wheeler and S. Bozhko, "The more electric aircraft: technology and challenges," IEEE Electrification Magazine, vol. 2, no. 4, pp. 6–12, Dec. 2014.

[12]

S. Mashayekh, M. Stadler, G. Cardoso, M. Heleno, S. C. Madathil, H. Nagarajan, R. Bent, M. Mueller-Stoffels, X. N. Lu, and J. H. Wang, "Security-constrained design of isolated multi-energy microgrids," IEEE Transactions on Power Systems, vol. 33, no. 3, pp. 2452–2462, May 2018.

[13]

S. H. Yao, P. Wang, and T. Y. Zhao, "Transportable energy storage for more resilient distribution systems with multiple microgrids," IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 3331–3341, May 2019.

[14]

C. Q. Ju, P. Wang, L. Goel, and Y. Xu, "A two-layer energy management system for microgrids with hybrid energy storage considering degradation costs," IEEE Transactions on Smart Grid, vol. 9, no. 6, pp. 6047–6057, Nov. 2018.

[15]

X. K. Xu, M. Bishop, D. G. Oikarinen, and C. Hao, "Application and modeling of battery energy storage in power systems," CSEE Journal of Power and Energy Systems, vol. 2, no. 3, pp. 82–90, Sep. 2016.

[16]

H. Nezamabadi and V. Vahidinasab, "Arbitrage strategy of renewable-based microgrids via peer-to-peer energy-trading," IEEE Transactions on Sustainable Energy, vol. 12, no. 2, pp. 1372–1382, Apr. 2021.

[17]

B. Mohandes, S. Acharya, M. S. El Moursi, A. S. Al-Sumaiti, H. Doukas, and S. Sgouridis, "Optimal design of an islanded microgrid with load shifting mechanism between electrical and thermal energy storage systems," IEEE Transactions on Power Systems, vol. 35, no. 4, pp. 2642–2657, Jul. 2020.

[18]

M. Farrokhabadi, C. A. Cañizares, J. W. Simpson-Porco, E. Nasr, L. L. Fan, P. A. Mendoza-Araya, R. Tonkoski, U. Tamrakar, N. Hatziargyriou, D. Lagos, R. W. Wies, M. Paolone, M. Liserre, L. Meegahapola, M. Kabalan, A. H. Hajimiragha, D. Peralta, M. A. Elizondo, K. P. Schneider, F. K. Tuffner, and J. Reilly, "Microgrid stability definitions, analysis, and examples," IEEE Transactions on Power Systems, vol. 35, no. 1, pp. 13–29, Jan. 2020.

[19]

G. D. Zhang, J. Yuan, Z. Li, S. S. Yu, S. Z. Chen, H. Trinh, and Y. Zhang, "Forming a reliable hybrid microgrid using electric spring coupled with non-sensitive loads and ESS," IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 2867–2879, Jul. 2020.

[20]

H. T. Nguyen, A. S. Al-Sumaiti, K. Turitsyn, Q. F. Li, and M. S. El Moursi, "Further optimized scheduling of micro grids via dispatching virtual electricity storage offered by deferrable power-driven demands," IEEE Transactions on Power Systems, vol. 35, no. 5, pp. 3494–3505, Sep. 2020.

[21]

P. Lyu, X. J. Liu, J. Qu, J. T. Zhao, Y. T. Huo, Z. G. Qu, and Z. H. Rao, "Recent advances of thermal safety of lithium ion battery for energy storage," Energy Storage Materials, vol. 31, pp. 195–220, Oct. 2020.

[22]

S. H. Yao, P. Wang, X. C. Liu, H. J. Zhang, and T. Y. Zhao, "Rolling optimization of mobile energy storage fleets for resilient service restoration," IEEE Transactions on Smart Grid, vol. 11, no. 2, pp. 1030–1043, Mar. 2020.

[23]

T. Ding, Z. K. Wang, W. H. Jia, B. Chen, C. Chen, and M. Shahidehpour, "Multiperiod distribution system restoration with routing repair crews, mobile electric vehicles, and soft-open-point networked microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 6, pp. 4795–4808, Nov. 2020.

[24]
The Specification of Microgrid Controllers, IEEE Standard 2030.7-2017, 2018.
[25]

X. M. Mo, J. Q. Zhu, J. J. Chen, Y. Guo, Y. R. Xia, and M. B. Liu, "A stochastic spatiotemporal decomposition decision-making approach for real-time dynamic energy management of multi-microgrids," IEEE Transactions on Sustainable Energy, vol. 12, no. 2, pp. 821–833, Apr. 2021.

[26]

M. I. S. L. Purage, A. Krishnan, E. Y. S. Foo, and H. B. Gooi, "Cooperative bidding-based robust optimal energy management of multimicrogrids," IEEE Transactions on Industrial Informatics, vol. 16, no. 9, pp. 5757–5768, Sep. 2020.

[27]

J. Y. Li, M. E. Khodayar, J. H. Wang, and B. Zhou, "Data-driven distributionally robust Co-optimization of P2P energy trading and network operation for interconnected microgrids," IEEE Transactions on Smart Grid, vol. 12, no. 6, pp. 5172–5184, Nov. 2021.

[28]

M. H. Ullah, B. Babaiahgari, A. Alseyat, and J. D. Park, "A computationally efficient consensus-based multiagent distributed EMS for DC microgrids," IEEE Transactions on Industrial Electronics, vol. 68, no. 6, pp. 5425–5435, Jun. 2021.

[29]

R. Rahmaniani, T. G. Crainic, M. Gendreau, and W. Rei, "The Benders decomposition algorithm: a literature review," European Journal of Operational Research, vol. 259, no. 3, pp. 801–817, Jun. 2017.

[30]

T. Roughgarden, "Algorithmic game theory," Communications of the ACM, vol. 53, no. 7, pp. 78–86, Jul. 2010.

[31]

S. S. M. Venkata and M. Shahidehpour, "Microgrid controllers: the brain, heart, & soul of microgrid automation [guest editorial]," IEEE Power and Energy Magazine, vol. 15, no. 4, pp. 16–22, Jul. /Aug. 2017.

[32]
The Testing of Microgrid Controllers, IEEE Standard 2030.8-2018, 2018.
[33]

L. K. Gan, A. Hussain, D. A. Howey, and H. M. Kim, "Limitations in energy management systems: a case study for resilient interconnected microgrids," IEEE Transactions on Smart Grid, vol. 10, no. 5, pp. 5675–5685, Sep. 2019.

[34]

X. W. Pan, L. Q. Zhang, J. F. Xiao, F. H. Choo, A. K. Rathore, and P. Wang, "Design and implementation of a communication network and operating system for an adaptive integrated hybrid AC/DC microgrid module," CSEE Journal of Power and Energy Systems, vol. 4, no. 1, pp. 19–28, Mar. 2018.

[35]

F. Blaabjerg, Y. H. Yang, D. S. Yang, and X. F. Wang, "Distributed power-generation systems and protection," Proceedings of the IEEE, vol. 105, no. 7, pp. 1311–1331, Jul. 2017.

[36]

K. E. Holmefjord, L. Husdal, M. de Jongh, and S. Torben, "Variable-speed engines on wind farm support vessels," Journal of Marine Science and Engineering, vol. 8, no. 3, pp. 229, Mar. 2020.

[37]
J. Bailey. (2019, Jun. 14). Insiders say airbus wants to create an electric hybrid to replace the A320neo. [Online]. Available: https://simpleflying.com/airbus-electric-a320neo/.
[38]

P. Wang, L. Goel, X. Liu, and F. H. Choo, "Harmonizing AC and DC: a hybrid AC/DC future grid solution," IEEE Power and Energy Magazine, vol. 11, no. 3, pp. 76–83, May/Jun. 2013.

[39]

C. Jin, J. J. Wang, and P. Wang, "Coordinated secondary control for autonomous hybrid three-port AC/DC/DS microgrid," CSEE Journal of Power and Energy Systems, vol. 4, no. 1, pp. 1–10, Mar. 2018.

[40]

H. Yu, S. Y. Niu, Y. M. Zhang, and L. N. Jian, "An integrated and reconfigurable hybrid AC/DC microgrid architecture with autonomous power flow control for nearly/net zero energy buildings," Applied Energy, vol. 263, pp. 114610, Apr. 2020.

[41]

T. Y. Zhao, X. W. Pan, S. H. Yao, C. C. Ju, and L. Li, "Strategic bidding of hybrid AC/DC microgrid embedded energy hubs: a two-stage chance constrained stochastic programming approach," IEEE Transactions on Sustainable Energy, vol. 11, no. 1, pp. 116–125, Jan. 2020.

[42]

N. T. Huang, W. T. Wang, and G. W. Cai, "Optimal configuration planning of multi-energy microgird based on deep joint generation of source-load-temperature scenarios," CSEE Journal of Power and Energy Systems, doi: 10.17775/CSEEJPES.2020.01090.

[43]
F. Kamrani, S. Fattaheian-Dehkordi, M. Gholami, A. Abbaspour, L. Fotuhi-Firuzabad, and M. Lehtonen,"A two-stage flexibility-oriented stochastic energy management strategy for multi-microgrids considering interaction with gas grid," IEEE Transactions on Engineering Management, to be published.
[44]

W. Violante, C. A. Cñizares, M. A. Trovato, and G. Forte, "An energy management system for isolated microgrids with thermal energy resources," IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 2880–2891, Jul. 2020.

[45]

M. Rezaeimozafar, M. Eskandari, and A. V. Savkin, "A self-optimizing scheduling model for large-scale EV fleets in microgrids," IEEE Transactions on Industrial Informatics, vol. 17, no. 12, pp. 8177–8188, Dec. 2021.

[46]

Y. Z. Li, T. Y. Zhao, P. Wang, H. B. Gooi, L. Wu, Y. Liu, and J. Ye, "Optimal operation of multimicrogrids via cooperative energy and reserve scheduling," IEEE Transactions on Industrial Informatics, vol. 14, no. 8, pp. 3459–3468, Aug. 2018.

[47]

Q. W. Xu, T. Y. Zhao, Y. Xu, Z. Xu, P. Wang, and F. Blaabjerg, "A distributed and robust energy management system for networked hybrid AC/DC microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 3496–3508, Jul. 2020.

[48]

S. B. Lei, J. H. Wang, C. Chen, and Y. H. Hou, "Mobile emergency generator pre-positioning and real-time allocation for resilient response to natural disasters," IEEE Transactions on Smart Grid, vol. 9, no. 3, pp. 2030–2041, May 2018.

[49]

Y. Li, P. Zhang, and P. B. Luh, "Formal analysis of networked microgrids dynamics," IEEE Transactions on Power Systems, vol. 33, no. 3, pp. 3418–3427, May 2018.

[50]

S. Peyghami, P. Palensky, and F. Blaabjerg, "An overview on the reliability of modern power electronic based power systems," IEEE Open Journal of Power Electronics, vol. 1, pp. 34–50, Feb. 2020.

[51]
X. Z. Liu, Z. D. Zheng, K. Wang, and Y. D. Li, "An energy router based on multi-winding high-frequency transformer," in 2016 IEEE Applied Power Electronics Conference and Exposition (APEC), 2016, pp. 3317–3321.
DOI
[52]

A. K. Bhattacharjee, N. Kutkut, and I. Batarseh, "Review of multiport converters for solar and energy storage integration," IEEE Transactions on Power Electronics, vol. 34, no. 2, pp. 1431–1445, Feb. 2019.

[53]

E. Nasr-Azadani, P. Su, W. D. Zheng, J. Rajda, C. Cañizares, M. Kazerani, E. Veneman, S. Cress, M. Wittemund, M. R. Manjunath, N. Wrathall, and M. Carter, "The Canadian renewable energy laboratory: a testbed for microgrids," IEEE Electrification Magazine, vol. 8, no. 1, pp. 49–60, Mar. 2020.

[54]
P. Schneider, L. Badger, D. Brhlik, D. Goldwasser, and B. Polly,"Resilient, rural, and revolutionary: Salisbury square's direct-current affordable microgrid community: preprint," National Renewable Energy Lab., Golden, CO, Tech. Rep. NREL/CP-5500–83181, Sep. 2, 2022.
[55]
Airbus. (2021, Jul.). E-Fan X: a giant leap towards zero-emission flight. [Online]. Available: https://www.airbus.com/en/innovation/zero-emission/electric-flight/e-fan-x.
[56]

N. Mousavi, G. Kothapalli, D. Habibi, C. K. Das, and A. Baniasadi, "A novel photovoltaic-pumped hydro storage microgrid applicable to rural areas," Applied Energy, vol. 262, pp. 114284, Mar. 2020.

[57]

Y. W. Li, S. H. Miao, X. Luo, B. X. Yin, J. Han, and J. H. Wang, "Dynamic modelling and techno-economic analysis of adiabatic compressed air energy storage for emergency back-up power in supporting microgrid," Applied Energy, vol. 261, pp. 114448, Mar. 2020.

[58]

J. Noack, N. Roznyatovskaya, T. Herr, and P. Fischer, "The chemistry of redox-flow batteries," Angewandte Chemie International Edition, vol. 54, no. 34, pp. 9776–9809, Aug. 2015.

[59]

M. Hu, Y. W. Wang, X. N. Lin, and Y. Shi, "A decentralized periodic energy trading framework for pelagic islanded microgrids," IEEE Transactions on Industrial Electronics, vol. 67, no. 9, pp. 7595–7605, Sep. 2020.

[60]

K. Hein, Y. Xu, G. Wilson, and A. K. Gupta, "Coordinated optimal voyage planning and energy management of all-electric ship with hybrid energy storage system," IEEE Transactions on Power Systems, vol. 36, no. 3, pp. 2355–2365, May 2021.

[61]

B. Wang, C. Zhang, and Z. Y. Dong, "Interval optimization based coordination of demand response and battery energy storage system considering SOC management in a microgrid," IEEE Transactions on Sustainable Energy, vol. 11, no. 4, pp. 2922–2931, Oct. 2020.

[62]

M. G. Hong, X. Y. Yu, N. P. Yu, and K. A. Loparo, "An energy scheduling algorithm supporting power quality management in commercial building microgrids," IEEE Transactions on Smart Grid, vol. 7, no. 2, pp. 1044–1056, Mar. 2016.

[63]

M. Javadi, Y. Z. Gong, and C. Y. Chung, "Frequency stability constrained microgrid scheduling considering seamless islanding," IEEE Transactions on Power Systems, vol. 37, no. 1, pp. 306–316, Jan. 2022.

[64]

J. F. Xiao, P. Wang, and L. Setyawan, "Multilevel energy management system for hybridization of energy storages in DC microgrids," IEEE Transactions on Smart Grid, vol. 7, no. 2, pp. 847–856, Mar. 2016.

[65]

K. Thirugnanam, M. S. El Moursi, V. Khadkikar, H. H. Zeineldin, and M. Al Hosani, "Energy management strategy of a reconfigurable grid-tied hybrid AC/DC microgrid for commercial building applications," IEEE Transactions on Smart Grid, vol. 13, no. 3, pp. 1720–1738, May 2022.

[66]

Y. Du and F. X. Li, "A hierarchical real-time balancing market considering multi-microgrids with distributed sustainable resources," IEEE Transactions on Sustainable Energy, vol. 11, no. 1, pp. 72–83, Jan. 2020.

[67]

X. J. Li and S. X. Wang, "Energy management and operational control methods for grid battery energy storage systems," CSEE Journal of Power and Energy Systems, vol. 7, no. 5, pp. 1026–1040, Sep. 2021.

[68]

A. M. S. M. H. S. Attanayaka, J. P. Karunadasa, and K. T. Hemapala, "Comprehensive electro-thermal battery-model for Li-ion batteries in microgrid applications," Energy Storage, vol. 3, no. 3, pp. e230, Jun. 2021.

[69]

S. Y. Ding, C. Y. Dong, T. Y. Zhao, L. Koh, X. Y. Bai, and J. Luo, "A meta-learning based multimodal neural network for multistep ahead battery thermal runaway forecasting," IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4503–4511, Jul. 2021.

[70]

Y. Xu, T. Y. Zhao, S. Q. Zhao, J. H. Zhang, and Y. Wang, "Multi-objective chance-constrained optimal day-ahead scheduling considering BESS degradation," CSEE Journal of Power and Energy Systems, vol. 4, no. 3, pp. 316–325, Sep. 2018.

[71]

Y. Liu, Y. Wang, Y. Z. Li, H. B. Gooi, and H. H. Xin, "Multi-agent based optimal scheduling and trading for multi-microgrids integrated with urban transportation networks," IEEE Transactions on Power Systems, vol. 36, no. 3, pp. 2197–2210, May 2021.

[72]

T. Y. Zhao, J. H. Zhang, and P. Wang, "Closed-loop supply chain based battery swapping and charging system operation: a hierarchy game approach," CSEE Journal of Power and Energy Systems, vol. 5, no. 1, pp. 35–45, Mar. 2019.

[73]

X. C. Liu, T. Y. Zhao, S. H. Yao, C. B. Soh, and P. Wang, "Distributed operation management of battery swapping-charging systems," IEEE Transactions on Smart Grid, vol. 10, no. 5, pp. 5320–5333, Sep. 2019.

[74]

Y. Y. Sun, J. L. Zhong, Z. Y. Li, W. Tian, and M. Shahidehpour, "Stochastic scheduling of battery-based energy storage transportation system with the penetration of wind power," IEEE Transactions on Sustainable Energy, vol. 8, no. 1, pp. 135–144, Jan. 2017.

[75]

X. Y. Jiang, J. Chen, M. Chen, and Z. Wei, "Multi-stage dynamic post-disaster recovery strategy for distribution networks considering integrated energy and transportation networks," CSEE Journal of Power and Energy Systems, vol. 7, no. 2, pp. 408–420, Mar. 2021.

[76]

Q. Sui, F. R. Wei, C. T. Wu, X. N. Lin, and Z. T. Li, "Day-ahead energy management for pelagic island microgrid groups considering non-integer-hour energy transmission," IEEE Transactions on Smart Grid, vol. 11, no. 6, pp. 5249–5259, Nov. 2020.

[77]
R. C. Smith, Uncertainty Quantification: Theory, Implementation, and Applications, Philadelphia: Society for Industrial and Applied Mathematics, 2013.
[78]

M. Alipour, H. Chitsaz, H. Zareipour, and D. Wood, "Microgrid energy management: how uncertainty modelling impacts economic performance," IET Generation, Transmission & Distribution, vol. 13, no. 24, pp. 5504–5510, Dec. 2019.

[79]

M. Y. Sun, T. Q. Zhang, Y. Wang, G. Strbac, and C. Q. Kang, "Using Bayesian deep learning to capture uncertainty for residential net load forecasting," IEEE Transactions on Power Systems, vol. 35, no. 1, pp. 188–201, Jan. 2020.

[80]

H. Çimen, N. Çetinkaya, J. C. Vasquez, and J. M. Guerrero, "A microgrid energy management system based on non-intrusive load monitoring via multitask learning," IEEE Transactions on Smart Grid, vol. 12, no. 2, pp. 977–987, Mar. 2021.

[81]

B. Zeng, X. Wei, D. B. Zhao, C. Singh, and J. H. Zhang, "Hybrid probabilistic-possibilistic approach for capacity credit evaluation of demand response considering both exogenous and endogenous uncertainties," Applied Energy, vol. 229, pp. 186–200, Nov. 2018.

[82]

Y. L. Li, W. Sun, W. Q. Yin, S. B. Lei, and Y. H. Hou, "Restoration strategy for active distribution systems considering endogenous uncertainty in cold load pickup," IEEE Transactions on Smart Grid, vol. 13, no. 4, pp. 2690–2702, Jul. 2022.

[83]

Y. F. Zhang, F. Liu, Z. J. Wang, Y. F. Su, W. S. Wang, and S. L. Feng, "Robust scheduling of virtual power plant under exogenous and endogenous uncertainties," IEEE Transactions on Power Systems, vol. 37, no. 2, pp. 1311–1325, Mar. 2022.

[84]

D. Coppitters, W. De Paepe, and F. Contino, "Robust design optimization of a photovoltaic-battery-heat pump system with thermal storage under aleatory and epistemic uncertainty," Energy, vol. 229, pp. 120692, Aug. 2021.

[85]

O. Ciftci, M. Mehrtash, and A. Kargarian, "Data-driven nonparametric chance-constrained optimization for microgrid energy management," IEEE Transactions on Industrial Informatics, vol. 16, no. 4, pp. 2447–2457, Apr. 2020.

[86]

R. H. M. Zargar and M. H. Y. Moghaddam, "Development of a markov-chain-based solar generation model for smart microgrid energy management system," IEEE Transactions on Sustainable Energy, vol. 11, no. 2, pp. 736–745, Apr. 2020.

[87]

A. J. Kleywegt, A. Shapiro, and T. Homem-de-Mello, "The sample average approximation method for stochastic discrete optimization," SIAM Journal of Optimization, vol. 12, no. 2, pp. 479–502, Jan. 2002.

[88]

D. Bertsimas and D. B. Brown, "Constructing uncertainty sets for robust linear optimization," Operations Research, vol. 57, no. 6, pp. 1483–1495, Apr. 2009.

[89]

Z. X. Liu, L. F. Wang, and L. Ma, "A transactive energy framework for coordinated energy management of networked microgrids with distributionally robust optimization," IEEE Transactions on Power Systems, vol. 35, no. 1, pp. 395–404, Jan. 2020.

[90]

G. A. Hanasusanto, V. Roitch, D. Kuhn, and W. Wiesemann, "A distributionally robust perspective on uncertainty quantification and chance constrained programming," Mathematical Programming, vol. 151, no. 1, pp. 35–62, Jun. 2015.

[91]
H. Rahimian and S. Mehrotra,"Distributionally robust optimization: a review," arXiv preprint arXiv: 1908. 05659, 2019.
[92]

G. C. Pflug, "On-line optimization of simulated markovian processes," Mathematics of Operations Research, vol. 15, no. 3, pp. 381–395, Aug. 1990.

[93]

X. V. Doan, "Distributionally robust optimization under endogenous uncertainty with an application in retrofitting planning," European Journal of Operational Research, vol. 300, no. 1, pp. 73–84, Jul. 2022.

[94]

F. Q. Luo and S. Mehrotra, "Distributionally robust optimization with decision dependent ambiguity sets," Optimization Letters, vol. 14, no. 8, pp. 2565–2594, Nov. 2020.

[95]

D. Bertsimas, V. Gupta, and N. Kallus, "Robust sample average approximation," Mathematical Programming, vol. 171, no. 1–2, pp. 217–282, Nov. 2018.

[96]

H. Rahimian, G. Bayraksan, and T. Homem-de-Mello, "Controlling risk and demand ambiguity in newsvendor models," European Journal of Operational Research, vol. 279, no. 3, pp. 854–868, Dec. 2019.

[97]

S. Q. Wang, M. Q. Du, L. G. Lu, W. Xing, K. Sun, and M. G. Ouyang, "Multilevel energy management of a DC microgrid based on virtual-battery model considering voltage regulation and economic optimization," IEEE Journal of Emerging and Selected Topics in Power Electronics, vol. 9, no. 3, pp. 2881–2895, Jun. 2021.

[98]

L. Fu, B. Liu, K. Meng, and Z. Y. Dong, "Optimal restoration of an unbalanced distribution system into multiple microgrids considering three-phase demand-side management," IEEE Transactions on Power Systems, vol. 36, no. 2, pp. 1350–1361, Mar. 2021.

[99]

Y. F. Wang, Z. H. Huang, M. Shahidehpour, L. L. Lai, Z. Q. Wang, and Q. S. Zhu, "Reconfigurable distribution network for managing transactive energy in a multi-microgrid system," IEEE Transactions on Smart Grid, vol. 11, no. 2, pp. 1286–1295, Mar. 2020.

[100]

H. Farzin, M. Fotuhi-Firuzabad, and M. Moeini-Aghtaie, "Role of outage management strategy in reliability performance of multi-microgrid distribution systems," IEEE Transactions on Power Systems, vol. 33, no. 3, pp. 2359–2369, May 2018.

[101]

N. Rezaei, A. Ahmadi, A. H. Khazali, and J. M. Guerrero, "Energy and frequency hierarchical management system using information gap decision theory for islanded microgrids," IEEE Transactions on Industrial Electronics, vol. 65, no. 10, pp. 7921–7932, Oct. 2018.

[102]

M. F. Zia, E. Elbouchikhi, M. Benbouzid, and J. M. Guerrero, "Energy management system for an islanded microgrid with convex relaxation," IEEE Transactions on Industry Applications, vol. 55, no. 6, pp. 7175–7185, Nov. /Dec. 2019.

[103]

E. Barklund, N. Pogaku, M. Prodanovic, C. Hernandez-Aramburo, and T. C. Green, "Energy management in autonomous microgrid using stability-constrained droop control of inverters," IEEE Transactions on Power Electronics, vol. 23, no. 5, pp. 2346–2352, Sep. 2008.

[104]

M. S. Wang, Y. F. Su, L. J. Chen, Z. M. Li, and S. W. Mei, "Distributed optimal power flow of DC microgrids: a penalty based ADMM approach," CSEE Journal of Power and Energy Systems, vol. 7, no. 2, pp. 339–347, Mar. 2021.

[105]

F. F. Shen, Q. W. Wu, J. Zhao, W. Wei, N. D. Hatziargyriou, and F. Liu, "Distributed risk-limiting load restoration in unbalanced distribution systems with networked microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 6, pp. 4574–4586, Nov. 2020.

[106]

S. Bahramara, P. Sheikhahmadi, A. Mazza, G. Chicco, M. Shafie-Khah, and J. P. S. Catalão, "A risk-based decision framework for the distribution company in mutual interaction with the wholesale day-ahead market and microgrids," IEEE Transactions on Industrial Informatics, vol. 16, no. 2, pp. 764–778, Feb. 2020.

[107]

F. Sheidaei and A. Ahmarinejad, "Multi-stage stochastic framework for energy management of virtual power plants considering electric vehicles and demand response programs," International Journal of Electrical Power & Energy Systems, vol. 120, pp. 106047, Sep. 2020.

[108]

B. Zeng and L. Zhao, "Solving two-stage robust optimization problems using a column-and-constraint generation method," Operations Research Letters, vol. 41, no. 5, pp. 457–461, Sep. 2013.

[109]

Y. Z. Li, T. Y. Zhao, P. Wang, H. B. Gooi, Z. H. Ding, K. C. Li, and W. Yan, "Flexible scheduling of microgrid with uncertainties considering expectation and robustness," IEEE Transactions on Industry Applications, vol. 54, no. 4, pp. 3009–3018, Jul. /Aug. 2018.

[110]

Z. C. Shi, H. Liang, S. J. Huang, and V. Dinavahi, "Distributionally robust chance-constrained energy management for islanded microgrids," IEEE Transactions on Smart Grid, vol. 10, no. 2, pp. 2234–2244, Mar. 2019.

[111]

S. Cai, Y. Y. Xie, Q. W. Wu, M. L. Zhang, X. L. Jin, and Z. R. Xiang, "Distributionally robust microgrid formation approach for service restoration under random contingency," IEEE Transactions on Smart Grid, vol. 12, no. 6, pp. 4926–4937, Nov. 2021.

[112]
M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Hoboken: John Wiley & Sons, 2005.
[113]

H. Zhou, A. Aral, I. Brandić, and M. Erol-Kantarci, "Multiagent bayesian deep reinforcement learning for microgrid energy management under communication failures," IEEE Internet of Things Journal, vol. 9, no. 14, pp. 11685–11698, Jul. 2022.

[114]

L. Yu, S. Q. Qin, M. Zhang, C. Shen, T. Jiang, and X. H. Guan, "A review of deep reinforcement learning for smart building energy management," IEEE Internet of Things Journal, vol. 8, no. 15, pp. 12046–12063, Aug. 2021.

[115]

L. Lei, Y. Tan, G. Dahlenburg, W. Xiang, and K. Zheng, "Dynamic energy dispatch based on deep reinforcement learning in IoT-driven smart isolated microgrids," IEEE Internet of Things Journal, vol. 8, no. 10, pp. 7938–7953, May 2021.

[116]

A. Dridi, H. Afifi, H. Moungla, and J. Badosa, "A novel deep reinforcement approach for ⅡoT microgrid energy management systems," IEEE Transactions on Green Communications and Networking, vol. 6, no. 1, pp. 148–159, Mar. 2022.

[117]

H. H. Goh, Y. F. Huang, C. S. Lim, D. D. Zhang, H. Liu, W. Dai, T. A. Kurniawan, and S. Rahman, "An assessment of multistage reward function design for deep reinforcement learning-based microgrid energy management," IEEE Transactions on Smart Grid, vol. 13, no. 6, pp. 4300–4311, Nov. 2022.

[118]

V. H. Bui, A. Hussain, and W. C. Su, "A dynamic internal trading price strategy for networked microgrids: a deep reinforcement learning-based game-theoretic approach," IEEE Transactions on Smart Grid, vol. 13, no. 5, pp. 3408–3421, Sep. 2022.

[119]
H. F. Zhang, D. Yue, C. X. Dou, and G. P. Hancke,"A three-stage optimal operation strategy of interconnected microgrids with rule-based deep deterministic policy gradient algorithm," IEEE Transactions on Neural Networks and Learning Systems, to be published.
[120]

Y. Du and F. X. Li, "Intelligent multi-microgrid energy management based on deep neural network and model-free reinforcement learning," IEEE Transactions on Smart Grid, vol. 11, no. 2, pp. 1066–1076, Mar. 2020.

[121]

H. Shuai and H. B. He, "Online scheduling of a residential microgrid via monte-carlo tree search and a learned model," IEEE Transactions on Smart Grid, vol. 12, no. 2, pp. 1073–1087, Mar. 2021.

[122]

H. Shuai, J. K. Fang, X. M. Ai, Y. F. Tang, J. Y. Wen, and H. B. He, "Stochastic optimization of economic dispatch for microgrid based on approximate dynamic programming," IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 2440–2452, May 2019.

[123]

H. Shuai, J. K. Fang, X. M. Ai, J. Y. Wen, and H. B. He, "Optimal real-time operation strategy for microgrid: an ADP-based stochastic nonlinear optimization approach," IEEE Transactions on Sustainable Energy, vol. 10, no. 2, pp. 931–942, Apr. 2019.

[124]

P. Zeng, H. P. Li, H. B. He, and S. H. Li, "Dynamic energy management of a microgrid using approximate dynamic programming and deep recurrent neural network learning," IEEE Transactions on Smart Grid, vol. 10, no. 4, pp. 4435–4445, Jul. 2019.

[125]

A. Das, D. Wu, and Z. Ni, "Approximate dynamic programming with policy-based exploration for microgrid dispatch under uncertainties," International Journal of Electrical Power & Energy Systems, vol. 142, pp. 108359, Nov. 2022.

[126]

Q. L. Wei, D. R. Liu, F. L. Lewis, Y. Liu, and J. Zhang, "Mixed iterative adaptive dynamic programming for optimal battery energy control in smart residential microgrids," IEEE Transactions on Industrial Electronics, vol. 64, no. 5, pp. 4110–4120, May 2017.

[127]

Y. Ryu and H. W. Lee, "A real-time framework for matching prosumers with minimum risk in the cluster of microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 2832–2844, Jul. 2020.

[128]

Z. Q. Zhu, K. W. Chan, S. W. Xia, and S. Q. Bu, "Optimal Bi-level bidding and dispatching strategy between active distribution network and virtual alliances using distributed robust multi-agent deep reinforcement learning," IEEE Transactions on Smart Grid, vol. 13, no. 4, pp. 2833–2843, Jul. 2022.

[129]

T. Y. Chen, S. R. Bu, X. Liu, J. K. Kang, F. R. Yu, and Z. Han, "Peer-to-peer energy trading and energy conversion in interconnected multi-energy microgrids using multi-agent deep reinforcement learning," IEEE Transactions on Smart Grid, vol. 13, no. 1, pp. 715–727, Jan. 2022.

[130]

Y. Du, Z. W. Wang, G. Y. Liu, X. Chen, H. Y. Yuan, Y. L. Wei, and F. X. Li, "A cooperative game approach for coordinating multi-microgrid operation within distribution systems," Applied Energy, vol. 222, pp. 383–395, Jul. 2018.

[131]

K. Anoh, S. Maharjan, A. Ikpehai, Y. Zhang, and B. Adebisi, "Energy peer-to-peer trading in virtual microgrids in smart grids: a game-theoretic approach," IEEE Transactions on Smart Grid, vol. 11, no. 2, pp. 1264–1275, Mar. 2020.

[132]
R. B. Melton,"GridWise transactive energy framework (DRAFT Version)," Pacific Northwest National Lab., Richland, WA, Tech. Rep. PNNL-SA-22946, Nov. 6, 2013.
[133]

M. Pilz and L. Al-Fagih, "Recent advances in local energy trading in the smart grid based on game-theoretic approaches," IEEE Transactions on Smart Grid, vol. 10, no. 2, pp. 1363–1371, Mar. 2019.

[134]

M. Daneshvar, B. Mohammadi-Ivatloo, M. Abapour, S. Asadi, and R. Khanjani, "Distributionally robust chance-constrained transactive energy framework for coupled electrical and gas microgrids," IEEE Transactions on Industrial Electronics, vol. 68, no. 1, pp. 347–357, Jan. 2021.

[135]

C. Lo Prete and B. F. Hobbs, "A cooperative game theoretic analysis of incentives for microgrids in regulated electricity markets," Applied Energy, vol. 169, pp. 524–541, May 2016.

[136]

J. Y. Li, C. R. Zhang, Z. Xu, J. H. Wang, J. Zhao, and Y. J. A. Zhang, "Distributed transactive energy trading framework in distribution networks," IEEE Transactions on Power Systems, vol. 33, no. 6, pp. 7215–7227, Nov. 2018.

[137]

L. Park, S. Jeong, J. Kim, and S. Cho, "Joint geometric unsupervised learning and truthful auction for local energy market," IEEE Transactions on Industrial Electronics, vol. 66, no. 2, pp. 1499–1508, Feb. 2019.

[138]

B. Wang, C. Zhang, C. J. Li, G. Y. Yang, and Z. Y. Dong, "Transactive energy sharing in a microgrid via an enhanced distributed adaptive robust optimization approach," IEEE Transactions on Smart Grid, vol. 13, no. 3, pp. 2279–2293, May 2022.

[139]

J. Dupačová, N. Gröwe-Kuska, and W. Römisch, "Scenario reduction in stochastic programming," Mathematical Programming, vol. 95, no. 3, pp. 493–511, Mar. 2003.

[140]

A. R. Malekpour and A. Pahwa, "Stochastic networked microgrid energy management with correlated wind generators," IEEE Transactions on Power Systems, vol. 32, no. 5, pp. 3681–3693, Sep. 2017.

[141]

A. H. Alobaidi, M. E. Khodayar, and M. Shahidehpour, "Decentralized energy management for unbalanced networked microgrids with uncertainty," IET Generation, Transmission & Distribution, vol. 15, no. 13, pp. 1922–1938, Jul. 2021.

[142]

X. C. Liu, C. B. Soh, T. Y. Zhao, and P. Wang, "Stochastic scheduling of mobile energy storage in coupled distribution and transportation networks for conversion capacity enhancement," IEEE Transactions on Smart Grid, vol. 12, no. 1, pp. 117–130, Jan. 2021.

[143]

P. Xie, Y. W. Jia, H. K. Chen, J. Wu, and Z. X. Cai, "Mixed-stage energy management for decentralized microgrid cluster based on enhanced tube model predictive control," IEEE Transactions on Smart Grid, vol. 12, no. 5, pp. 3780–3792, Sep. 2021.

[144]

H. J. Gao, J. Y. Liu, L. F. Wang, and Z. B. Wei, "Decentralized energy management for networked microgrids in future distribution systems," IEEE Transactions on Power Systems, vol. 33, no. 4, pp. 3599–3610, Jul. 2018.

[145]

N. Jia, C. Wang, W. Wei, and T. S. Bi, "Decentralized robust energy management of multi-area integrated electricity-gas systems," Journal of Modern Power Systems and Clean Energy, vol. 9, no. 6, pp. 1478–1489, Nov. 2021.

[146]

M. Xie, X. Ji, S. J. Ke, and M. B. Liu, "Autonomous optimized economic dispatch of active distribution power system with multi-microgrids based on analytical target cascading theory," Proceedings of the CSEE, vol. 37, no. 17, pp. 4911–4921, Sep. 2017.

[147]

W. B. Powell and S. Meisel, "Tutorial on stochastic optimization in energy—Part I: modeling and policies," IEEE Transactions on Power Systems, vol. 31, no. 2, pp. 1459–1467, Mar. 2016.

[148]
T. M. Moerland, J. Broekens, A. Plaat, and C. M. Jonker,"Model-based reinforcement learning: a survey," arXiv preprint arXiv: 2006. 16712, 2020.
[149]

Z. B. Zou, X. R. Yu, and S. Ergan, "Towards optimal control of air handling units using deep reinforcement learning and recurrent neural network," Building and Environment, vol. 168, pp. 106535, Jan. 2020.

[150]

A. Paudel, M. Khorasany, and H. B. Gooi, "Decentralized local energy trading in microgrids with voltage management," IEEE Transactions on Industrial Informatics, vol. 17, no. 2, pp. 1111–1121, Feb. 2021.

[151]

Y. G. Du, J. Wu, S. Y. Li, C. N. Long, and S. Onori, "Hierarchical coordination of two-time scale microgrids with supply-demand imbalance," IEEE Transactions on Smart Grid, vol. 11, no. 5, pp. 3726–3736, Sep. 2020.

[152]

Y. Zheng, Y. Song, D. J. Hill, and Y. X. Zhang, "Multiagent system based microgrid energy management via asynchronous consensus ADMM," IEEE Transactions on Energy Conversion, vol. 33, no. 2, pp. 886–888, Jun. 2018.

[153]

Q. Zhou, M. Shahidehpour, A. Alabdulwahab, and A. Abusorrah, "A cyber-attack resilient distributed control strategy in islanded microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 5, pp. 3690–3701, Sep. 2020.

[154]

S. Y. Wang, X. D. Wang, and W. C. Wu, "Cloud computing and local chip-based dynamic economic dispatch for microgrids," IEEE Transactions on Smart Grid, vol. 11, no. 5, pp. 3774–3784, Sep. 2020.

[155]

F. Pacaud, M. De Lara, J. P. Chancelier, and P. Carpentier, "Distributed multistage optimization of large-scale microgrids under stochasticity," IEEE Transactions on Power Systems, vol. 37, no. 1, pp. 204–211, Jan. 2022.

[156]

M. Dabbaghjamanesh, B. Y. Wang, A. Kavousi-Fard, N. D. Hatziargyriou, and J. Zhang, "Blockchain-based stochastic energy management of interconnected microgrids considering incentive price," IEEE Transactions on Control of Network Systems, vol. 8, no. 3, pp. 1201–1211, Sep. 2021.

[157]

M. Dabbaghjamanesh, A. Kavousi-Fard, and Z. Y. Dong, "A novel distributed cloud-fog based framework for energy management of networked microgrids," IEEE Transactions on Power Systems, vol. 35, no. 4, pp. 2847–2862, Jul. 2020.

[158]

S. Q. Wang, M. Q. Du, L. G. Lu, W. Xing, K. Sun, and M. G. Ouyang, "Multilevel energy management of a DC microgrid based on virtual-battery model considering voltage regulation and economic optimization," IEEE Journal of Emerging and Selected Topics in Power Electronics, vol. 9, no. 3, pp. 2881–2895, Jun. 2021.

[159]

M. Mazidi, N. Rezaei, F. J. Ardakani, M. Mohiti, and J. M. Guerrero, "A hierarchical energy management system for islanded multi-microgrid clusters considering frequency security constraints," International Journal of Electrical Power & Energy Systems, vol. 121, pp. 106134, Oct. 2020.

[160]

Y. Sun, X. C. Hou, J. Yang, H. Han, M. Su, and J. M. Guerrero, "New perspectives on droop control in AC microgrid," IEEE Transactions on Industrial Electronics, vol. 64, no. 7, pp. 5741–5745, Jul. 2017.

[161]

E. Unamuno, J. Paniagua, and J. A. Barrena, "Unified virtual inertia for AC and DC microgrids: and the role of interlinking converters," IEEE Electrification Magazine, vol. 7, no. 4, pp. 56–68, Dec. 2019.

[162]
Australian Energy Market Operator, "Black system South Australia 28 September 2016: final report," Mar. 28, 2017.
[163]

X. F. Wang and F. Blaabjerg, "Harmonic stability in power electronic-based power systems: concept, modeling, and analysis," IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 2858–2870, May 2019.

[164]

P. A. Amaral and I. M. Bomze, "Copositivity-based approximations for mixed-integer fractional quadratic optimization," Pacific Journal of Optimization, vol. 11, no. 2, pp. 225–238, Apr. 2015.

Publication history
Copyright
Rights and permissions

Publication history

Received: 29 June 2022
Revised: 07 October 2022
Accepted: 24 October 2022
Published: 09 December 2022
Issue date: March 2023

Copyright

© 2022 CSEE

Rights and permissions

Return