Journal Home > Volume 1 , Issue 2
iEnergy 2022, 1(2): 188-203 https://doi.org/10.23919/IEN.2022.0025
Review | Open Access | Issue | Published: 01 August 2022

The competition and equilibrium in power markets under decarbonization and decentralization

Show Author's Information Qixin Chen1( ),  Xichen Fang1,  Hongye Guo1,  Kedi Zheng1,  Qinghu Tang1,  Ruike Lyu1,  Kaikai Pan2,  Peter Palensky3,  Daniel S. Kirschen4,  Chongqing Kang1
Department of Electrical Engineering, Tsinghua University, Beijing 100084, China
College of Electrical Engineering, Zhejiang University, Hangzhou 310058, China
Department of Electrical Sustainable Energy, Delft University of Technology, 2600 AA Delft, The Netherlands
Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195, USA
Keywords:
equilibrium analysis, Power markets, high renewable penetration, modelling methods, solution techniques, recent developments
Cite this article:
Chen Q, Fang X, Guo H, et al. The competition and equilibrium in power markets under decarbonization and decentralization. iEnergy, 2022, 1(2): 188-203. https://doi.org/10.23919/IEN.2022.0025
Download citation
EndNote(RIS)
BibTeX

1333

Views

135

Downloads

Citations

7

Crossref

N/A

WoS

0

Scopus

N/A

CSCD

Abstract Full text About this article

Equilibrium analysis has been widely studied as an effective tool to model gaming interactions and predict market results. However, as competition modes are fundamentally changed by the decarbonization and decentralization of power systems, analysis techniques must evolve. This article comprehensively reviews recent developments in modelling methods, practical settings and solution techniques in equilibrium analysis. Firstly, we review equilibrium in the evolving wholesale power markets which feature new entrants, novel trading products and multi-stage clearing. Secondly, the competition modes in the emerging distribution market and distributed resource aggregation are reviewed, and we compare peer-to-peer clearing, cooperative games and Stackelberg games. Furthermore, we summarize the methods to treat various information acquisition degrees, risk preferences and rationalities of market participants. To deal with increasingly complex market settings, this review also covers refined analytical techniques and agent-based models used to compute the equilibrium. Finally, based on this review, this paper summarizes key issues in the gaming and equilibrium analysis in power markets under decarbonization and decentralization.


menu
Abstract
Full text
Outline
About this article

The competition and equilibrium in power markets under decarbonization and decentralization

Show Author's information Qixin Chen1( ), Xichen Fang1, Hongye Guo1, Kedi Zheng1, Qinghu Tang1, Ruike Lyu1, Kaikai Pan2, Peter Palensky3, Daniel S. Kirschen4, Chongqing Kang1
Department of Electrical Engineering, Tsinghua University, Beijing 100084, China
College of Electrical Engineering, Zhejiang University, Hangzhou 310058, China
Department of Electrical Sustainable Energy, Delft University of Technology, 2600 AA Delft, The Netherlands
Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195, USA

Abstract

Equilibrium analysis has been widely studied as an effective tool to model gaming interactions and predict market results. However, as competition modes are fundamentally changed by the decarbonization and decentralization of power systems, analysis techniques must evolve. This article comprehensively reviews recent developments in modelling methods, practical settings and solution techniques in equilibrium analysis. Firstly, we review equilibrium in the evolving wholesale power markets which feature new entrants, novel trading products and multi-stage clearing. Secondly, the competition modes in the emerging distribution market and distributed resource aggregation are reviewed, and we compare peer-to-peer clearing, cooperative games and Stackelberg games. Furthermore, we summarize the methods to treat various information acquisition degrees, risk preferences and rationalities of market participants. To deal with increasingly complex market settings, this review also covers refined analytical techniques and agent-based models used to compute the equilibrium. Finally, based on this review, this paper summarizes key issues in the gaming and equilibrium analysis in power markets under decarbonization and decentralization.

Keywords: equilibrium analysis, Power markets, high renewable penetration, modelling methods, solution techniques, recent developments

References(156)

1
Keay, M., Rhys, J., Robinson, D. (2013). Electricity market reform in Britain: Central planning versus free markets. In Evolution of Global Electricity Markets, Sioshansi, F. P. Ed. San Diego, CA, USA: Academic Press, 31–57.
DOI
2
Nudell, T. R., Annaswamy, A. M., Lian, J. M., Kalsi, K., D’Achiardi, D. (2018). Electricity markets in the United States: A brief history, current operations, and trends. In Smart Grid Control, Stoustrup, J., Annaswamy, A., Chakrabortty, A., et al. Eds. Cham: Springer International Publishing.
DOI
3

Guo, H. Y., Chen, Q. X., Xia, Q., Kang, C. Q. (2019). Market power mitigation clearing mechanism based on constrained bidding capacities. IEEE Transactions on Power Systems, 34: 4817–4827.
DOI Google Scholar
4

Daraeepour, A., Kazempour, S. J., Patiño-Echeverri, D., Conejo, A. J. (2016). Strategic demand-side response to wind power integration. IEEE Transactions on Power Systems, 31: 3495–3505.
DOI Google Scholar
5

Nash, J. F. (1950). Equilibrium points in N-person games. Proceedings of the National Academy of Sciences of the United States of America, 36: 48–49.
DOI Google Scholar
6

Hobbs, B. E. (2001). Linear complementarity models of Nash-Cournot competition in bilateral and POOLCO power markets. IEEE Transactions on Power Systems, 16: 194–202.
DOI Google Scholar
7

Day, C. J., Hobbs, B. F., Pang, J. S. (2002). Oligopolistic competition in power networks: A conjectured supply function approach. IEEE Transactions on Power Systems, 17: 597–607.
DOI Google Scholar
8

Ruiz, C., Conejo, A. J. (2009). Pool strategy of a producer with endogenous formation of locational marginal prices. IEEE Transactions on Power Systems, 24: 1855–1866.
DOI Google Scholar
9

Pozo, D., Contreras, J. (2011). Finding multiple Nash equilibria in pool-based markets: A stochastic EPEC approach. IEEE Transactions on Power Systems, 26: 1744–1752.
DOI Google Scholar
10

Li, G., Shi, J., Qu, X. L. (2011). Modeling methods for GenCo bidding strategy optimization in the liberalized electricity spot marke—A state-of-the-art review. Energy, 36: 4686–4700.
DOI Google Scholar
11

Petoussis, A. G., Zhang, X. P., Petoussis, S. G., Godfrey, K. R. (2013). Parameterization of linear supply functions in nonlinear AC electricity market equilibrium models—Part I: Literature review and equilibrium algorithm. IEEE Transactions on Power Systems, 28: 650–658.
DOI Google Scholar
12
Zhang, X. (2010). Restructured Electric Power Systems. Hoboken, NJ, USA: John Wiley & Sons, Inc.
DOI
13

Pozo, D., Sauma, E., Contreras, J. (2017). Basic theoretical foundations and insights on bilevel models and their applications to power systems. Annals of Operations Research, 254: 303–334.
DOI Google Scholar
14

Tsimopoulos, E. G., Georgiadis, M. C. (2021). Nash equilibria in electricity pool markets with large-scale wind power integration. Energy, 228: 120642.
DOI Google Scholar
15

He, G. N., Chen, Q. X., Kang, C. Q., Xia, Q., Poolla, K. (2017). Cooperation of wind power and battery storage to provide frequency regulation in power markets. IEEE Transactions on Power Systems, 32: 3559–3568.
DOI Google Scholar
16

Baringo, L., Conejo, A. J. (2014). Strategic wind power investment. IEEE Transactions on Power Systems, 29: 1250–1260.
DOI Google Scholar
17

Guo, H. Y., Chen, Q. X., Fang, X. C., Liu, K., Xia, Q., Kang, C. Q. (2020). Efficiency loss for variable renewable energy incurred by competition in electricity markets. IEEE Transactions on Sustainable Energy, 11: 1951–1964.
DOI Google Scholar
18

Sioshansi, R. (2015). Optimized offers for cascaded hydroelectric generators in a market with centralized dispatch. IEEE Transactions on Power Systems, 30: 773–783.
DOI Google Scholar
19

Pan, G. S., Gu, W., Lu, Y. P., Qiu, H. F., Lu, S., Yao, S. (2021). Accurate modeling of a profit-driven power to hydrogen and methane plant toward strategic bidding within multi-type markets. IEEE Transactions on Smart Grid, 12: 338–349.
DOI Google Scholar
20

Nasrolahpour, E., Kazempour, J., Zareipour, H., Rosehart, W. D. (2018). A bilevel model for participation of a storage system in energy and reserve markets. IEEE Transactions on Sustainable Energy, 9: 582–598.
DOI Google Scholar
21
Guo, H. Y., Chen, Q. X., Xia, Q., Zhang, J. L., Li, M., Zou, P. (2017). Evaluating the impacts of VPPs on the joint energy and ancillary service markets equilibrium. In: Proceedings of the 2017 IEEE Power & Energy Society General Meeting, Chicago, IL, USA.
DOI
22

Wu, H. Y., Shahidehpour, M., Alabdulwahab, A., Abusorrah, A. (2016). A game theoretic approach to risk-based optimal bidding strategies for electric vehicle aggregators in electricity markets with variable wind energy resources. IEEE Transactions on Sustainable Energy, 7: 374–385.
DOI Google Scholar
23

Liu, F., Bie, Z. H., Jiang, J. F., Wang, K. (2019). Impact of microgrid aggregator on joint energy and reserve market based on pure strategy Nash equilibrium. Energy Procedia, 159: 142–147.
DOI Google Scholar
24

Carrion, M., Arroyo, J. M., Conejo, A. J. (2009). A bilevel stochastic programming approach for retailer futures market trading. IEEE Transactions on Power Systems, 24: 1446–1456.
DOI Google Scholar
25

Kardakos, E. G., Simoglou, C. K., Bakirtzis, A. G. (2016). Optimal offering strategy of a virtual power plant: A stochastic Bi-level approach. IEEE Transactions on Smart Grid, 7: 794–806.
DOI Google Scholar
26
Fang, X. C., Hou, Y. H., Liu, K., Guo, H. Y., Chen, Q. X. (2019). Strategic behaviors of wind generators in a stochastic joint power market equilibrium. In: Proceedings of the 2019 IEEE Power & Energy Society General Meeting, Atlanta, GA, USA.
DOI
27

Ito, K., Reguant, M. (2016). Sequential markets, market power, and arbitrage. American Economic Review, 106: 1921–1957.
DOI Google Scholar
28

Fang, X. C., Guo, H. Y., Zhang, D., Chen, Q. X. (2021). Cost recovery and investment barriers for renewables under market manipulation of thermal collusion. Applied Energy, 285: 116487.
DOI Google Scholar
29

Baringo, L., Conejo, A. J. (2013). Risk-constrained multi-stage wind power investment. IEEE Transactions on Power Systems, 28: 401–411.
DOI Google Scholar
30

Grimm, V., Rückel, B., Sölch, C., Zöttl, G. (2021). The impact of market design on transmission and generation investment in electricity markets. Energy Economics, 93: 104934.
DOI Google Scholar
31

Chen, S., Conejo, A. J., Sioshansi, R., Wei, Z. N. (2020). Investment equilibria involving gas-fired power units in electricity and gas markets. IEEE Transactions on Power Systems, 35: 2736–2747.
DOI Google Scholar
32

Smeers, Y., Martin, S., Aguado, J. A. (2022). Co-optimization of energy and reserve with incentives to wind generation. IEEE Transactions on Power Systems, 37: 2063–2074.
DOI Google Scholar
33

Zou, P., Chen, Q. X., Yu, Y., Xia, Q., Kang, C. Q. (2017). Electricity markets evolution with the changing generation mix: An empirical analysis based on China 2050 High Renewable Energy Penetration Roadmap. Applied Energy, 185: 56–67.
DOI Google Scholar
34

Chen, Q. X., Zou, P., Wu, C. Y., Zhang, J. L., Li, M., Xia, Q., Kang, C. Q. (2017). A Nash-Cournot approach to assessing flexible ramping products. Applied Energy, 206: 42–50.
DOI Google Scholar
35

Helgesen, P. I., Tomasgard, A. (2018). An equilibrium market power model for power markets and tradable green certificates, including Kirchhoff’s Laws and Nash-Cournot competition. Energy Economics, 70: 270–288.
DOI Google Scholar
36

Debia, S., Pineau, P. O., Siddiqui, A. S. (2019). Strategic use of storage: The impact of carbon policy, resource availability, and technology efficiency on a renewable-thermal power system. Energy Economics, 80: 100–122.
DOI Google Scholar
37

Hu, K. J., Chen, Y. C. (2019). Equilibrium fuel supply and carbon credit pricing under market competition and environmental regulations: A California case study. Applied Energy, 236: 815–824.
DOI Google Scholar
38

Parag, Y., Sovacool, B. K. (2016). Electricity market design for the prosumer era. Nature energy, 1: 16032.
DOI Google Scholar
39

Papavasiliou, A. (2018). Analysis of distribution locational marginal prices. IEEE Transactions on Smart Grid, 9: 4872–4882.
DOI Google Scholar
40

Bai, L. Q., Wang, J. H., Wang, C. S., Chen, C., Li, F. X. (2018). Distribution locational marginal pricing (DLMP) for congestion management and voltage support. IEEE Transactions on Power Systems, 33: 4061–4073.
DOI Google Scholar
41

Morstyn, T., Teytelboym, A., McCulloch, M. D. (2019). Designing decentralized markets for distribution system flexibility. IEEE Transactions on Power Systems, 34: 2128–2139.
DOI Google Scholar
42

Chen, H. H., Fu, L. B., Bai, L. Q., Jiang, T., Xue, Y. S., Zhang, R. F., Chowdhury, B., Stekli, J., Li, X. (2021). Distribution market-clearing and pricing considering coordination of DSOs and ISO: An EPEC approach. IEEE Transactions on Smart Grid, 12: 3150–3162.
DOI Google Scholar
43

Cai, Y., Huang, T., Bompard, E., Cao, Y. J., Li, Y. (2017). Self-sustainable community of electricity prosumers in the emerging distribution system. IEEE Transactions on Smart Grid, 8: 2207–2216.
DOI Google Scholar
44

Wei, J. D., Zhang, Y., Wang, J. X., Wu, L. (2021). Distribution LMP-based demand management in industrial park via a Bi-level programming approach. IEEE Transactions on Sustainable Energy, 12: 1695–1706.
DOI Google Scholar
45

Yan, X. H., Gu, C. H., Li, F. R., Wang, Z. Y. (2018). LMP-based pricing for energy storage in local market to facilitate PV penetration. IEEE Transactions on Power Systems, 33: 3373–3382.
DOI Google Scholar
46

Wu, Y. W., Barati, M., Lim, G. J. (2020). A pool strategy of microgrid in power distribution electricity market. IEEE Transactions on Power Systems, 35: 3–12.
DOI Google Scholar
47

Sorin, E., Bobo, L., Pinson, P. (2019). Consensus-based approach to peer-to-peer electricity markets with product differentiation. IEEE Transactions on Power Systems, 34: 994–1004.
DOI Google Scholar
48

Guo, Z. W., Pinson, P., Wu, Q. H., Chen, S. B., Yang, Q. M., Yang, Z. Y. (2022). An asynchronous online negotiation mechanism for real-time peer-to-peer electricity markets. IEEE Transactions on Power Systems, 37: 1868–1880.
DOI Google Scholar
49

Paudel, A., Chaudhari, K., Long, C., Gooi, H. B. (2019). Peer-to-peer energy trading in a prosumer-based community microgrid: A game-theoretic model. IEEE Transactions on Industrial Electronics, 66: 6087–6097.
DOI Google Scholar
50

le Cadre, H., Jacquot, P., Wan, C., Alasseur, C. (2020). Peer-to-peer electricity market analysis: From variational to generalized Nash equilibrium. European Journal of Operational Research, 282: 753–771.
DOI Google Scholar
51

Li, G. G., Li, Q. Q., Song, W., Wang, L. H. (2021). Incentivizing distributed energy trading among prosumers: A general Nash bargaining approach. International Journal of Electrical Power & Energy Systems, 131: 107100.
DOI Google Scholar
52

Tushar, W., Saha, T. K., Yuen, C., Morstyn, T., McCulloch, M. D., Poor, H. V., Wood, K. L. (2019). A motivational game-theoretic approach for peer-to-peer energy trading in the smart grid. Applied Energy, 243: 10–20.
DOI Google Scholar
53

Zhang, K., Troitzsch, S., Hanif, S., Hamacher, T. (2020). Coordinated market design for peer-to-peer energy trade and ancillary services in distribution grids. IEEE Transactions on Smart Grid, 11: 2929–2941.
DOI Google Scholar
54

Mieth, R., Dvorkin, Y. (2020). Distribution electricity pricing under uncertainty. IEEE Transactions on Power Systems, 35: 2325–2338.
DOI Google Scholar
55

Wang, L. L., Zhu, Z. A., Jiang, C. W., Li, Z. Y. (2021). Bi-level robust optimization for distribution system with multiple microgrids considering uncertainty distribution locational marginal price. IEEE Transactions on Smart Grid, 12: 1104–1117.
DOI Google Scholar
56
Biggar, D. R., Hesamzadeh, M. R. (2014). The smart grid and efficient pricing of distribution networks. In The Economics of Electricity Markets, Biggar, D. R., Hesamzadeh, M. R. Eds. Wiley.
DOI
57
Lu, Z. L., Bai, L. Q., Wang, J. X., Wei, J. D., Xiao, Y. P., Chen, Y. (2022). Peer-to-peer joint electricity and carbon trading based on carbon-aware distribution locational marginal pricing. IEEE Transactions on Power Systems, https://doi.org/10.1109/TPWRS.2022.3167780.
DOI
58

Zhang, Z., Li, R., Li, F. R. (2020). A novel peer-to-peer local electricity market for joint trading of energy and uncertainty. IEEE Transactions on Smart Grid, 11: 1205–1215.
DOI Google Scholar
59

Guo, Z. W., Pinson, P., Chen, S. B., Yang, Q. M., Yang, Z. Y. (2021). Chance-constrained peer-to-peer joint energy and reserve market considering renewable generation uncertainty. IEEE Transactions on Smart Grid, 12: 798–809.
DOI Google Scholar
60

Xiao, J. W., Yang, Y. B., Cui, S. C., Liu, X. K. (2022). A new energy storage sharing framework with regard to both storage capacity and power capacity. Applied Energy, 307: 118171.
DOI Google Scholar
61

Zheng, L., Zhou, B., Cao, Y. J., Or, S. W., Li, Y., Chan, K. W. (2022). Hierarchical distributed multi-energy demand response for coordinated operation of building clusters. Applied Energy, 308: 118362.
DOI Google Scholar
62
Fan, S., Xiao, J. C., Li, Z. Y., He, G. Y. (2021). Characterization and trading of energy level and energy shift considering virtual power plant. Journal of Modern Power Systems and Clean Energy, https://doi.org/10.35833/MPCE.2021.000192.
63

Park, S. W., Zhang, Z., Li, F. R., Son, S. Y. (2021). Peer-to-peer trading-based efficient flexibility securing mechanism to support distribution system stability. Applied Energy, 285: 116403.
DOI Google Scholar
64

Iria, J., Scott, P., Attarha, A., Gordon, D., Franklin, E. (2022). MV-LV network-secure bidding optimisation of an aggregator of prosumers in real-time energy and reserve markets. Energy, 242: 122962.
DOI Google Scholar
65

Baeyens, E., Bitar, E. Y., Khargonekar, P. P., Poolla, K. (2013). Coalitional aggregation of wind power. IEEE Transactions on Power Systems, 28: 3774–3784.
DOI Google Scholar
66

Dabbagh, S. R., Sheikh-El-Eslami, M. K. (2015). Risk-based profit allocation to DERs integrated with a virtual power plant using cooperative game theory. Electric Power Systems Research, 121: 368–378.
DOI Google Scholar
67

Rahmani-Dabbagh, S., Sheikh-El-Eslami, M. K. (2016). A profit sharing scheme for distributed energy resources integrated into a virtual power plant. Applied Energy, 184: 313–328.
DOI Google Scholar
68

Nguyen, H. T., Le, L. B. (2018). Bi-objective-based cost allocation for cooperative demand-side resource aggregators. IEEE Transactions on Smart Grid, 9: 4220–4235.
DOI Google Scholar
69

Nguyen, H. T., Le, L. B. (2018). Sharing profit from joint offering of a group of wind power producers in day ahead markets. IEEE Transactions on Sustainable Energy, 9: 1921–1934.
DOI Google Scholar
70

Chakraborty, P., Baeyens, E., Khargonekar, P. P. (2018). Cost causation based allocations of costs for market integration of renewable energy. IEEE Transactions on Power Systems, 33: 70–83.
DOI Google Scholar
71

Li, B. S., Wang, X., Shahidehpour, M., Jiang, C. W., Li, Z. Y. (2019). Robust bidding strategy and profit allocation for cooperative DSR aggregators with correlated wind power generation. IEEE Transactions on Sustainable Energy, 10: 1904–1915.
DOI Google Scholar
72

Zhang, L. Q., Xie, J., Chen, X. Y., Zhan, Y. S., Zhou, L. (2020). Cooperative game-based synergistic gains allocation methods for wind-solar-hydro hybrid generation system with cascade hydropower. Energies, 13: 3890.
DOI Google Scholar
73

Tan, Z. F., Li, H. H., Ju, L. W., Tan, Q. K. (2018). Joint scheduling optimization of virtual power plants and equitable profit distribution using shapely value theory. Mathematical Problems in Engineering, 2018: 3810492.
DOI Google Scholar
74

Chen, X. Y., Leung, K. C. (2020). Non-cooperative and cooperative optimization of scheduling with vehicle-to-grid regulation services. IEEE Transactions on Vehicular Technology, 69: 114–130.
DOI Google Scholar
75
Chakraborty, P., Baeyens, E., Khargonekar, P. P., Poolla, K. (2016). A cooperative game for the realized profit of an aggregation of renewable energy producers. In: Proceedings of the 2016 IEEE 55th Conference on Decision and Control, Las Vegas, NV, USA.
DOI
76

Robu, V., Chalkiadakis, G., Kota, R., Rogers, A., Jennings, N. R. (2016). Rewarding cooperative virtual power plant formation using scoring rules. Energy, 117: 19–28.
DOI Google Scholar
77

Khazaei, H., Zhao, Y. (2018). Indirect mechanism design for efficient and stable renewable energy aggregation. IEEE Transactions on Power Systems, 34: 1033–1042.
DOI Google Scholar
78

Grimm, V., Orlinskaya, G., Schewe, L., Schmidt, M., Zöttl, G. (2021). Optimal design of retailer-prosumer electricity tariffs using bilevel optimization. Omega, 102: 102327.
DOI Google Scholar
79

Ansarin, M., Ghiassi-Farrokhfal, Y., Ketter, W., Collins, J. (2020). The economic consequences of electricity tariff design in a renewable energy era. Applied Energy, 275: 115317.
DOI Google Scholar
80

Zhang, X. X. (2014). Optimal scheduling of critical peak pricing considering wind commitment. IEEE Transactions on Sustainable Energy, 5: 637–645.
DOI Google Scholar
81

Backe, S., Kara, G., Tomasgard, A. (2020). Comparing individual and coordinated demand response with dynamic and static power grid tariffs. Energy, 201: 117619.
DOI Google Scholar
82

Althaher, S., Mancarella, P., Mutale, J. (2015). Automated demand response from home energy management system under dynamic pricing and power and comfort constraints. IEEE Transactions on Smart Grid, 6: 1874–1883.
DOI Google Scholar
83

Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., Slootweg, J. G. (2019). On-line building energy optimization using deep reinforcement learning. IEEE Transactions on Smart Grid, 10: 3698–3708.
DOI Google Scholar
84

Shen, Y. W., Li, Y., Zhang, Q. W., Li, F. X., Wang, Z. (2021). Consumer psychology based optimal portfolio design for demand response aggregators. Journal of Modern Power Systems and Clean Energy, 9: 431–439.
DOI Google Scholar
85

Tsaousoglou, G., Sartzetakis, I., Makris, P., Efthymiopoulos, N., Varvarigos, E., Paterakis, N. G. (2022). Flexibility aggregation of temporally coupled resources in real-time balancing markets using machine learning. IEEE Transactions on Industrial Informatics, 18: 4342–4351.
DOI Google Scholar
86

Rigoni, V., Flynn, D., Keane, A. (2021). Coordinating demand response aggregation with LV network operational constraints. IEEE Transactions on Power Systems, 36: 979–990.
DOI Google Scholar
87

Mousavi, M., Wu, M. (2022). A DSO framework for market participation of DER aggregators in unbalanced distribution networks. IEEE Transactions on Power Systems, 37: 2247–2258.
DOI Google Scholar
88

Zheng, S. L., Sun, Y., Li, B., Qi, B., Shi, K., Li, Y. F., Tu, X. Z. (2020). Incentive-based integrated demand response for multiple energy carriers considering behavioral coupling effect of consumers. IEEE Transactions on Smart Grid, 11: 3231–3245.
DOI Google Scholar
89

Wang, F., Ge, X. X., Yang, P., Li, K. P., Mi, Z. Q., Siano, P., Duić, N. (2020). Day-ahead optimal bidding and scheduling strategies for DER aggregator considering responsive uncertainty under real-time pricing. Energy, 213: 118765.
DOI Google Scholar
90

Rashidizadeh-Kermani, H., Vahedipour-Dahraie, M., Shafie-Khah, M., Siano, P. (2020). A regret-based stochastic Bi-level framework for scheduling of DR aggregator under uncertainties. IEEE Transactions on Smart Grid, 11: 3171–3184.
DOI Google Scholar
91

Al-Awami, A. T., Amleh, N. A., Muqbel, A. M. (2017). Optimal demand response bidding and pricing mechanism with fuzzy optimization: Application for a virtual power plant. IEEE Transactions on Industry Applications, 53: 5051–5061.
DOI Google Scholar
92

Sarker, M. R., Ortega-Vazquez, M. A., Kirschen, D. S. (2015). Optimal coordination and scheduling of demand response via monetary incentives. IEEE Transactions on Smart Grid, 6: 1341–1352.
DOI Google Scholar
93

AlAshery, M. K., Xiao, D. L., Qiao, W. (2020). Second-order stochastic dominance constraints for risk management of a wind power producer’s optimal bidding strategy. IEEE Transactions on Sustainable Energy, 11: 1404–1413.
DOI Google Scholar
94

Zhu, J. Q., Xia, Y. R., Mo, X. M., Guo, Y., Chen, J. J. (2021). A bilevel bidding and clearing model incorporated with a pricing strategy for the trading of energy storage use rights. Energy, 235: 121338.
DOI Google Scholar
95

Chattopadhyay, D., Alpcan, T. (2014). A game-theoretic analysis of wind generation variability on electricity markets. IEEE Transactions on Power Systems, 29: 2069–2077.
DOI Google Scholar
96

Shafie-khah, M., Catalão, J. P. S. (2015). A stochastic multi-layer agent-based model to study electricity market participants behavior. IEEE Transactions on Power Systems, 30: 867–881.
DOI Google Scholar
97

Baringo, L., Conejo, A. J. (2016). Offering strategy of wind-power producer: A multi-stage risk-constrained approach. IEEE Transactions on Power Systems, 31: 1420–1429.
DOI Google Scholar
98

Sheikhahmadi, P., Bahramara, S., Moshtagh, J., Damavandi, M. Y. (2018). A risk-based approach for modeling the strategic behavior of a distribution company in wholesale energy market. Applied Energy, 214: 24–38.
DOI Google Scholar
99

Vatandoust, B., Ahmadian, A., Golkar, M. A., Elkamel, A., Almansoori, A., Ghaljehei, M. (2019). Risk-averse optimal bidding of electric vehicles and energy storage aggregator in day-ahead frequency regulation market. IEEE Transactions on Power Systems, 34: 2036–2047.
DOI Google Scholar
100

Guo, H. Y., Chen, Q. X., Xia, Q., Kang, C. Q. (2019). Electricity wholesale market equilibrium analysis integrating individual risk-averse features of generation companies. Applied Energy, 252: 113443.
DOI Google Scholar
101

Moret, F., Pinson, P., Papakonstantinou, A. (2020). Heterogeneous risk preferences in community-based electricity markets. European Journal of Operational Research, 287: 36–48.
DOI Google Scholar
102

Dai, T., Qiao, W. (2015). Optimal bidding strategy of a strategic wind power producer in the short-term market. IEEE Transactions on Sustainable Energy, 6: 707–719.
DOI Google Scholar
103

Kazemi, M., Zareipour, H., Ehsan, M., Rosehart, W. D. (2017). A robust linear approach for offering strategy of a hybrid electric energy company. IEEE Transactions on Power Systems, 32: 1949–1959.
DOI Google Scholar
104

Rezaei, N., Ahmadi, A., Khazali, A., Aghaei, J. (2019). Multiobjective risk-constrained optimal bidding strategy of smart microgrids: An IGDT-based normal boundary intersection approach. IEEE Transactions on Industrial Informatics, 15: 1532–1543.
DOI Google Scholar
105

Löhndorf, N., Wozabal, D. (2021). Gas storage valuation in incomplete markets. European Journal of Operational Research, 288: 318–330.
DOI Google Scholar
106

El Rahi, G., Etesami, S. R., Saad, W., Mandayam, N. B., Poor, H. V. (2019). Managing price uncertainty in prosumer-centric energy trading: A prospect-theoretic stackelberg game approach. IEEE Transactions on Smart Grid, 10: 702–713.
DOI Google Scholar
107

Prelec, D. (1998). The probability weighting function. Econometrica, 66: 497–527.
DOI Google Scholar
108

Kahneman, D., Knetsch, J. L., Thaler, R. (1986). Fairness as a constraint on profit seeking: Entitlements in the market. The American economic review, 76: 728–741.
Google Scholar
109

Gao, J. W., Ma, Z. Y., Guo, F. J. (2019). The influence of demand response on wind-integrated power system considering participation of the demand side. Energy, 178: 723–738.
DOI Google Scholar
110

Yang, J., Wu, F. Z., Yan, J., Lin, Y. J., Zhan, X. P., Chen, L., Liao, S. Y., Xu, J., Sun, Y. Z. (2020). Charging demand analysis framework for electric vehicles considering the bounded rationality behavior of users. International Journal of Electrical Power & Energy Systems, 119: 105952.
DOI Google Scholar
111
Gao, H., Zhang, F., Xiang, Y. M., Ye, S. Y., Liu, X. N., Liu, J. Y. (2021). Bounded rationality based multi-VPP trading in local energy market: A dynamic game approach with different trading targets. CSEE Journal of Power and Energy Systems, https://doi.org/10.17775/CSEEJPES.2021.01600.
DOI
112

Vahid-Pakdel, M. J., Ghaemi, S., Mohammadi-ivatloo, B., Salehi, J., Siano, P. (2019). Modeling noncooperative game of GENCOs’ participation in electricity markets with prospect theory. IEEE Transactions on Industrial Informatics, 15: 5489–5496.
DOI Google Scholar
113

Liu, Y. F., Sun, M. (2020). Application of duopoly multi-periodical game with bounded rationality in power supply market based on information asymmetry. Applied Mathematical Modelling, 87: 300–316.
DOI Google Scholar
114

Guo, H. Y., Chen, Q. X., Shahidehpour, M., Xia, Q., Kang, C. Q. (2022). Bidding behaviors of GENCOs under bounded rationality with renewable energy. Energy, 250: 123793.
DOI Google Scholar
115

Kekatos, V., Giannakis, G. B., Baldick, R. (2016). Online energy price matrix factorization for power grid topology tracking. IEEE Transactions on Smart Grid, 7: 1239–1248.
DOI Google Scholar
116

Birge, J. R., Hortaçsu, A., Pavlin, J. M. (2017). Inverse optimization for the recovery of market structure from market outcomes: An application to the MISO electricity market. Operations Research, 65: 837–855.
DOI Google Scholar
117

Zheng, K. D., Chen, Q. X., Wang, Y., Kang, C. Q., Xie, L. (2021). Unsupervised congestion status identification using LMP data. IEEE Transactions on Smart Grid, 12: 726–736.
DOI Google Scholar
118

Dehghanpour, K., Nehrir, M. H., Sheppard, J. W., Kelly, N. C. (2016). Agent-based modeling in electrical energy markets using dynamic Bayesian networks. IEEE Transactions on Power Systems, 31: 4744–4754.
DOI Google Scholar
119

Chen, R. D., Paschalidis, I. C., Caramanis, M. C., Andrianesis, P. (2019). Learning from past bids to participate strategically in day-ahead electricity markets. IEEE Transactions on Smart Grid, 10: 5794–5806.
DOI Google Scholar
120

Mitridati, L., Pinson, P. (2018). A Bayesian inference approach to unveil supply curves in electricity markets. IEEE Transactions on Power Systems, 33: 2610–2620.
DOI Google Scholar
121

Kiannejad, M., Salehizadeh, M. R., Oloomi-Buygi, M., Shafie-Khah, M. (2020). Artificial neural network approach for revealing market competitors’ behaviour. IET Generation, Transmission & Distribution, 14: 1292–1297.
DOI Google Scholar
122

Guo, H. Y., Chen, Q. X., Zheng, K. D., Xia, Q., Kang, C. Q. (2021). Forecast aggregated supply curves in power markets based on LSTM model. IEEE Transactions on Power Systems, 36: 5767–5779.
DOI Google Scholar
123

Zhao, H., Zhao, J. H., Qiu, J., Liang, G. Q., Wen, F. S., Xue, Y. S., Dong, Z. Y. (2021). Data-driven risk preference analysis in day-ahead electricity market. IEEE Transactions on Smart Grid, 12: 2508–2517.
DOI Google Scholar
124

Guo, H. Y., Chen, Q. X., Xia, Q., Kang, C. Q. (2021). Deep inverse reinforcement learning for objective function identification in bidding models. IEEE Transactions on Power Systems, 36: 5684–5696.
DOI Google Scholar
125
Tang, Q. H., Guo, H. Y., Chen, Q. X. (2022). Multi-market bidding behavior analysis of energy storage system based on inverse reinforcement learning. IEEE Transactions on Power Systems, https://doi.org/10.1109/TPWRS.2022.3150518.
DOI
126

Bakirtzis, A. G., Ziogos, N. P., Tellidou, A. C., Bakirtzis, G. A. (2007). Electricity producer offering strategies in day-ahead energy market with step-wise offers. IEEE Transactions on Power Systems, 22: 1804–1818.
DOI Google Scholar
127

Liu, S. N., Wang, M. Z., Kong, N., Hu, X. P. (2021). An enhanced branch-and-bound algorithm for bilevel integer linear programming. European Journal of Operational Research, 291: 661–679.
DOI Google Scholar
128

Soares, I., Alves, M. J., Henggeler Antunes, C. (2021). A deterministic bounding procedure for the global optimization of a bi-level mixed-integer problem. European Journal of Operational Research, 291: 52–66.
DOI Google Scholar
129

Liu, W. J., Chen, S. B., Hou, Y. H., Yang, Z. Y. (2021). Optimal reserve management of electric vehicle aggregator: discrete bilevel optimization model and exact algorithm. IEEE Transactions on Smart Grid, 12: 4003–4015.
DOI Google Scholar
130

Ye, Y. J., Papadaskalopoulos, D., Kazempour, J., Strbac, G. (2020). Incorporating non-convex operating characteristics into Bi-level optimization electricity market models. IEEE Transactions on Power Systems, 35: 163–176.
DOI Google Scholar
131
Zhong, W. F., Xie, K., Liu, Y., Xie, S. L., Xie, L. H. (2022). Nash mechanisms for market design based on distribution locational marginal prices. IEEE Transactions on Power Systems, https://doi.org/10.1109/TPWRS.2022.3152517.
DOI
132

Pereira, M. V., Granville, S., Fampa, M. H. C., Dix, R., Barroso, L. A. (2005). Strategic bidding under uncertainty: A binary expansion approach. IEEE Transactions on Power Systems, 20: 180–188.
DOI Google Scholar
133

Guo, H. Y., Chen, Q. X., Xia, Q., Kang, C. Q. (2020). Modeling strategic behaviors of renewable energy with joint consideration on energy and tradable green certificate markets. IEEE Transactions on Power Systems, 35: 1898–1910.
DOI Google Scholar
134

Shahmohammadi, A., Sioshansi, R., Conejo, A. J., Afsharnia, S. (2018). Market equilibria and interactions between strategic generation, wind, and storage. Applied Energy, 220: 876–892.
DOI Google Scholar
135

Kazempour, S. J., Conejo, A. J., Ruiz, C. (2013). Generation investment equilibria with strategic producers—Part I: Formulation. IEEE Transactions on Power Systems, 28: 2613–2622.
DOI Google Scholar
136
Ye, Y. J., Papadaskalopoulos, D., Yuan, Q., Tang, Y., Strbac, G. (2022). Multi-agent deep reinforcement learning for coordinated energy trading and flexibility services provision in local electricity markets. IEEE Transactions on Smart Grid, https://doi.org/10.1109/TSG.2022.3149266.
DOI
137

Namalomba, E., Hu, F. H., Shi, H. J. (2022). Agent based simulation of centralized electricity transaction market using bi-level and Q-learning algorithm approach. International Journal of Electrical Power & Energy Systems, 134: 107415.
DOI Google Scholar
138

Lehna, M., Hoppmann, B., Scholz, C., Heinrich, R. (2022). A Reinforcement Learning approach for the continuous electricity market of Germany: Trading from the perspective of a wind park operator. Energy and AI, 8: 100139.
DOI Google Scholar
139

Algarvio, H., Lopes, F. (2022). Agent-based retail competition and portfolio optimization in liberalized electricity markets: A study involving real-world consumers. International Journal of Electrical Power & Energy Systems, 137: 107687.
DOI Google Scholar
140

Zhou, Y., Shi, Z. Y., Wu, L. B. (2021). Green policy under the competitive electricity market: An agent-based model simulation in Shanghai. Journal of Environmental Management, 299: 113501.
DOI Google Scholar
141

Xu, S. Y., Chen, X. Y., Xie, J., Rahman, S., Wang, J. X., Hui, H. X., Chen, T. (2021). Agent-based modeling and simulation for the electricity market with residential demand response. CSEE Journal of Power and Energy Systems, 7: 368–380.
Google Scholar
142

Mason, K., Qadrdan, M., Jenkins, N. (2021). Investing in generation and storage capacity in a liberalised electricity market: An agent based approach. Applied Energy, 294: 116905.
DOI Google Scholar
143

Du, Y., Li, F. X., Zandi, H. L., Xue, Y. S. (2021). Approximating Nash equilibrium in day-ahead electricity market bidding with multi-agent deep reinforcement learning. Journal of Modern Power Systems and Clean Energy, 9: 534–544.
DOI Google Scholar
144

Ye, Y. J., Qiu, D. W., Sun, M. Y., Papadaskalopoulos, D., Strbac, G. (2020). Deep reinforcement learning for strategic bidding in electricity markets. IEEE Transactions on Smart Grid, 11: 1343–1355.
DOI Google Scholar
145

Kiran, P., Chandrakala, K. V. (2020). New interactive agent based reinforcement learning approach towards smart generator bidding in electricity market with micro grid integration. Applied Soft Computing, 97: 106762.
DOI Google Scholar
146
Liu, Y. K., Zhang, D. X., Deng, C. Y., Wang, X. Y. (2020). Deep reinforcement learning approach for autonomous agents in consumer-centric electricity market. In: Proceedings of the 2020 5th IEEE International Conference on Big Data Analytics, Xiamen, China.
DOI
147

Liang, Y. C., Guo, C. L., Ding, Z. H., Hua, H. C. (2020). Agent-based modeling in electricity market using deep deterministic policy gradient algorithm. IEEE Transactions on Power Systems, 35: 4180–4192.
DOI Google Scholar
148

Ye, Y. J., Qiu, D. W., Li, J., Strbac, G. (2019). Multi-period and multi-spatial equilibrium analysis in imperfect electricity markets: A novel multi-agent deep reinforcement learning approach. IEEE Access, 7: 130515–130529.
DOI Google Scholar
149

Wang, J. D., Wu, J. H., Che, Y. B. (2019). Agent and system dynamics-based hybrid modeling and simulation for multilateral bidding in electricity market. Energy, 180: 444–456.
DOI Google Scholar
150
Fraunholz, C., Keles, D., Fichtner, W. (2019). Agent-based generation and storage expansion planning in interconnected electricity markets. In: Proceedings of the 2019 16th International Conference on the European Energy Market (EEM), Ljubljana, Slovenia.
DOI
151

Jiang, Z. Q., Ai, Q. (2017). Agent-based simulation for symmetric electricity market considering price-based demand response. Journal of Modern Power Systems and Clean Energy, 5: 810–819.
DOI Google Scholar
152

Esmaeili Aliabadi, D., Kaya, M., Sahin, G. (2017). Competition, risk and learning in electricity markets: An agent-based simulation study. Applied Energy, 195: 1000–1011.
DOI Google Scholar
153

Aliabadi, D. E., Kaya, M., Şahin, G. (2017). An agent-based simulation of power generation company behavior in electricity markets under different market-clearing mechanisms. Energy Policy, 100: 191–205.
DOI Google Scholar
154

Pinto, T., Sousa, T. M., Praça, I., Vale, Z., Morais, H. (2016). Support Vector Machines for decision support in electricity markets׳ strategic bidding. Neurocomputing, 172: 438–445.
DOI Google Scholar
155

Gupta, S., Kekatos, V., Saad, W. (2019). Optimal real-time coordination of energy storage units as a voltage-constrained game. IEEE Transactions on Smart Grid, 10: 3883–3894.
DOI Google Scholar
156

Contreras-Ocaña, J. E., Ortega-Vazquez, M. A., Zhang, B. S. (2019). Participation of an energy storage aggregator in electricity markets. IEEE Transactions on Smart Grid, 10: 1171–1183.
DOI Google Scholar
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 06 June 2022
Revised: 27 June 2022
Accepted: 17 July 2022
Published: 01 August 2022
Issue date: June 2022

Copyright

© The author(s) 2022

Acknowledgements

Acknowledgements

This work was supported by NSFC-NWO International Cooperation project under Grant 52161135201 and by National Natural and Science Foundation of China under Grant U2066205.

Rights and permissions

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return