File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/TPWRS.2022.3217922
- Scopus: eid_2-s2.0-85141477158
- WOS: WOS:001054600200065
- Find via
Supplementary
- Citations:
- Appears in Collections:
Article: Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading
Title | Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading |
---|---|
Authors | |
Keywords | continuous double auction market mean-field approximation multi-agent reinforcement learning multi-energy systems Peer-to-peer energy trading |
Issue Date | 1-Sep-2023 |
Publisher | Institute of Electrical and Electronics Engineers |
Citation | IEEE Transactions on Power Systems, 2023, v. 38, n. 5, p. 4853-4866 How to Cite? |
Abstract | With increasing numbers of prosumers employed with multi-energy systems (MES) towards higher energy utilization efficiency, an advanced energy management scheme is becoming increasingly important. The incorporation of MES into the existential energy market holds promise for future power systems. The continuous double auction (CDA) market, in a decentralized manner, makes it ideal for enabling peer-to-peer (P2P) energy trading due to its high transparency and efficiency. However, the CDA market is difficult to model when considering the highly stochastic and dynamic behaviors of market participants. For this reason, we formulate this task as a Decentralized Partially Observed Markov Decision Process and propose a novel multi-agent reinforcement learning method that allows each prosumer agent to stabilize the training performance with mean-field approximation and also to maintain the scalability and privacy with market public information. Case studies constructed on a real-world scenario of 100 prosumers show that our method captures the economic benefits of the P2P energy trading paradigm without violating the prosumers' privacy, and outperforms the state-of-the-art methods in terms of policy performance, scalability, and computational performance. |
Persistent Identifier | http://hdl.handle.net/10722/337528 |
ISSN | 2021 Impact Factor: 7.326 2020 SCImago Journal Rankings: 3.312 |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Qiu, DW | - |
dc.contributor.author | Wang, JH | - |
dc.contributor.author | Dong, ZH | - |
dc.contributor.author | Wang, Y | - |
dc.contributor.author | Strbac, G | - |
dc.date.accessioned | 2024-03-11T10:21:36Z | - |
dc.date.available | 2024-03-11T10:21:36Z | - |
dc.date.issued | 2023-09-01 | - |
dc.identifier.citation | IEEE Transactions on Power Systems, 2023, v. 38, n. 5, p. 4853-4866 | - |
dc.identifier.issn | 0885-8950 | - |
dc.identifier.uri | http://hdl.handle.net/10722/337528 | - |
dc.description.abstract | With increasing numbers of prosumers employed with multi-energy systems (MES) towards higher energy utilization efficiency, an advanced energy management scheme is becoming increasingly important. The incorporation of MES into the existential energy market holds promise for future power systems. The continuous double auction (CDA) market, in a decentralized manner, makes it ideal for enabling peer-to-peer (P2P) energy trading due to its high transparency and efficiency. However, the CDA market is difficult to model when considering the highly stochastic and dynamic behaviors of market participants. For this reason, we formulate this task as a Decentralized Partially Observed Markov Decision Process and propose a novel multi-agent reinforcement learning method that allows each prosumer agent to stabilize the training performance with mean-field approximation and also to maintain the scalability and privacy with market public information. Case studies constructed on a real-world scenario of 100 prosumers show that our method captures the economic benefits of the P2P energy trading paradigm without violating the prosumers' privacy, and outperforms the state-of-the-art methods in terms of policy performance, scalability, and computational performance. | - |
dc.language | eng | - |
dc.publisher | Institute of Electrical and Electronics Engineers | - |
dc.relation.ispartof | IEEE Transactions on Power Systems | - |
dc.rights | This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. | - |
dc.subject | continuous double auction market | - |
dc.subject | mean-field approximation | - |
dc.subject | multi-agent reinforcement learning | - |
dc.subject | multi-energy systems | - |
dc.subject | Peer-to-peer energy trading | - |
dc.title | Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading | - |
dc.type | Article | - |
dc.identifier.doi | 10.1109/TPWRS.2022.3217922 | - |
dc.identifier.scopus | eid_2-s2.0-85141477158 | - |
dc.identifier.volume | 38 | - |
dc.identifier.issue | 5 | - |
dc.identifier.spage | 4853 | - |
dc.identifier.epage | 4866 | - |
dc.identifier.eissn | 1558-0679 | - |
dc.identifier.isi | WOS:001054600200065 | - |
dc.publisher.place | PISCATAWAY | - |
dc.identifier.issnl | 0885-8950 | - |