Energy management in microgrid based on deep reinforcement learning with expert knowledge

Wenjing Zhang; Hong Qiao; Xianyong Xu; Junxingxu Chen; Jian Xiao; Keren Zhang; Yanbo Long; YuanJun Zuo

doi:10.1117/12.2662727

9 December 2022 Energy management in microgrid based on deep reinforcement learning with expert knowledge

Wenjing Zhang, Hong Qiao, Xianyong Xu, Junxingxu Chen, Jian Xiao, Keren Zhang, Yanbo Long, YuanJun Zuo

Proceedings Volume 12492, International Workshop on Automation, Control, and Communication Engineering (IWACCE 2022); 124920Z (2022) https://doi.org/10.1117/12.2662727
Event: International Workshop on Automation, Control, and Communication Engineering (IWACCE 2022), 2022, Wuhan, China

Abstract

Microgrid is an effective way to improve the utilization rate of renewable energy and is an indispensable part of recent power networks. In microgrids, the deployment of energy management systems (EMS) ensures stable operation and maximizes energy efficiency. Due to the uncertainty of non-steerable generation and non-flexible consumption in the microgrid, it is challenging to design an energy management algorithm to schedule the steerable generators and storage. To address this problem, energy management system is modeled as a Markov Decision Process (MDP) with continuous action space in this paper. Then an off-line reinforcement learning algorithm is leveraged to help EMS make scheduling decisions. Compared with other EMS schemes based on deep reinforcement learning, our method can effectively utilize the optimal decision data generated by mathematical programming, i.e., expert knowledge, to improve learning efficiency and decision-making ability. Simulation based on real world data verifies that the proposed algorithm has better performance than other reinforcement learning algorithms.

Citation Download Citation

Wenjing Zhang, Hong Qiao, Xianyong Xu, Junxingxu Chen, Jian Xiao, Keren Zhang, Yanbo Long, and YuanJun Zuo "Energy management in microgrid based on deep reinforcement learning with expert knowledge", Proc. SPIE 12492, International Workshop on Automation, Control, and Communication Engineering (IWACCE 2022), 124920Z (9 December 2022); https://doi.org/10.1117/12.2662727

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available