Optimal energy management for residential house aggregators with uncertain user behaviors using deep reinforcement learning

Tools

Lin, Yujun and Yan, Linfang and Hui, Hongxun and Yang, Qiufan and Zhou, Jianyu and Chen, Yin and Chen, Xia and Wen, Jinyu (2025) Optimal energy management for residential house aggregators with uncertain user behaviors using deep reinforcement learning. IEEE Transactions on Industry Applications, 61 (6). pp. 8736-8747. ISSN 0093-9994 (https://doi.org/10.1109/tia.2025.3577145)

[thumbnail of Lin-etal-2025-Optimal-energy-management-for-residential-house-aggregators]
Preview
 Text. Filename: Lin-etal-2025-Optimal-energy-management-for-residential-house-aggregators.pdf
Accepted Author Manuscript
License: Creative Commons Attribution 4.0 logo
Download (754kB)| Preview

Abstract

This paper addresses the home energy management (HEM) problem for a large number of residential houses, which can be regarded as a high-dimensional optimization problem. To cope with the high-dimensional issue, the concept of the aggregator is utilized to reduce the state and action space. And a two-stage deep reinforcement learning (DRL) based approach is proposed for the aggregators to track the schedule from the superior grid and guarantee the operation constraints. In the first stage, a DRL control agent is set to learn the optimal scheduling strategy interacting with the environment based on the soft-actor-critic (SAC) framework and generate the aggregate control actions. In the second stage, the aggregate control actions are disaggregated to individual appliances considering the users' behaviors. The uncertainty of the EV charging demand is quantitatively described by the driver's experience. An aggregate anxiety concept is introduced to characterize both the driver's anxiety on the EV's range and uncertain events. Finally, simulation studies verify the effectiveness of the proposed approach under dynamic user behaviors, and the comparisons also show the superiority of the proposed approach over the method mentioned in benchmarks.

ORCID iDs

Lin, Yujun, Yan, Linfang, Hui, Hongxun, Yang, Qiufan, Zhou, Jianyu, Chen, Yin ORCID logoORCID: https://orcid.org/0000-0002-3351-5065, Chen, Xia and Wen, Jinyu;
CORE (COnnecting REpositories)