Skip to main content
SHARE
Publication

Reinforcement-learning-based Smart Water Heater Control: An Actual Deployment

by Kadir Amasyali, Kuldeep R Kurte, Helia Zandi, Jeffrey Munk
Publication Type
Conference Paper
Book Title
2023 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT)
Publication Date
Page Numbers
1 to 5
Publisher Location
New Jersey, United States of America
Conference Name
The 2023 North American Innovative Smart Grid Technologies Conference (ISGT NA 2023)
Conference Location
Washington, District of Columbia, United States of America
Conference Sponsor
IEEE
Conference Date
-

Utilizing smart control algorithms for electric water heaters (EWHs) is essential for fully harnessing the demand response (DR) potential of EWHs. For this reason, the use of reinforcement learning (RL) algorithms for EWHs has received increasing attention in recent years. However, existing RL approaches are either simulation-based or use pretrained RL agents. To this end, this paper presents the real-world deployment of a set of model-free RL approaches that aim to minimize the electricity cost of a EWH under a time-of-use electricity pricing policy using standard DR commands (e.g., shed, load up). The experiment results showed that the RL agents can help save electricity cost in the range of 11% to 14% compared to the baseline operation. This study demonstrated that RL-based EWH controllers can be deployed in real world without any prior training and can still save electricity cost.