Control of a point absorber using reinforcement learning

Anderlini, Enrico and Forehand, David I.M. and Stansell, Paul and Xiao, Qing and Abusara, Mohammad (2016) Control of a point absorber using reinforcement learning. IEEE Transactions on Sustainable Energy, 7 (4). pp. 1681-1690. ISSN 1949-3037 (https://doi.org/10.1109/TSTE.2016.2568754)

[thumbnail of Anderlini-etal-IEEE-TOSE-2016-Control-of-a-point-absorber-using-reinforcement]
Preview
 Text. Filename: Anderlini_etal_IEEE_TOSE_2016_Control_of_a_point_absorber_using_reinforcement.pdf
Final Published Version
License: Creative Commons Attribution 3.0 logo
Download (1MB)| Preview

Abstract

This work presents the application of reinforcement learning for the optimal resistive control of a point absorber. The model-free Q-learning algorithm is selected in order to maximise energy absorption in each sea state. Step changes are made to the controller damping, observing the associated penalty, for excessive motions, or reward, i.e. gain in associated power. Due to the general periodicity of gravity waves, the absorbed power is averaged over a time horizon lasting several wave periods. The performance of the algorithm is assessed through the numerical simulation of a point absorber subject to motions in heave in both regular and irregular waves. The algorithm is found to converge towards the optimal controller damping in each sea state. Additionally, the model-free approach ensures the algorithm can adapt to changes to the device hydrodynamics over time and is unbiased by modelling errors.

ORCID iDs

Anderlini, Enrico ORCID logoORCID: https://orcid.org/0000-0002-7353-2134, Forehand, David I.M., Stansell, Paul, Xiao, Qing ORCID logoORCID: https://orcid.org/0000-0001-8512-5299 and Abusara, Mohammad;
CORE (COnnecting REpositories)