Picture of athlete cycling

Open Access research with a real impact on health...

The Strathprints institutional repository is a digital archive of University of Strathclyde's Open Access research outputs. Strathprints provides access to thousands of Open Access research papers by Strathclyde researchers, including by researchers from the Physical Activity for Health Group based within the School of Psychological Sciences & Health. Research here seeks to better understand how and why physical activity improves health, gain a better understanding of the amount, intensity, and type of physical activity needed for health benefits, and evaluate the effect of interventions to promote physical activity.

Explore open research content by Physical Activity for Health...

Comparing policy gradient and value function based reinforcement learning methods in simulated electrical power trade

Lincoln, Richard and Galloway, Stuart and Stephen, Bruce and Burt, Graeme (2012) Comparing policy gradient and value function based reinforcement learning methods in simulated electrical power trade. IEEE Transactions on Power Systems, 27 (1). pp. 373-380. ISSN 0885-8950

[img] PDF
tps_policy_paper_submit_final_040711.pdf - Preprint

Download (200kB)

Abstract

In electrical power engineering, reinforcement learning algorithms can be used to model the strategies of electricity market participants. However, traditional value function based reinforcement learning algorithms suffer from convergence issues when used with value function approximators. Function approximation is required in this domain to capture the characteristics of the complex and continuous multivariate problem space. The contribution of this paper is the comparison of policy gradient reinforcement learning methods, using artificial neural networks for policy function approximation, with traditional value function based methods in simulations of electricity trade. The methods are compared using an AC optimal power flow based power exchange auction market model and a reference electric power system model.