Deep reinforcement learning for plan execution

Valle, Gonzalo Montesino and Cashmore, Michael (2022) Deep reinforcement learning for plan execution. In: IntEx Workshop on Integrated Planning, Acting, and Execution, 2022-06-17 - 2022-06-17, Virtual.

[thumbnail of Valle-Cashmore-IntEx-2022-Deep-reinforcement-learning-for-plan-execution]
Preview
 Text. Filename: Valle_Cashmore_IntEx_2022_Deep_reinforcement_learning_for_plan_execution.pdf
Accepted Author Manuscript
License: Strathprints license 1.0
Download (1MB)| Preview

Abstract

There are many different methods for the deliberative control of autonomous systems in stochastic environments, each with different strengths and limitations. Reinforcement Learning can provide robust performance in unpredictable environments, but its decisions are often not predictable. In contrast, Automated Planning can provide explicable and transparent behaviour but its performance drops when the environment is uncertain. In this paper we discuss an approach to plan execution through reinforcement learning by training an agent to follow predetermined plans. The implementation of the approach leads to the complex task of defining evaluation metrics that describe the desired behaviour. We describe the implementation of this approach as a set of agents, which differ in their reward function, and were trained and evaluated in three scenarios in which plan execution can deviate and be recovered.

ORCID iDs

Valle, Gonzalo Montesino and Cashmore, Michael ORCID logoORCID: https://orcid.org/0000-0002-8334-4348;
CORE (COnnecting REpositories)