Designing an adaptable benchmark and competition simulation for integrated planning and execution

Nemiro, Liudvikas and Canal, Gerard and Lima, Oscar and Cashmore, Michael and Roberts, Mark (2021) Designing an adaptable benchmark and competition simulation for integrated planning and execution. In: The International Conference on Automated Planning and Scheduling 2021, 2021-08-02 - 2021-08-13, Virtual.

[thumbnail of Nemiro-etal-ICASPS-2021-Designing-an-adaptable-benchmark-and-competition-simulation]
Preview
Text. Filename: Nemiro_etal_ICASPS_2021_Designing_an_adaptable_benchmark_and_competition_simulation.pdf
Accepted Author Manuscript

Download (154kB)| Preview

Abstract

Effectively using a planning system as the executive of an agent acting in real time poses a variety of challenges in integrating planning and execution. Many integrated systems have been developed with a focus on particular challenges, and it has been typically difficult to test, benchmark, and compare these systems. To do so requires a benchmark that has transparent and well-defined rules, and can be adapted to exhibit the problem characteristics of interest. In this paper, we propose a new benchmark simulation for integrated planning and execution, designed to be accessible and adaptive. We describe the simple core scenario of the simulation and how it can be configured to present more challenging scenarios. We describe our plans for the development of the simulation as a competition, benchmarking, and teaching tool, and encourage the community to contribute to its design.