Using machine learning for decreasing state uncertainty in planning

Krivic, Senka and Cashmore, Michael and Magazzeni, Daniele and Szedmak, Sandor and Piater, Justus (2020) Using machine learning for decreasing state uncertainty in planning. Journal of Artificial Intelligence Research, 69. pp. 765-806. ISSN 1076-9757 (https://doi.org/10.1613/JAIR.1.11567)

[thumbnail of Krivic-etal-JAIR-2020-Using-machine-learning-for-decreasing-state-uncertainty]
Preview
 Text. Filename: Krivic_etal_JAIR_2020_Using_machine_learning_for_decreasing_state_uncertainty.pdf
Accepted Author Manuscript
Download (1MB)| Preview

Abstract

We present a novel approach for decreasing state uncertainty in planning prior to solving the planning problem. This is done by making predictions about the state based on currently known information, using machine learning techniques. For domains where uncertainty is high, we define an active learning process for identifying which information, once sensed, will best improve the accuracy of predictions. We demonstrate that an agent is able to solve problems with uncertainties in the state with less planning effort compared to standard planning techniques. Moreover, agents can solve problems for which they could not find valid plans without using predictions. Experimental results also demonstrate that using our active learning process for identifying information to be sensed leads to gathering information that improves the prediction process.

CORE (COnnecting REpositories)