Strathprints logo
Strathprints Home | Open Access | Browse | Search | User area | Copyright | Help | Library Home | SUPrimo

Robot introspection through learned hidden Markov models

Fox, M. and Ghallab, M. and Infantes, G. and Long, D. (2006) Robot introspection through learned hidden Markov models. Artificial Intelligence, 170 (2). pp. 59-113. ISSN 0004-3702

[img]
Preview
PDF (strathprints002772.pdf)
Download (476Kb) | Preview

    Abstract

    In this paper we describe a machine learning approach for acquiring a model of a robot behaviour from raw sensor data. We are interested in automating the acquisition of behavioural models to provide a robot with an introspective capability. We assume that the behaviour of a robot in achieving a task can be modelled as a finite stochastic state transition system. Beginning with data recorded by a robot in the execution of a task, we use unsupervised learning techniques to estimate a hidden Markov model (HMM) that can be used both for predicting and explaining the behaviour of the robot in subsequent executions of the task. We demonstrate that it is feasible to automate the entire process of learning a high quality HMM from the data recorded by the robot during execution of its task.The learned HMM can be used both for monitoring and controlling the behaviour of the robot. The ultimate purpose of our work is to learn models for the full set of tasks associated with a given problem domain, and to integrate these models with a generative task planner. We want to show that these models can be used successfully in controlling the execution of a plan. However, this paper does not develop the planning and control aspects of our work, focussing instead on the learning methodology and the evaluation of a learned model. The essential property of the models we seek to construct is that the most probable trajectory through a model, given the observations made by the robot, accurately diagnoses, or explains, the behaviour that the robot actually performed when making these observations. In the work reported here we consider a navigation task. We explain the learning process, the experimental setup and the structure of the resulting learned behavioural models. We then evaluate the extent to which explanations proposed by the learned models accord with a human observer's interpretation of the behaviour exhibited by the robot in its execution of the task.

    Item type: Article
    ID code: 2772
    Keywords: robotics, robot, machine learning, hidden Markov model, learning, artificial intelligence, Electronic computers. Computer science, Artificial Intelligence
    Subjects: Science > Mathematics > Electronic computers. Computer science
    Department: Faculty of Science > Computer and Information Sciences
    Related URLs:
    Depositing user: Professor Maria Fox
    Date Deposited: 03 Apr 2007
    Last modified: 05 Sep 2014 13:30
    URI: http://strathprints.strath.ac.uk/id/eprint/2772

    Actions (login required)

    View Item

    Fulltext Downloads: