Towards explanations of plan execution for human-robot teaming

Moon, Jiyoun and Magazzeni, Daniele and Cashmore, Michael and Buksz, Dorian and Lee, Beom-Hee and Moon, Yong-Seon and Roh, Sang-Hyun; (2019) Towards explanations of plan execution for human-robot teaming. In: SDMM19 : 1st International Workshop on the Semantic Descriptor, Semantic Modeling and Mapping for Humanlike Perception and Navigation of Mobile Robots toward Large Scale Long-Term Autonomy. CEUR Workshop Proceedings, CHN, pp. 58-64.

[thumbnail of Moon-etal-SDMM-2019-Towards-explanations-of-plan-execution-for-human-robot-teaming]
Preview
 Text. Filename: Moon_etal_SDMM_2019_Towards_explanations_of_plan_execution_for_human_robot_teaming.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

Human-robot teaming is inevitable in various applications ranging from manufacturing to field robotics because of the advantages of adaptability and high flexibility. To become an effective team, knowledge regarding plan execution needs to be shared by verbalization. In this respect, semantic scene understanding in natural language is one of the most fundamental components for information sharing between humans and heterogeneous robots, as robots can perceive the surrounding environment in a form that both humans and other robots can understand. In this paper, we introduce semantic scene understanding methods for verbalization of plan execution. We generate sentences and scene graphs, which is a natural language grounded graph over the detected objects and their relationships, with the graph map generated using a robot mapping algorithm. Experiments were performed to verify the effectiveness of the proposed methods.

ORCID iDs

Moon, Jiyoun, Magazzeni, Daniele, Cashmore, Michael ORCID logoORCID: https://orcid.org/0000-0002-8334-4348, Buksz, Dorian, Lee, Beom-Hee, Moon, Yong-Seon and Roh, Sang-Hyun;
CORE (COnnecting REpositories)