A modular teleoperation system for reliable and safer robotic manipulation with integrated force and visual feedback

Tools

Khedr, Mohamed and Yang, Erfu; (2025) A modular teleoperation system for reliable and safer robotic manipulation with integrated force and visual feedback. In: 2025 30th International Conference on Automation and Computing (ICAC). IEEE, GBR. ISBN 9798331525453 (https://doi.org/10.1109/ICAC65379.2025.11196247)

[thumbnail of Khedr-Yang-2025-A-modular-teleoperation-system-for-reliable-and-safer-robotic-manipulation]
Preview
 Text. Filename: Khedr-Yang-2025-A-modular-teleoperation-system-for-reliable-and-safer-robotic-manipulation.pdf
Accepted Author Manuscript
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

This paper presents a new modular teleoperation system which is able to integrate robot manipulator, gripper, dual force sensors, and camera to provide both force and visual feedback for enhanced operator awareness during contact-rich robotic manipulation. A custom graphical user interface is also designed to enable real-time control, supported by force and visual feedback. The system architecture is modular and distributed, using Ethernet and data distribution service communication to achieve the synchronised sensor-actuation interaction between the working devices. The unique addition of vertically stacked force sensors provides the operator with tactile-like insight into object alignment, symmetry, and surface contact. To validate the proposed system, experiments are conducted with ROS2, a UR10e collaborative robot, Robotiq 2F-85 gripper, load cells, Intel Realsense camera, and a diverse set of objects. The operator’s performance is evaluated across multiple trials per object. The results show that the system enhances the teleoperation processes and facilitates the grasping positioning, while ensuring safe placing and releasing of the grasped objects.

ORCID iDs

Khedr, Mohamed ORCID logoORCID: https://orcid.org/0000-0003-3571-7450 and Yang, Erfu ORCID logoORCID: https://orcid.org/0000-0003-1813-5950;
CORE (COnnecting REpositories)