A Framework for Customizable Multi-User Teleoperated Control

Adnan Munawar, Jie Ying Wu, Russell H. Taylor, Peter Kazanzides, Gregory S. Fischer

Research output: Contribution to journalArticlepeer-review


Traditional teleoperation (leader/follower) systems primarily focus on one operator controlling one remote robot, but as robots become ubiquitous, there is an increasing need for multiple operators, including autonomous agents, to collaboratively control multiple robots. However, existing teleoperation frameworks do not inherently support the variety of possible collaborations, such as multiple operators, each with an input device (leader), controlling a robot and camera or different degrees of freedom of a single robot (follower). The same concept applies to teleoperating robots in a simulation environment through physical input devices. In this letter, we extend our novel simulation framework that is capable of incorporating multiple input devices asynchronously with a real-Time dynamic simulation to incorporate a customizable shared control. For this purpose, we have identified and implemented a sufficient set of coordinate frames to encapsulate the pairing of multiple leaders, followers and cameras in a shared asynchronous manner with force feedback. We demonstrate the utility of this framework in accelerating user training, ease of learning, and enhanced task completion times through shared control by a supervisor.

Original languageEnglish (US)
Article number9364683
Pages (from-to)3256-3263
Number of pages8
JournalIEEE Robotics and Automation Letters
Issue number2
StatePublished - Apr 2021


  • Medical robots and systems
  • simulation and animation
  • telerobotics and teleoperation

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Biomedical Engineering
  • Human-Computer Interaction
  • Mechanical Engineering
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence


Dive into the research topics of 'A Framework for Customizable Multi-User Teleoperated Control'. Together they form a unique fingerprint.

Cite this