Published:
Author: Jaimie Patterson
Category:
Three-panel demonstration of a robotic arm system showing motion tracking, workspace mapping, and gripper control, with a wider view of the lab setup below."
"Remote-controlled critical tasks, such as those in surgery or disaster response, could be performed more effectively—regardless of the operator's inherent spatial skills."—Tsung-Chi Lin, postdoctoral fellow at the Malone Center for Engineering in Healthcare

Operating on a patient thousands of miles away, exploring faraway planets, safely disposing of hazardous materials—these previously impossible or dangerous tasks are now achievable through teleoperation, the process of remote-controlling robots. However, successful teleoperation requires proper training.

Since human operators come from diverse backgrounds and have varying levels of robotics experience and spatial planning abilities, one-size-fits-all training is ineffective. To address this, a team of Johns Hopkins researchers has developed a targeted training approach that achieves consistent performance across users, regardless of their inherent ability to visualize objects and actions in 3D.

The team presented its paper, “Reducing Performance Variability and Overcoming Limited Spatial Ability: Targeted Training for Remote Robot Teleoperation.” at the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems in Abu Dhabi, U.A.E.

“Our method ensures that everyone, regardless of innate ability or experience with robots, can accurately operate a robot remotely,” says co-lead author Tsung-Chi Lin, a postdoctoral fellow at the Malone Center for Engineering in Healthcare. “Our personalized approach levels the playing field and has the potential to make this technology more accessible to and reliable with a wider range of applications.”

Joining Lin on this study are Juo-Tung Chen, a master’s student in robotics and the other co-lead author of the paper, and Chien-Ming Huang, an assistant professor of computer science.

Traditional teleoperation training has relied on two limited approaches: either users self-identifying their skill gaps or working directly with a small number of expert trainers. In contrast, the Hopkins team’s approach consists of two simple steps: first, assessing users’ natural abilities, then providing training modules tailored to their individual skill gaps.

The team’s system evaluates users’ abilities in three key areas essential for remote manipulation tasks: moving and rotating a robot’s base, positioning its arm within a specific space, and controlling its gripper to grasp and release objects. Then, it matches users to training modules that focus specifically on the areas in which they need improvement.

The researchers tested their approach by having study participants operate a robotic arm to prepare medications remotely. Compared to free-form training, the team’s targeted training method demonstrated a more consistent performance, with users reporting higher confidence levels.

“Our results also suggest that our method reduces the impact of natural spatial ability on task completion time and performance,” says Lin.

This means that anyone—regardless of their innate ability to visualize a robot’s movements in 3D—can benefit from this targeted training approach.

“In practical terms, this could improve the reliability and safety of teleoperation in high-stakes environments like health care or hazardous material handling,” says Lin. “Remote-controlled critical tasks, such as those in surgery or disaster response, could be performed more effectively—regardless of the operator’s inherent spatial skills.”

The researchers plan to adapt their training method for use with more complex robots. They also aim to investigate this method’s long-term skill retention to inform the development of more comprehensive teleoperation training programs.