Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality. 2023

Zheyuan Zhang, and Chen Qian
The Laboratory for Computational Sensing and Robotics, Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States.

Teleoperation is an essential component in fields such as medicine and manufacturing, enabling human operators to interact with remote robotic systems. A wearable device has been designed and manufactured to enhance sensitivity, wearability, and synchronization, providing users with the ability to experience the sensation of grasping virtual objects. The device incorporates a 2-DoF robotic arm, haptic sensors for finger gestures, and a Unity-powered virtual scene system. Its effectiveness was evaluated through user experiments, where participants were asked to rank the weights of three virtual balls and identify the direction of force applied to a virtual ball in separate tests. Additionally, the device's ability to render various shapes was also examined. The experiments showed that 73.3% of participants accurately ranked the balls by mass, and an overall correctness rate of 87.3% was achieved for force direction identification. For shape rendering, the device yielded more accurate results for simple objects like spheres, whereas rendering more complex objects such as cups and cones was challenging. The findings indicate that this wearable device has potential applications in haptic feedback and virtual reality contexts. Despite the challenges with complex shape rendering, the device shows promising capability in enhancing the user's immersive experience in virtual environments.

UI MeSH Term Description Entries

Related Publications

Zheyuan Zhang, and Chen Qian
May 2021, IEEE transactions on visualization and computer graphics,
Zheyuan Zhang, and Chen Qian
January 2016, IEEE transactions on haptics,
Zheyuan Zhang, and Chen Qian
January 2020, IEEE transactions on haptics,
Zheyuan Zhang, and Chen Qian
July 2013, Surgical endoscopy,
Zheyuan Zhang, and Chen Qian
January 2021, IEEE transactions on haptics,
Zheyuan Zhang, and Chen Qian
January 2018, Frontiers in robotics and AI,
Zheyuan Zhang, and Chen Qian
January 2024, Research (Washington, D.C.),
Zheyuan Zhang, and Chen Qian
March 2024, IEEE transactions on visualization and computer graphics,
Zheyuan Zhang, and Chen Qian
January 2021, Journal of rehabilitation and assistive technologies engineering,
Zheyuan Zhang, and Chen Qian
January 2018, IEEE transactions on haptics,
Copied contents to your clipboard!