TY - GEN
T1 - RoSTAR
T2 - 22nd IEEE International Workshop on Multimedia Signal Processing, MMSP 2020
AU - Xue Er Shamaine, Chung
AU - Qiao, Yuansong
AU - Henry, John
AU - McNevin, Ken
AU - Murray, Niall
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/9/21
Y1 - 2020/9/21
N2 - Real world virtual world communication and interaction will be a cornerstone of future intelligent manufacturing ecosystems. Human robotic interaction is considered to be the basic element of factories of the future. Despite the advancement of different technologies such as wearables and Augmented Reality (AR), human-robot interaction (HRI) is still extremely challenging. Whilst progress has been made in the development of different mechanisms to support HRI, there are issues with cost, naturalistic and intuitive interaction, and communication across heterogeneous systems. To mitigate these limitations, RoSTAR is proposed. RoSTAR is a novel open-source HRI system based on the Robot Operating System (ROS) and Augmented Reality. An AR Head Mounted Display (HMD) is deployed. It enables the user to interact and communicate through a ROS powered robotic arm. A model of the robot arm is imported directly into the Unity Game engine, and any interactions with this virtual robotic arm are communicated to the ROS robotic arm. This system has the potential to be used for different process tasks, such as robotic gluing, dispensing and arc welding as part of an interoperable, low cost, portable and naturalistically interactive experience.
AB - Real world virtual world communication and interaction will be a cornerstone of future intelligent manufacturing ecosystems. Human robotic interaction is considered to be the basic element of factories of the future. Despite the advancement of different technologies such as wearables and Augmented Reality (AR), human-robot interaction (HRI) is still extremely challenging. Whilst progress has been made in the development of different mechanisms to support HRI, there are issues with cost, naturalistic and intuitive interaction, and communication across heterogeneous systems. To mitigate these limitations, RoSTAR is proposed. RoSTAR is a novel open-source HRI system based on the Robot Operating System (ROS) and Augmented Reality. An AR Head Mounted Display (HMD) is deployed. It enables the user to interact and communicate through a ROS powered robotic arm. A model of the robot arm is imported directly into the Unity Game engine, and any interactions with this virtual robotic arm are communicated to the ROS robotic arm. This system has the potential to be used for different process tasks, such as robotic gluing, dispensing and arc welding as part of an interoperable, low cost, portable and naturalistically interactive experience.
KW - Augmented Reality
KW - Human-Robot Interaction
KW - Robot Operating System
KW - Unity3D
UR - http://www.scopus.com/inward/record.url?scp=85099221994&partnerID=8YFLogxK
U2 - 10.1109/MMSP48831.2020.9287100
DO - 10.1109/MMSP48831.2020.9287100
M3 - Conference contribution
AN - SCOPUS:85099221994
T3 - IEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020
BT - IEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 21 September 2020 through 24 September 2020
ER -
