Hi my name is Ryo Suzuki I'm an Assistant Professor at the University of Calgary
Department of Computer Science. Today, I want to talk about Augmented Reality and Robotics
a survey and taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces. So this is
a collaboration with Adnan Karim, Tian Xia, Hooman Hedayati, and Nic Marquardt at University of
Calgary, University of North Carolina at Chapel Hill, and University of College London
so this paper is about intersection between augmented reality and robotics and we have surveyed 460
research papers about AR and robotics to understand how we can use AR of mixed reality to enhance
human-robot interaction but also robotic interfaces such as acutuated tangible user interfaces and
shape-changing interfaces. So with the recent advances in AR and mixed reality, we are
there are a growing number of the research papers that investigate how we can use AR for
human-robot interaction but existing paper mostly focus on individual exploration so in this
paper we try to synthesize these works into the different dimensions of the ar and robotics paper
so for our contribution we have synthesized this paper into the eight different dimensions but
we also summarize our paper into the interactive website so that you can if you go to this website
you can actually see that all of the research paper
with uh interactively uh to to dig into each research paper
so in this paper we have analyzed a different dimension of the AR robotics so the first one
is approaches to augmented reality in robotics and a second characteristics of augmented robots
and third one is purposes and benefits of augmented reality
and fourth one is the classification of the presented information and fifth uh we have design
component strategy for visual augmentation and the six we have interaction and interactive modalities
seven we have uh application domains and also we have evaluation strategies
so based on this finding analysis we also discuss the future research opportunity and challenges
to inform research community for the future of AR and robotics research
then my student Adnan Karim will be talking about each dimension and taxonomy
hi I'm Adnan and I'll pick up Ryo left out so in terms of approaches to augmented reality
in robotics we had on-body on-environment and on-robot and that could be done whether
augmenting the robot or we could be augmenting the surroundings
in terms of characteristics of augmented robots we had multiple form factors we had robotic arms
drones, mobile robots, vehicles, to name a few
in terms of its relationship we had 1 to 1, 1 to m, n to 1, and n to m
in terms of scale we had starting from small all the way up to large
in terms of proximity we have near proximity anything in between and then also far proximity
in terms of purposes and benefits of visual augmentation we have facilitating programming
supporting real-time control improving safety communicating intent and also
increasing expressiveness in terms of classification of presented information we had
internal information external information plan and activity and also supplemental content
in terms of design components and strategies we had three which is UI and widgets which fell with
menus, information panels, label and annotations, control and handles, and also monitors and displays
we also had spatial references and visualizations and things that fell under there was points and
locations, path and trajectories, areas and boundaries, and also other visualizations and
finally we had embedded visualizations which had anthromorphic effects, virtual replicas and ghost
effects, and also texture mapping effects in terms of interactions we had low to high including only
output which is low implicit explicit and indirect and also explicit and direct input in terms of
more interaction we had tangible we had touch, controller, gesture, gaze, voice, and also proximity
in terms of application domains there are multiple but we'll name a few industry was the most
popular we also had mobility and transportation, social interaction, and also medical and health
in terms of evaluation strategies there was three one was demonstration
technical evaluation and also user evaluation in terms of discussions
and findings we found a lot of things and here is a summary of what we found
and in terms of future opportunities and challenges we've had four things we wanted
to focus on so the first one is making AR-HRI practical and ubiquitous things like
technological and practical challenges and also deployment and evaluation in the wild
we also had AR-HRI for better decision making including real-time embedded database for AR-HRI
and also explainable and explorable robotics we also have designing and exploring new AR-HRI
which includes reimagining robot design and also immersive authoring and prototyping
and finally we had novel interaction design enabled by AR-HRI which included natural
input interactions with ar hri and also blending the virtual and physical worlds
together that concludes our presentation again we summarize by finding seven new dimensions
and also future opportunities and challenges and again we also have this website which
summarizes all the papers that you guys can see and look into
thank you again for listening to our talk we hope this was helpful