hi
nice to meet you i'm
ryo suzuki i'm a former phd student
at the university of colorado
boulder and i'm now an assistant
professor at the university of calgary
so today i want to talk about
realitysketch
embedding responsive graphics and
visualization
in ar through dynamic sketching
so this work is a collaboration with
rubaiat habib kaze li-yi wei
stephan diverdi wilmot li and daniel
lightinger
at adobe research and the
university of colorado boulder
so this paper presents realitysketch
augmented reality interface for sketching
interactive graphics
and visualizations so reality sketch
enables a new way
to embed dynamic and responsive
graphics in the real world
so the user can quickly sketch on ipad
and bind them with a physical object in
real time and in improvisational ways
so that the sketched element can
dynamically move with the corresponding
physical motion
so this paper contributes to a set of
interaction techniques that
enable capturing parameterizing and
visualizing real-world
motion without predefined
programs and the configuration
so uh let me quickly go through the
overview background
so the sketching interface research in
hci is vast which starts from the
ivan sutherland's sketchpad but
there are a vast research in the
interactive sketching
and the dynamic sketching in which the
sketched elements are gonna be animate
and change based on the user
interface user interaction
and then the recently more and more work
have investigated how we can
integrate the sketching interface in ar or vr
or mixed reality interfaces
so if we categorize the existing work
we can see this kind of the histogram
one of which is static or responsive
which is uh the sketch elements are
gonna be changing and animate
another one is a separated or embedded
which is the sketch
elements are presented and spatially
integrated within the real world
but to our best of knowledge not so many
work
have investigated this intersection of
the embedding
and embedded and and responsive
sketching interfaces that leverage
both dynamic sketching and the ar or
mixed reality interfaces
uh so that's why we uh
uh this paper presents reality sketch
which is
trying to investigate the very first uh
the interface
to combine these two
so reality sketch is an augmented
reality interface
sketching interfaces that is based on
apple ar kit uh
that which is which works on iphone and
ipad
so with the reality sketch when you
sketch it and its elements is gonna
dynamically move
based on the physical motion or
the tangible interaction
so that you can directly manipulate on
the sketched
element in ar
so the reality sketch workflow are composed
from the the three workflow one of which
is of tracking and then the sketching
and parameterizing
and finally parameter binding or
visualization
so for example uh if you uh select the
color
on ipad then it's gonna be tracked on
the
ar screen and then if you sketch it
then just get sketching and they're
gonna be automatically bound to the real
world object so that you can actually
you know just um the sketch these kind
of objects
and then the you could also define
the variable or visualize it so that uh
you can combine combine you know the
sketched elements
to make more expressive motion
so we have investigated uh the four
different types of application
which is augmented uh uh
with augmented physical physics
experiment and explore concept
explanation and sport training
analysis
and then in the in-situ tangible user
interfaces
so please prefer the more detail in
our paper
thank you