- It's okay. Now, I'm starting my second presentation.
I am honored to be able to present two presentations here.
Actually, I am not the first author of this paper,
but the first author is busy so I stand in here for him.
To begin with, the subject of this work is
about expanding the space of a small smartwatch.
Touch gestures are familiar to use
because it is intuitive and we are already familiarized
by using the other devices, such as smartphone.
Maybe from this automation,
most of the commercial smartwatches have a touchscreen.
However, touchscreen on the smartwatch is too small.
The tiny touchscreen worsens the occlusion problem
and requires too much clutching for using thouch gestures.
Therefore, previous researchers
presented the various designs to solve these problems
such as using mechanical manipulation
or using the edge of the touchscreen
or extending into space to around the space.
These techniques were adjusted problems
of the tiny touchscreen.
However, those require the user
to learn new input techniques.
So we suggest the concept of transture.
The goal of transture design is extending input space
with using the familiarity of the touch gesture.
In transture, touch gesture is not only still used
but also there is no discreet boundary
between the touchscreen and each around the space.
In other words, we try to make
our user can do a gesture in the air
with a improvised and natural transition
from the touch gesture on the screen
to each around the space, as shown in this video.
Before explaining the transture itself
now I will do a touch gesture introduction.
When users interact with the touchscreen
utilizing touch gesture they faced two state:
touch state and out-of-range state.
Then through design transture, we introduced
one more state into the state transture diagram.
It is named glue state.
Glue state is gluing state between
touched state and out-of-range state.
The goal of the glue state is to make a gesture
can be continued in the air from the touchscreen.
Okay, then now I introduce how transture occurs
between the states, why it uses transture.
The first step to use transture is gesture registration.
In this step, a user can choose
which gesture to use in glue state.
As I mentioned prior there is no discreet
boundary between touched state and slue state.
Therefore, we choose the traditional touch gesture
as gesture registration action.
For example, if a user wants dragging gesture in glue state
a user drew dragging gesture on touchscreen
as the registration action for tracking in the air.
And the next state is relaxation for state transition
from touched state to glue state.
After a finger leaves from the touch screen
a user can be done touch gesture or can be
state continuing in glue state.
So, if a user wants to continue gesture in the air
users should do a relaxation action.
After the relaxation action a user can
continue a gesture in the air.
Then finally a user can be done
relaxation with the terminating action.
To make around the space a continuous space
from the touch screen, some design issues exist.
Now I explain the issues in designing transture.
The first issue in the relaxation action
relaxation action is needed to distinguishing
traditional touch gesture realization
and relaxation action of transture.
Then to make a natural transition between
touched state and glue state it is important
to find the imperceptible reliable action
to a distinguishing releasing action and relaxation action.
The second issue in the glue state.
In case of the touch gesture a user can
recognize the data gesture on the touch screen
because there is tactile feedback between
the finger and the touchscreen.
However, if a user does gesture in the air
there is no feedback for recognizing
whether glue state or out of range state.
Hence, here is to find the proper feedback
to let a user know the current state.
And the solution is designing terminating action.
Terminating action should be easy to use
but should not occur extended transition
from glue state to out of range state.
And the final issue is in the Transiture design
is designing Multi-touch Transture
especically about the starting action
of the pinching gesture.
If we design pinching in gesture
as similar to the single-touch transiture
gesture registration action should be
treated as a pinching gesture on the touch screen.
However, after doing pinching gesture
there is no space to move their finger in the air
as you can see in the video
and hence here leads to design
alternative starting action from such transiture.
As a first step to achieving transiture
we conducted observation study.
The goal of this study is collecting
the common features of finger movement
while using smart touch.
To do this we tracked finger movement while
participants use conventional applications of smart watch.
Such as searching on (mumbles)
finding a contact, checking time
and scheduling, et cetera.
Then analyze the finger movements pattern
for designing relaxation action with many data
tapping dragging and flicking gesture.
Because maybe I have not much time to presentation
so I will skip some tests.
You can see the tests in the paper.
As a result of all of this we find the two features
can be using in designing relaxation action.
First one is the rest position
and the second one is finger movement speed
and direction after done
finger movement speed and direction
after done with dragging or flicking gesture.
Based on the two distinguishable features
of finger movement after a touch gesture is done
we set a relaxation action
to a finger movement that keep moving after
crossing the bezel of the screen.
Another finding is about relative movement
between the fingers while a user do single-touch transiture.
First one is height difference between the fingers
while they do single touch transiture.
In case the height difference is too wide
(mumbles) in single touch transiture.
But in the two dimensional distance between the fingers
it is not much change to while the user
to a single touch transiture.
Based on this finding we can design
alternative starting action for multi-touch transiture
We design a starting action for pinching gesture
by using the 2D distance change
while one finger is on the touch screen.
As shown, one finger is on the touch screen.
And based on the research we designed the transiture
as the original design for the following experiments.
This is simplified state diagram for transiture.
First a user do a touch gesture on the screen
for gesture registration.
And then a user keeps moving across the bezel of the screen
then a glue state is starting.
After continuing gesture in the air
then if a user wants to kill a gesture
a user can do lift a finger above
around the space as a terminating action.
In our early design we just settle finger lifting action
with height threshold to the terminating action
as a similar to touch gesture.
Then we conducted the experiment
to verify the feasibility of design
of relaxation action.
To show the feasibility we use dragging test
using three different travel lengths.
10 mm and 20 mm and 40 mm.
10 mm travel lengths can be done with touch gesture only
and 20 mm travel lengths also can be done
with touch gesture only
but it can be done at the boundary of the screen.
And finally 40 mm travel lengths
should be used transiture because the screen
is shorter than 40 mm.
And the results show that designs
with the relaxation action were also were okay.
In case of 10 mm target also is said to be done
with touch gestures.
In case of 20 mm target
some trial had been done with transiture
even if it do not need to use transiture.
But this accidental activation only occurs at 0.52%
from all trials.
And in case of 40 mm targets
some trials failed to activate transiture
but this unsuccessful activation
only occur 0.87% from the whole trials.
So, this design relaxation action is very working.
And we can also get our finding
from this experiment about terminating action.
In this experiment we design a terminating action
with height difference between the screen
and the finger was used for terminating action.
If a user lift a finger above the around space
glue state is done.
However, some participants mentioned that
termination action with height difference
was harder to perform because participant
input space did not match the device coordination.
To solve this problem we analyzed
the finger tracking data from this experiment.
And then as a result we can find
we can find the finger movement
speed along that exists in glue status
these fingers will be slow then the speed that the
moment people terminating action.
Therefore we designed termination action
rather than using height difference
between the fingers and the screen.
So, can lead to actions that are still terminating actions
for single touch transiture.
And actually here in the paper
two more experiments exist
but I skip these experiments for the time.
As a summary, now I explain the final
strength of transiture and it is about
the single touch transiture.
First user to touch gesture on the screen
for gesture registration, then a user keep moving
across the bezel of the screen
as the same as the older design of transiture
and when the glue status starting
feedback is given to the user
as feedback for glue state starting.
Then a user can do a continuing gesture in the air.
After that if a user wants to kill a gesture
a user can do keep lift up gesture as a termination.
When the glue state is done, as the same
to starting the glue state feedback is given to user.
And then this is a demonstration video
to show how we work the single touch transiture.
In the glue state
and then can lift up to then.
And next it is about multiple-touch transiture.
State transition is the same to the single touch transiture
but in multi-touch transiture gesture registration
and relaxation action was combined as starting action.
To starting multi-touch transiture
a user open their fingers while
one finger touch on the screen.
When the glue state is starting feedback is given
to let a user know the glue state is starting.
Then a user can do a continuing gesture in the air.
After that if a user wants to kill a gesture
a user release a touch finger shown in the picture.
When the glue state is done
Ah sorry, when the glue state is done feedback is given
to the user to let the user know glue state is done.
This is a demonstration video for multi-touch transiture.
It show that a wider zoom is on the screen
and then two finger is distanced
multi-touch transiture is starting.
Okay, it's done, we investigate the concept of
transiture in this paper.
The goal of transiture is to bring the experience
of larger touch screen device into a smart watch usage.
In this study we focused on dragging and pinching gestures
as a single-touch and multi-touch transiture
but we can generalize to other touch gestures
from our findings.
Our findings may provide a guideline
in future studies to utilize the space
around the touch screen
as an expended space from a touch interface.
Thank you.
(applause)
- [Moderator] Time for questions.
- [Audience Member] I am (mumbles) from (mumbles)
University, very interesting work
I like where it goes a lot so I appreciate your hard work.
I have a question about so in your case
your prototype right now uses optic track system
- Yes
- [Audience Member] to track movements
So I just want to see
what's your plan for future work so that it get with the
multi-track and how you're going to track
finger movements like later on people walking in the street
you don't have a track system (mumbles)
so how are you going to do that.
- Actually we will not be to follow tracking system
but just we anticipate that if the technology
will be better, the transiture is useful to smart watch.
- [Moderator] Anybody else?
Yep
- [Audience Member] I just wanted to answer to your question
on Wednesday morning one of the papers presented from Sui
was that sight sensor, which allows you to detect touch
around the phone, so you can have a lot
of different technologies I guess to detect.
- [Moderator] I have a quick question
maybe the next speaker can get ready.
So I've seen your model, most of your gestures
start with a touch, right?
- Yeah
- [Moderator] And so, you showed it a little bit
in your last video, imagine I want to start the gesture
outside of the touch screen so I want to do something
like this, I saw that you can pin one finger
on the touch screen to do the pinch gesture
is that part of your design?
Did you consider that as well?
I want to finish my transiture with a touch screen
not start it with it.
- Please beg your pardon
with the last part of your question
- [Moderator] Yes, so I'm just saying
can you, would it be part of your design
can you integrate that starting the gesture
without touching the screen and then finishing
terminating it touching the screen
- Ah, starting in the air?
- [Moderator] Yeah
- Actually, it is very different to our design core
because our design core
is maintaining the touch gesture itself
and just to extend to transition in the air
- [Moderator] So it starts with touch
- Yeah