Hello everyone, Today I am going to present the project
“Tilt responsive techniques for digital drawing board”.
Drawing boards offer a self-stable work surface that is continuously adjustable
offering artist the freedom to ink, read and draw with several postures.
During the last decade, we have seen the same trend with digital displays,
such as the Samsung Space Monitor, Wacom Cintiq and the Surface Studio,
opening up a class of techniques that sense and respond to tilt adjustments.
A vertical monitor affords reading a document, but not writing on it with a stylus.
Angled drafting tables allow close engagement with one’s ideas.
But a vertically-oriented screen is better suited to present refined ideas to others
None of these devices offer a user experience
that senses and responds to shifting display angles.
To address this problem and explore a range of scenarios on the surface studio,
we sense display postures
and the continuous transitions in between with a tilt sensor.
We show how a variety of knowledge work scenarios
can use sensed display adjustments to drive context-appropriate transitions
Our prototype launches to a “lock screen,”
displaying notifications, and from where users can log in into their session.
Then as the screen reaches a low angle,
this reveals detailed private information such as notifications.
The Map application uses tilt to control a perspective view of a city.
At vertical, the screen shows the Skyline,
as if looking through the screen onto a miniature cityscape.
As the user tilts down, the view of the city rotates, until reaching an Overhead View.
This experience well demonstrates
our use of the transfer function to transition between low and vertical position.
In another example, we explore the duality between messy/tidy,
and private/public while filling sticky notes.
While in the low-angled posture, the user can jot down notes on orange stickies
which can be left lying around the screen, like a messy desk.
If a co-worker comes in, you can angle the display vertical
to automatically tidies annotation, and hides personal information.
Our Teleconf App explores a solution that uses the display tilt
to transition between Person Space and Task Space.
When vertical, the display emphasizes Person Space.
Tilting down then transitions to Task Space,
where the user can mark-up a shared document or whiteboard.
Participants made many positive comments about disabling
the camera when tilted or horizontal.
But also articulated the benefit of focusing the remote audience on content
The Document App supports fluid transitions between
the reading vs. writing tasks typical of active reading.
Users can read and edit text with the display in vertical orientation.
Tilting down then let them handwrite or annotate with ink,
directly on their document, from a convenient display posture.
Participants perceived tilting as less effortful to automatically call-out comments,
and recognize handwritten ink as text, versus navigating the many UI commands
and options typical of current practice .
To stabilize the tilt motion, we implemented a transfer function
that supports both relative motion for fine adjustments
and absolute motion to maintain a direct mapping between orientation
and the semantics of a sensed context.
We also implemented a tilt side channel toolbar
to solve key issue of surfacing cross-application functionality associated with tilt,
even though tilting has application-specific mappings.
Side-Channel commands include Clutching,
to freeze the content,
as well as invoking a general-purpose Annotation Layer.
Participants designated our Document and Teleconf apps
as the most compelling experiences.
Both of these scenarios evoke situations
where users would already implicitly adjust their screen angle,
typically driven by use of the pen to markup content.
Our Reading vs. Writing transition offers a better writing angle
and more space for handwritten annotations,
but also implicitly leverages the tilt adjustment necessary for pen use.
Participants also mentioned difficulties with current telework user interfaces
to find whiteboards and document sharing during video calls.
This suggests that when the UI responds appropriately,
implicit uses of tilt can also lower the perceived effort
to access certain program functionality.
We received mixed responses to our Lock Screen app experiences.
Responses were only positive
if the experience dovetailed with a user’s existing practices.
For example, for people who typically put the screen vertical to unlock their screen,
the lock screen did not suit their needs.