Hello, my name is Houssem Saidi, from the university of toulouse
Executing commands in head-mounted displays usually requires activating a menu, which is then displayed in mid-air, in the field of view of the HMD
To interact with this menu, the user has to perform mid-air gestures to select and validate items
There are two major issues with this approach
First, Displaying menus in an already narrow FoV occludes the displayed content and limits the size of the menu that can be displayed
Second, mid-air gestures are usually rather difficult to perform accurately hundred per cent of the time
A potential alternative to this approach would be combining smartphones and Head mounted displays to improve this process
augments the number of degrees of freedom which means, a bigger interaction vocabulary
This approach has been used for several use cases, however,
these use cases focuses mainly on ad-hoc tasks, usually navigation or 3D exploration.
The work presented in this videos exploits this approach to ease interaction with multi-level menus through what we call, the HoloBar
The HoloBar offers a multi-level menu based on four grounding principles
The first principle is a rapid activation of the menu, anytime the user needs it
To activate the HoloBar, the user brings the smartphone beneath the FoV and enters what we call the Activation Zone
As soon as the smartphone is detected inside this zone, the HoloBar is displayed
the top-level menu is displayed as an unobtrusive menu bar on the HMD
while the second-level menu is displayed on the smartphone
To select top-level menu items, the user can move the smartphone horizontally
this corresponds to the user aligning his head, the smartphone and target item
Moving the smartphone under the holobar implicitely selects a top level item and displays a preview of the second-level item on the smartphone
We conducted two studies
The first one tries to identify the smallest possible activation distance for the HoloBar
While the second one investigates the performance of the HoloBar for command execution compared to two other menus
As we wanted to identify the smallest possible activation zone, we evaluated 3 activation distances
Then, we investigated the performance of the HoloBar for command execution, compared to two other menus
A HoloLens like menu and a Hybrid menu combining the interaction of the HoloLens menu with the layout of the HoloBar
This allowed us to compare the HoloBar in termes of menu distribution
fully displayed on the HoloLens or split between the hololens and the smartphone
and menu layout : so either linear layout, or grid layout
Results showed that the holoBar ensured not only a quicker overall completion time
Menu activation, Top-Level item selection, Second-level item selection, Final Validation
This concludes this video, in which we briefly presented the HoloBar, a novel approach for command execution
The HoloBar offers a multi-level menu that can be rapidly activated, anytime
This work also determined the most suitable activation distance for the HoloBar
and compared its performances to two other menus
we found that it was at least 29% quicker for command access while maintaining a 99,4% success rate