Hi, this paper introduces the concept of camera handling to 360 cameras
Typically, as a photographer, you can define user attention about a scene through the viewfinder.
But 360 camera doesn't give you a viewfinder
which makes perfect sense because every shot with 360 cameras is about an omnidirectional view.
But when it comes to the presentation of the 360 media on screen
users still need that region-of-interests or the user attention for more efficient browsing.
One way to introduce region-of-interests back is in the post-editing phase
manually with labor labeling or automatically with machine learning approaches
We introduce a novel concept of camera handling
which allows the user with the 360 camera to address user attention in a scene at capture time
We introduce the first handling technique, which is the FoV Handling
that allows the user to address user attention in a scene by just facing at it at capture time
Then, our algorithm can identify the user attention region in the equirectangular image
according to the user's face direction.
this way
we can extract two important sub-images in the equirectangular image
which are the user attention and the user (operator) face
Now we have the face image, the user attention image
as well as the equirectangular image
and we can use these materials to provide four different presentation formats
which are the focus, side-by-side, picture-in-picture, and equirectangular.
This adds a layer of dynamics in presenting 360 media.
Let me introduce the second handling technique
which is the pointer handling
that allows users to address user attention in a scene by just pointing at it with the camera body
and similarly, we can identify the user attention region according to the pointing direction
and together, we acquire the user attention image and the user (operator) face image.
please refer to our paper for implementation details
Until now, we have introduced director-360
the two handling techniques that enable photographers to record user attention and their face image at capture time
as well as the four presentation formats
We conducted a user study
where we sent three users to shoot video tours for gallery
campus
and foodie
and they were also asked to produce a footage using director-360 editor
I'll quickly go through the result
This is one taken in the gallery
and you can see he used the picture-in-picture while following the guide
and also the side-by-side view to record the guide introducing the exhibition.
This is one for the campus
This person here is recording a video to introduce the campus to newcomers
this is a picture-in-picture view.
and also he used this equirectangular view to show the overall atmosphere of the scene.
and the last one is fooide
This is a group of two persons
He used a picture-in-picture to show their reaction while walking in a night market for foodie
thanks for your attention