Hi,everyone.
I’m Yui Atarashi, an undergraduate at University of Tsukuba.
I’d like to present our paper
"Instrumeteor, Authoring Tool for Guitar Performance Video”
To show off playing musical instruments,
musicians publish their musical performance video on streaming services.
First, they record performance video,
then author the video and finally publish it.
In Japan, the culture of cover creation is widespread.
Therefore, a lot of performance videos covering original song have been published.
For example, Nico Nico Douga, the most popular Japanese video-sharing service,
the number of tags that are attached to cover performance videos has exceeded
250,000 posts as of January 2021.
Because effects and authoring methods are different depending on the type of instrument,
we focus on the guitar performance videos
which are popular types of performance videos.
First, in order to find out
and analyze the typical characteristics of guitar performance videos,
we collected the top 100 most viewed Japanese guitar performances videos.
These videos were posted on YouTube from January, 2018 to November, 2020.
There were eight types of video effects in the collected videos.
The figure shows the results of the survey on video effects.
This video shows examples of the video effects.
There are various types of video transitions in the collected performance videos.
Transitions are used when the melody changes such as the start time of the chorus.
The figure shows the results of a survey on transition types.
This video shows examples of the transitions.
When we author guitar performance video through existing method,
there are two problems.
The first, because existing tools do not specialize on performance videos,
it is difficult for users to trial and error of authoring performance videos.
The second, users need to combine multiple video tracks into a single track at the right timing,
aware of the musical structure.
Therefore, lots of manual work is required.
To solve these problems, we propose Instrumeteor, authoring tool for guitar performance videos.
First, It implements typical effects informed by the survey to unleash the musicians creativity.
Instrumeteor implements A to G effects found in the survey.
The second, Instrumeteor automatically analyzes the musical structure in the tracks
to align them on a single time line to reduce manual work.
Currently, a user specifies the input file name
and effects directly on the code on the Instrumenteor system.
This is the output video.
As future work,
we will do iterative improvement
based on the above-mentioned insights and this initial prototype.
This is a mockup of interaction design.
I'm doing my best to implement it.
The edit screen is divided into an item panel,
a video playback panel,
a timeline panel,
and an effect panel.
The input videos are displayed in the lower left.
When the user selects the lyrics animation button,
the lyrics animation will be reflected in the video.
The user can change the saturation of the video by selecting the button.
Selecting the transition button allows the user to select the type of transition.
If the user selects a multi-view button, the user can change the display format.
This is summary slide.Thank you.