Hi, everyone, my name is Qinyue Chen. And I am going to talk about our work,
Bubble coloring to visualize the speech emotion. I collaborated with Yuchun Yan on
this project at the color lab of KAIST with our advisor: Professor Hyeon-Jeong Suk
Emotion communication in text-based instant messaging has been studied for many years.
Diverse media have been considered to visualize and enhance emotion, such as color, shape,
vibration and images, which are supposed to help people feel more connected to each other
and communicate better during chatting.
However, the emotion communication of voice messaging is still under-explored,
even though voice messaging has been integrated into instant messaging
and become more and more popular in the world.
So what if we apply the emotional characteristics of color to chat bubbles in voice message?
In this study, we were motivated to visualize the emotion of voice message by altering the color background.
We want to explore the emotional effect of the chat bubble’s background color on voice messages.
To achieve our research goal, we conducted a user study.
Considering the color combination may affect the emotional meaning of color,
we introduced three representative chat platforms which have different chat bubble colors:
Facebook Messenger, WeChat, and KakaoTalk.
We intended to regard the default chat bubble colors as the neutral emotion and apply different
colors to the chat bubbles of non-neutral emotions.
Here, as you can see, we considered four different emotions in our study.
Orange, dark red, dark grey, and pale blue were selected to represent excited, angry, sad, and serene, respectively.
This is the comparison of the default version and the colored version.
In total, 25 participants participated our experiment.
And they were asked to finish two tasks in a web-based survey.
Firstly, they need to record a provided voice message which conveyed a particular emotion.
And then they need to replay their recordings
and compare the colored bubble with the default bubble regarding emotional conveyance and willingness to use.
Now come to the result part.
So firstly, we performed a one-sample t-test to examine whether
the score of emotional conveyance was different between the colored bubble and the default version.
From the analysis, all mean difference was significant, indicating that the emotional conveyance was overall intensified.
And also for the willingness to use, we found a similar tendency with the emotional conveyance.
The users are willing to use colored bubble to visualize emotions of voice message,
comparing with the default version.
And more specifically, the excited and sad received a respectively higher score.
We also found that compared with the two different criteria, there is no significant difference between excited and serene.
However, in the case of angry and sad, the mean score of willingness to use significantly decreased,
that is to say, the negative emotions may be less likely to be explicitly visualized than the positive emotions.
And finally, to compare the effect of emotion and the service, we employed a two-way ANOVA. And we found
that for both emotion conveyance and willingness to use, they were affected by the interaction
effect between service and emotion, but not only by service, confirming our assumption
of the interaction effect of color combinations of the default color and bubble color.
So in summary, with the exception of the serene, the emotion was intensified through the background
color across all the three messengers. And users are willing to use colored bubble to
visualize emotions of voice message. Compared with the emotion conveyance, the likelihood
was reduced, particularly in negative emotions.
That's all my presentation. And thank you for listening. If you have any further question,
please feel free to contact us!