Hi, everyone! Thank you for being interested in our work.
My name is Chen Zitong. I am from Zhejiang University.
Today I will be presenting you our Work-in-Progress paper
Paint with Your Mind: Designing EEG-based
Interactive Installation for Traditional Chinese Artworks.
This work is cooperated with Liao Jing, Chen Jianqiao,
Zhou Chuyi, Chai Fangbing, Wu Yang and Preben Hansen.
The presentation will be divided into the following sections.
Museum exhibitions on traditional Chinese paintings are
gaining popularity for educational and cultural value.
However, it is not easy for non-professional
or non-Chinese visitors to understand.
Inspired by the "mind control" idea
in many science fiction stories or movies,
we design an interactive installation
to enhance museum visitors’ interest and comprehension
using EEG headsets.
Visitors can experience the generation of lines,
colors, and movements of characters with the installation. Visitors can experience the generation of lines,
colors, and movements of characters with the installation.
Next, I will explain the design details of our installation.
Our installation is built based on a traditional artwork
Court Ladies Preparing Newly Woven Silk by Xuan Zhang in Tang dynasty.
Our installation uses the Neurosky Mindwave headset
to collect real-time EEG signals.
The headset provides the mental measurements attention.
We adopt Attention as control signals
to encourage visitors to concentrate and appreciate the painting.
Software system of our installation consists of a graphical interface module
for displaying figures and animations,
and a connection module for updating Attention values.
We design the interaction of our installation as three phases:
Sketching, Coloring and Movement-control.
The first phase is Sketching.
We expect that visitors can feel like they are ’drawing’ edges
by concentrating their mind in this phase.
To implement this , we first convert the painting
into SVG format in Adobe Illustrator.
Then we use the Attention value output
by the EEG headset to control display rate of the edges.
Higher Attention value is associated with greater display rate
and will accelerate the sketching process.
After Sketching, we simulate the coloring process by filling colors inside closed edges.
In this way, visitors can feel that they are able to mentally ’color’ a painting.
Likewise to Sketching, Attention value controls the coloring rate.
For unknown reasons, the Chinese painter did not paint according to
actual working procedures, which should be sewing, silk hitting, fire fanning and ironing.
To increase visitors’ understanding, we made animations of the painting
and designed the Movement-Control interactive phase.
In this phase, visitors can realize the story setting of the painting
by ’mind controlling’ movement of characters.
We defined four Attention thresholds to activate motion of different parts.
Once current Attention value exceed an threshold,
the corresponding part is activated to move.
We defined the threshold values in accordance with the silk making workflow.
For example, the Attention threshold(10) for Sewing part is set to be smaller than
the value(30) for Silk hitting, which indicates a piece of silk should be hit after sewing.
Here I will show you a video demonstrating the workflow of our Work-in-Progress system.
However, our work has some limitations.
Firstly, the installation is limited to uni-modal interaction.
Secondly, we observed that the response of installation could be delayed.
In conclusion, our work aims at providing an innovative interaction
for traditional Chinese artworks and devotes to enhancing visitors' interests
and comprehension in the experience of 'painting with your mind'.
In future work, we will concentrate on enhancing the reliability of EEG devices
and incorporate with other interactive mechanisms, such as eye-tracking technique.
Moreover, a systematic user study need to be conducted
in order to perform evaluation and improvement.
Thank you for listening!