Hi, I am,
Md. Rabiul Islam,
presenting the paper self-supervised learning for ...
reading activity classification,
and we are from Osaka Prefecture University, Japan.
In our daily life, we are doing different human ...
activities, and reading is a cognitive one.
It is an important source of information that includes ...
reading plaintext, answering MCQs, and many more.
Therefore by reading, we do not simply mean ...
reading plain text only but also solving problems by reading.
By applying classifications such as reading versus not reading,
reading quality classification,
we can get very useful information,
such as amount of reading,
quality of reading, and many more.
This information constitutes a useful feedback,
that enables effective mentoring
that in turn
improves motivation and reading habit.
Therefore reading is a part of a human activity recognition
that can be classified into physical and cognitive.
For physical human activities such as walking,
running, riding a bicycle requires ...
significant bodily movements
and has successfully been recognized by employing IMU ...
motion sensors data.
On the other hand, for cognitive human activities, there have
fewer bodily movements
and need to capture biological signals with different sensors ...
depending on activities.
Different sensors may need different treatments
and cognitive human activities may not be solved by applying ...
the existing technologies of physical human activity recognition.
Therefore we are motivated to take reading activity classification
as an example of cognitive human activities
and to solve it by applying
eye-movement data.
For reading activity classification,
researchers conducted few trials
with classical machine learning methods
by employing hand-crafted features.
But the limitations are the lack of accuracy and less ...
in-the-wild applicability.
Deep learning has solved such issues in various fields.
But it requires larger-sized labeled data
which is problematic to achieve in most of the fields ...
because of various reasons.
A deep learning technique called self-supervised learning ...
can learn with small-sized labeled data.
The proposed SSL method consists of self-supervised ...
pre-training and target task training.
In self-supervised pre-training,
at first, we apply data transformation
to a large-sized unlabeled sensor data and pre-train the ...
base network by identifying pseudo labels
applied during data transformation.
In target task training,
we re-train the base network by fine-tuning it
employing a small-sized labeled sensor data
by identifying target classes.
We evaluated the proposed on reading detection and ...
confidence estimation on answering multiple-choice questions.
The experimental setup for reading detection is shown here.
We record accelerometer, gyroscope,
and electrooculography data by employing
EOG glasses while the user was reading texts in-the-wild condition.
The experimental setup for confidence estimation is shown here.
We record eye-gaze by employing
an eye-tracker
while the user was solving multiple-choice questions ...
in-the-wild condition.
The result of our experiment for both tasks of reading ...
detection and confidence estimation are shown in this slide.
For both graphs,
y-axis shows the accuracy
and x-axis shows the number of labeled training samples per class.
The red line shows the result of the proposed SSL method.
The blue line shows the result of fully-supervised deep ...
learning method. The black line shows the ...
result of SVM and the green line shows the chance rate.
By analyzing results
for both tasks, we can say that proposed ...
SSL method performs the best for both of reading ...
activity classification tasks.
Finally, conclusion and future work
The objective of our study is reading activity classification.
We proposed an SSL method and evaluated it on reading ...
detection and confidence estimation.
And finally, we conclude that the ...
proposed SSL method is always recommended to apply ...
for both reading activity classification tasks.
In future,
we need to improve the accuracy of the classification
and to apply the proposed method for other reading ...
activity classification tasks to check the generality of the ...
proposed method.
Thank you for your attention