Hello everyone I'm Tahir Abbas and today on behalf of ...
all my co-authors.
I'm going to present this work on understanding users'
perceptions of response delays in crowd-powered ...
conversational systems.
Crowd-powered conversational systems are ...
based on the real-time crowdsourcing concepts.
where we harness the wisdom of crowd in near real-time.
by pre-recruiting workers in advance.
Let's see how crowd-powered conversational systems work ...
under the hood. First of all,
the end user sends message to anonymous workers.
anonoymous crowd workers then generate some candidate answers.
which are sent to another set of workers for quality assurance.
And finally the best answer is chosen by these workers and ...
send back to the the user.
You may have noticed there can be several sources of ...
latency in this whole workflow.
For example Network bandwidth is one main source ...
of latency in crowd-powered conversational system.
Similarly, when the task is outsource to ...
the anonymous workers, they need some time to ...
complete it, whic also add some
latency
Thirdly, another set of workers need ...
to validate the responses generated by their peers.
which adds another layer of latency.
Many studies in HCI have revealed that extended ...
waiting time can cause stress and furstration to end users.
There can be two paths to solve this problem.
The first path, "How can we make the CPCS ...
faster?" requires building sophisticated ...
technical solutions. The path that we followed
was how to make the CPCS "appear" faster.
Which minimizes PERCIEVED response ...
latency by building engaging interventions.
This is called Perceived latency,
which is the perception of time in receivers' mind.
We followed this path because there is a trade-off ...
between speed and quality
imposing strict time constraints on workers to ...
keep the system's reaction time below a certain threshold
may impair the quality of crowd contributions.
Therefore, it is important that we focus ...
on the psychological dimension of time,
which does not require building engineering solutions ...
and can be cheaper to implement.
various factors in crowd-powered conversational ...
system can distort the perception of time.