Quality-Aware Task Assignment in Crowdsourcing

Speaker:        Professor Guoliang LI
                Tsinghua University

Title:          "Quality-Aware Task Assignment in Crowdsourcing"

Date:           Friday, 22 May 2015

Time:           11:00am - 12 noon

Venue:          Room 4472 (via lifts 25/26), HKUST

Abstract:

The task assignment problem is rather important to obtain high-quality
results from the crowd. A poor assignment may not only waste time and
money, but may also hurt the quality of crowdsourcing applications that
depend on the workers' answers. We consider quality measures that are
relevant to an application during the task assignment process.
Particularly, we explore how Accuracy and F-score, two widely-used
evaluation metrics for crowdsourcing applications, can facilitate task
assignment. Since these two metrics assume that the ground truth of a
question is known, we study their variants that make use of the
probability distributions derived from workers' answers. We investigate
online assignment strategies, which enables optimal task assignments.
Since these algorithms are expensive, we propose solutions that attain
high quality in linear time.


******************
Biography:

Guoliang Li is an Associate Professor of Department of Computer Science,
Tsinghua University, Beijing, China. He received his PhD degree in
computer science from Tsinghua University in 2009, and his Bachelor degree
in Computer Science from Harbin Institute of Technology in 2004. His
research interests include crowd computing, data cleaning and integration.
He has published more than 80 papers in premier conferences and journals,
such as SIGMOD, VLDB, ICDE, SIGKDD, SIGIR, TODS,  VLDB Journal, and TKDE.
He is a PC co-chair of The 14th International Conference on Web-Age
Information Management (WAIM 2014) and The 17th International Workshop on
theWeb and Databases (WebDB 2014).  He has served on the program
committees of many premier conferences, such as SIGMOD, VLDB, KDD, ICDE,
and IJCAI. His papers have been cited more than 2200 times. He received
IEEE TCDE Early Career Award, CCF Young Scientist Award, NSFC Excellent
Young Scholar, New Century Excellent Talents in University Award, Beijing
Excellent Doctoral Dissertation Award, Nomination Award of National
Excellent Doctoral Dissertation, and SCOPUS National Youth Science Star
Award.