A Novel Crowd-sourcing Inference Method

摘要

With the fast growing of artificial intelligence (AI), more and more applications require querying uncertain data, especially from social media and crowd sourcing platform. In situations where it is impossible to increase data quality by controlling the sources, we may resort to algorithms to make the best use of the collected data. Since crowdsourcing provides a useful way to distributing tasks to mass people, and collects labels from as many workers as possible, many researchers have been study crowd-sourcing inference algorithms. In our work, we propose a novel crowd-sourcing inference algorithm to infer ground truth and obtain worker reliability and task difficulty at the same time.