Towards the Competence of Crowdsourcees: Literature-based Considerations on the Problem of Assessing Crowdsourcees' Qualities

摘要

Today, crowd sourcing literature and platforms propose many different means of assessing and defining worker quality, reliability and trustworthiness of task solutions. Where examples include: redundant scheduling, gold standard questions, qualification tests, and employer acceptance rate. In this paper, we argue that these approaches are not ineffective, but are shortsighted, as they reveal little about the actual abilities of a worker in general. Therefore, we propose the definition of competencies for crowd sourcees as a more elaborate methodology to today's notion of qualifications and qualification tests. Furthermore, we shed some light on how the competencies of crowd sourcees could be identified and confirmed via online social media platforms.