METHOD AND SYSTEM FOR DETERMINING THE RESULTS OF THE PROBLEM EXECUTION IN A CROWDS-SOURCING ENVIRONMENT

摘要

A method and system for determining a result for a task executed in a crowd-sourced environment is disclosed. The method comprises receiving, a plurality of results of the task having been submitted by a plurality of human assessors; receiving a quality score for each human assessor of the plurality of human assessors; generating a plurality of vector representations comprising a vector representation for each of the results; mapping, the plurality of vector representations into a vector space; clustering the plurality of vector representations into at least a first cluster and a second cluster; executing a machine learning algorithm configured to generate a first confidence parameter and a second confidence parameter; in response to a given one of the first confidence parameter and the second confidence parameter meeting a predetermined condition, generating, an aggregated vector representation; and selecting the aggregated vector representation as the result of the task.