AUTOMATED COLLECTION OF HUMAN-REVIEWED DATA

摘要

The embodiments of the present invention provide methods and systems for automated collection of human-reviewed data. Requesters send data to be reviewed by humans (or data requests) to a data processing system, which is in communication with one or more systems for collecting human-reviewed data (HRD). The methods and systems discussed enables the data processing system to work with one or more of the systems for collecting HRD). In one embodiment, between the data processing system and the systems for collecting HRD are wrappers, which stores parameters specific to the data requests and libraries for transforming the data requests to human intelligent tasks (HITs) specific to each HRD system. The data processing system also includes a number of components that facilitate transforming data requests into HITs, sending the HITs to the HRD collection systems, receiving HRD, and analyzing HRD to improve the quality of collected HRD.