METHOD FOR EVALUATING WORKERS USING THE UNIT OF WORK DIFFICULTY OF CROWDSOURCING BASED PROJECTS FOR ARTIFICIAL INTELLIGENCE TRAINING DATA GENERATION

摘要

A method of evaluating workers using the difficulty of a work unit of a crowdsourcing-based project is provided. The method is a step of assigning a plurality of tasks of a crowdsourcing-based project (hereinafter, referred to as a project) to a plurality of workers and requesting the task to be performed, receiving a plurality of work results or a work pass request from the plurality of workers. , Allocating the plurality of work results to a plurality of inspectors and requesting to perform inspection, and receiving an inspection pass or rejection input from the plurality of inspectors as a plurality of inspection results for the plurality of work results, and the project When is finished, it includes the step of evaluating the plurality of workers and scoring (scoring). In this case, the step of evaluating and scoring the plurality of workers includes assigning a work unit difficulty level to each task of the project based on the number of times the work pass request is input, and the work unit for each task And assigning a task score based on the difficulty level, and scoring each worker by summing the task scores of one or more tasks performed by each worker and passed the inspection.