METHOD AND APPARATUS FOR DETERMINING WHETHER TO INTRODUCE MACHINE LEARNING MODELS FOR LABELING TASKS ACCORDING CHARACTERISTICS OF CROWDSOURCING BASED ON PROJECTS

摘要

The present invention relates to a method and apparatus for determining whether to introduce a machine learning model for the labeling task of a crowdsourcing-based project. In the method for determining whether to introduce a machine learning model for the labeling task of a crowdsourcing-based project according to an embodiment of the present invention, when a project for the labeling task is requested, matching between the project and at least one pre-trained machine learning model calculating a score; checking whether a pre-trained machine learning model for the labeling task exists among the at least one pre-trained machine learning model based on the calculated matching score; and determining whether automatic labeling or manual labeling according to the confirmation result, whether a pre-trained machine learning model for the labeling task exists, and the confirmation result, pre-trained machine learning for the labeling task When a model exists, automatic labeling is performed based on the confirmed pre-trained machine learning model, and when a pre-trained machine learning model for the labeling task does not exist, the labeling operation is performed manually Comparing the first cost required and the second cost required for automatically performing the labeling operation using a pre-trained machine learning model or a custom model in which the calculated matching score is within a preset threshold range, and the comparison It may further include the step of determining whether automatic labeling or manual labeling according to the result.