MANAGING DEFECTS IN A MODEL TRAINING PIPELINE USING SYNTHETIC DATA SETS ASSOCIATED WITH DEFECT TYPES

摘要

The disclosure herein describes managing defects in a model training pipeline. A synthetic data set is generated that is associated with a defect type and lifecycle stage of the model training pipeline, and baseline performance metrics associated with the defect type are generated. Based on a code change to the pipeline, a test model is trained using the pipeline and the synthetic data set, and test performance metrics are collected based on the test model and associated with the defect type. Based on comparing the baseline performance metrics and the test performance metrics, a defect of a particular defect type is identified in the pipeline. An indicator of the defect is provided that includes the defect type and the lifecycle stage with which the synthetic data set is associated, whereby a defect correction process is enabled to remedy the defect based on the associated defect type and the lifecycle stage.