AUTOMATED AND UNSUPERVISED CURATION OF IMAGE DATASETS

摘要

Techniques for dataset processing are provided. A plurality of feature vectors is generated for a plurality of pixel regions from a plurality of images, and a plurality of clusters is generated based on the plurality of feature vectors. A score is assigned to each respective pixel region in the plurality of pixel regions based at least in part on a cluster the respective pixel region is associated with. A unified dataset is created by, for each respective cluster in the plurality of clusters, computing a representative index for each pixel region in the respective cluster by comparing the pixel regions in the cluster, and modifying the score of the pixel regions in the cluster based on the computed representative indices. A confidence index is generated for the unified dataset based at least in part on a level of fragmentation in the unified dataset.