An apparatus (10) for manually auditing a set (30) of images having quality ratings (38) for an image quality metric assigned to the respective images of the set of images by an automatic quality assessment process (40) includes at least one electronic processor (20) programmed to: generate quality rating confidence values (42) indicative of confidence of the quality ratings for the respective images; select a subset (32) of the set of images for manual review based at least on the quality rating confidence values; and provide a user interface (UI) (27) via which only the subset of the set of images is presented and via which manual quality ratings (46) for the image quality metric are received for only the subset of the set of images.
展开▼
