SYSTEMS AND METHODS FOR AUTOMATIC BIAS MONITORING OF COHORT MODELS AND UN-DEPLOYMENT OF BIASED MODELS

摘要

Systems and methods are disclosed for monitoring models for bias. In one implementation, a system for automatically assessing a deployed model for selection of a cohort may include a processing device programmed to: apply the deployed model to data representing a first plurality of individuals, the data including at least one characteristic of the first plurality of individuals; based on the application, select a subset of the first plurality of individuals as a cohort; receive data representing a second plurality of individuals labeled as within the cohort, the data including the at least one characteristic of the second plurality of individuals; compare the selected subset and the second plurality of individuals along the at least one characteristic; and determine whether the comparison results in a difference between the selected subset and the second plurality of individuals greater than a threshold.