Audit Machine Learning Models Against Bias

摘要

A method and system of mitigating bias in a decision-making system are provided. A presence of bias is identified in one or more machine learning models. For each of the machine learning models, a presence of bias in an output of the model is determined. One or more options to mitigate a system bias during a processing stage, based on the identified presence of bias for each of the one or more models, are determined. One or more options to mitigate the system bias during a post-processing stage, based on the identified presence of bias in each output of the models, are determined. A combination of options is provided, including (i) a processing option for the processing stage, and (ii) a post-processing option for the post-processing stage, wherein the combination of options accommodates a threshold bias limit to the system bias and a total bias mitigation cost threshold.