Backdoor detection in neural networks using gradients

摘要

Problem to be solved: to provide a mechanism for evaluating whether a machine learning model includes a backdoor trigger by evaluating a trained machine learning model.This mechanism processes the test data set to generate the output classification of the test dataset and test data sets Based on the output produced by processing the test data set, a gradient data indicative of the degree of variation in the test data set is generated.This mechanism analyzes gradient data and identifies the pattern of elements in a test dataset which indicates a backdoor trigger.This mechanism generates an output indicative of the presence of a backdoor trigger within the trained machine learning model in response to identifying the pattern of elements indicating the back door trigger.Diagram