DISCRIMINATIVE FEATURE SELECTION FOR DATA SEQUENCES

摘要

A discriminative feature selection method for selecting a set of features from a set of training data sequences is described. The training data sequences are generated by at least two data sources, and each data sequence consists of a sequence of data symbols taken from an alphabet. The method is performed by first building a suffix tree from the training data. The suffix tree contains only suffixes of the data sequences having an empirical probability of occurrence greater than a first predetermined threshold, from at least one of the sources. Next the suffix tree is pruned of all suffixes for which there exists in the suffix tree a shorter suffix having equivalent predictive capability, for all of the data sources.