General Purpose Performance Evaluation tool for Analysis and COmparison of ATA Algorithms

摘要

To support autonopmous Target Acquisition (ATA) evaluation and trades analysis, the Air Force research laboratory, Advanced Guidance Division (AFRL/MNG) located at Eglin AFB has incorporated a general-purpose performance evaluation system into its Modular Algorithm Concept Evaluation Tool (MACET). The MACET performance evaluation system may be used for active, passive, or multi-sensor ATA analysis. It consists of two main elements: a relational, multi-uset of databases that are used to capture, catalog, and archiev test results for various algorithms under varying condition and environments. The MACET PET cient application is a data mining tool for exploring the ATA test results in the databases, computing standard ATA detection and classification performance metrics (e.g., detection probability, detection reliability, false alarm rate, probability of correct classification, confusion matrices) on user defined subsets of data, calculating test case parameter statistics, and generating performance comparison plots.