Engineering Commons^™

Utility Of Experimental Design In Automatic Target Recognition Performance Evaluation, James M. Higdon

Theses and Dissertations

This research investigates current practices in test and evaluation of classification algorithms, and recommends improvements. We scrutinize the evaluation of automatic target recognition algorithms and rationalize the potential for improvements in the accepted methodology. We propose improvements through the use of an experimental design approach to testing. We demonstrate the benefits of improvements by simulating algorithm performance data and using both methodologies to generate evaluation results. The simulated data is varied to test the sensitivity of the benefits to a broad set of outcomes. The opportunities for improvement are threefold. First, the current practice of 'one-at-a-time factor variation (only one …