Test and Evaluation: DOD has been Slow in Improving Testing of Software-IntensiveSystems

摘要

Department of Defense (DoD) software cost total over $30 billion a year(estimated to be $42 billion by 1995), of which about two-thirds is for maintaining upgrading and modifying operational systems already in production. Today's major defense systems depend largely on the quality of this complex and increasingly costly software. In fact, many major weapon systems cannot operate if the software fails to function as required. Because software errors can cause a system to fail, possibly with life-threatening consequences, software-intensive systems need to be thoroughly test before production). Since the early 1970s, GAO has reported problems in operational test and evaluation of defense acquisition programs. Senior DoD officials, as well as Members of the Congress, are concerned that many of these problems continue today, particulary in software-intensive systems. Because of these concerns, GAO initiated this review to identify (1) the extent that software-related problems affect the performance of defense acquisition programs during operational test and evaluation, (2) pervasive barriers in the acquisition process that limit the effectiveness of the test and evaluation of software-intensive systems, and (3) DoD's effort to resolve software test and evaluation problems. Although GAO recognizes that inherently complex technical characteristics contribute to software problems, this report focuses more directly on nontechnical barriers that limit the effectiveness of operational test and evaluation and need management attention.