System Test Metrics on a Development-Intensive Project

摘要

No software is bug-free, despite what certain large corporations would have us believe, and the opportunities for introduction of defects or unintentional behaviour between requirement and delivery are enormous. This paper presents the experiences of Thales Sensors (Racal Radar defence Systems at the time) in attempting to quantify the effectiveness of our system testing procedures, as a metric to be used in assessing fitness for delivery. This method is suitable for current, 'black box' MoD procurement processes. The paper goes on to propose a similar metric to assess fitness of a statement of requirement as a basis for procurement or release for design. This could be used as a basis for co-operative, 'white box' procurement processes under consideration for Defence Acquisition reform.