Subject Matter Expert (SME)/Peer Use in MS VV

摘要

Review by experts and peers is a primary validation technique in all aspects of software and system development as well as for models and simulation. This kind of validation technique is widely used both because of its capabilities to provide insight about model and simulation capabilities and because adequate real world (experimental) data often are not available to allow robust quantitative validation. Ways that reviewers are selected, managed, and used are very important, and so are how reviews are conducted and responses to them. Review use of experts and peers is an area in which there is very little documented guidance among modeling and simulation, software, and systems engineering communities-no formal standards for such reviews exist in any of these communities. This paper a) identifies the guidance that exists about reviews in modeling and simulation, b) describes current practices with identification of strengths and weaknesses, c) examines processes used within the legal system to determine expert witness qualifications and extracts useful principles applicable to modeling and simulation, and d) suggests both research endeavors and best practices that can lead to improvements in modeling and simulation reviews.