Automated analysis of machine-generated test-results - An exploration of the efficiency gains from automated testing

摘要

Testing and measuring has become increasingly prevalent and important in industrial settings as products andprocesses move towards greater complexity. To be able to more fully judge quality and progress in a developingsystem, companies strive to test widely and test often. How, then, can these results be best taken advantage of?Many organisations favour using automated frameworks generating data based on either random permutations ofconfigurations or constant running of pre-defined tests. However, it becomes difficult and infeasible for humans tomanually trawl through the amounts of data produced when running such automated tests. Clearly, a tool or systemto assist is required. This study will examine the potential improvements to efficiency made with the introduction of abespoke test analysis system to one such company.