It is time for a monstrous change in how we treat test automation. Test automation has always been difficult to justify. The effort, the cost, the analysis - is it worth it? Sure, you find bugs, but are they the important bugs? Many people see the time and expense and wonder if it should be spent elsewhere. Those days can end. Using data analysis and customer telemetry, it is completely feasible to assign direct value to how the test automation relates to the real business value of faster delivery of what the customer really needs with higher quality. The key is to turn the test automation activity into part of the product itself, and the tests into just one more user of your system - a user that YOU control. You can know, for certain, which test activities are important, which ones are helping you go faster and which ones are finding the issues the users will care about because you will think about the test results the same way you think about end users. This presentation will describe how the Microsoft Office team bridged the gap and collapsed the silos between product and test automation. It will show how the telemetry signal and analysis features and services that are a regular part of the Office product were the critical component to finally solving the age old problem of tests completely disconnected from customer needs and business value. It will show how individual product teams within Office use insights gained from bridging that gap to identify real problems earlier and ship with confidence faster and more often.
展开▼
