首页> 外文OA文献 >Separating passing and failing test executions by clustering anomalies
【2h】

Separating passing and failing test executions by clustering anomalies

机译:通过聚类异常将通过和失败的测试执行分开

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务,本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文,但由于OA文献来源多样且变更频繁,仍可能出现获取不到、文献不完整或与标题不符等情况,如果获取不到我们将提供退款服务。请知悉。

摘要

Developments in the automation of test data generation have greatly improved efficiency of the software testing process, but the so-called oracle problem (deciding the pass or fail outcome of a test execution) is still primarily an expensive and error-prone manual activity. We present an approach to automatically detect passing and failing executions using cluster-based anomaly detection on dynamic execution data based on firstly, just a system’s input/output pairs and secondly, amalgamations of input/output pairs and execution traces. The key hypothesis is that failures will group into small clusters, whereas passing executions will group into larger ones. Evaluation on three systems with a range of faults demonstrates this hypothesis to be valid—in many cases small clusters were composed of at least 60 % failures (and often more). Concentrating the failures in these small clusters substantially reduces the numbers of outputs that a developer would need to manually examine following a test run and illustrates that the approach has the potential to improve the effectiveness and efficiency of the testing process.
机译:测试数据生成自动化的发展极大地提高了软件测试过程的效率,但是所谓的oracle问题(决定测试执行的通过或失败结果)仍然主要是昂贵且易于出错的手动活动。我们提出一种方法,该方法基于动态执行数据的基于集群的异常检测来自动检测通过和失败的执行,首先基于一个系统的输入/输出对,其次基于输入/输出对和执行轨迹的合并。关键假设是,失败将被分组为较小的集群,而传递的执行将被分组为较大的集群。对具有一系列故障的三个系统的评估证明了该假设是正确的-在许多情况下,小型集群至少由60%的故障(甚至更多)组成。将故障集中在这些小型集群中会大大减少开发人员在测试运行后需要手动检查的输出数量,并说明该方法具有提高测试过程的有效性和效率的潜力。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号