首页> 外文会议>International Conference on Instrumentation and Measurement, Computer, Communication and Control >Research on the Algorithm of Hadoop-Based Spatial-Temporal Outlier Detection
【24h】

Research on the Algorithm of Hadoop-Based Spatial-Temporal Outlier Detection

机译:基于Hadoop的时空离群值检测算法研究

获取原文

摘要

A spatial-temporal outlier is an object whose non-spatial attribute value is significantly different from those of other objects in its spatial and temporal neighbors. Identifying or detecting spatial-temporal outliers will help us find some unexpected, interesting and useful knowledge in many application fields, for example: financial fraud detection, fault diagnosis, network intrusion detection and so on. However, the existing spatial-temporal outlier detection algorithms can't efficiently deal with big dataset. In this paper, a Hadoop-based spatial-temporal outlier detection algorithm is proposed. This approach takes the spatial autocorrelation into consideration. Therefore, the weight is introduced in the approach. However, the calculation involved in calculating weight is significantly large. Besides, the big dataset needs to be processed in this approach. Therefore, Hadoop is used to improve it's performance. The Ningbo sea tide dataset is used to validate the effectiveness and scalability of this approach.
机译:时空离群值是一个对象,其非空间属性值与其时空邻居中的其他对象的非空间属性值显着不同。识别或检测时空异常值将帮助我们在许多应用领域中找到一些意料之外的,有趣的和有用的知识,例如:财务欺诈检测,故障诊断,网络入侵检测等。但是,现有的时空离群值检测算法不能有效地处理大数据集。本文提出了一种基于Hadoop的时空离群值检测算法。这种方法考虑了空间自相关。因此,在该方法中引入了权重。但是,计算权重所涉及的计算量很大。此外,大数据集需要以这种方式进行处理。因此,使用Hadoop来提高其性能。宁波海潮数据集用于验证这种方法的有效性和可扩展性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号