首页> 外文会议>Annual Water Environment Federation technical exhibition and conference >AUTOMATED DETECTION OF ANOMALIES IN HIGH-FREQUENCY WATER QUALITY SENSOR DATA USING MACHINE LEARNING
【24h】

AUTOMATED DETECTION OF ANOMALIES IN HIGH-FREQUENCY WATER QUALITY SENSOR DATA USING MACHINE LEARNING

机译:使用机器学习自动检测高频水质传感器数据中的异常

获取原文

摘要

High-quality, high-frequency data is essential for successful process modeling and process control. In this paper, a data-driven approach which makes use of deep learning techniques was taken to solve a real-world ammonia concentration dataset. Two rule-based algorithms serve as the benchmark, where both algorithms detect anomalies based on the statistical features. The LSTM approach considers periodicity to distinguish the normal with the abnormal behaviors, with the predicted anomalous data flagged and qualitatively ranked based on the severity and likelihood that the data are faulty (i.e., good, maybe faulty, probably faulty, definitely faulty).The results show that the LSTM based algorithm outperform the rule-based algorithm, where ten out of 11 anomalies can be detected with only one false positive. Both "real" anomalies were successfully detected. Further elimination of the "real" anomalies was then attempted with the flow and temperature datasets. The results show that temperature is not a perfect substitute for flow data. In practice, some water quality datasets may be needed to fully eliminate the impact of precipitation. The algorithms have been successfully applied to well-maintained sensor signals and are now being tested with poorly maintained sensors to judge their suitability in a real-world application.
机译:高品质,高频率数据是成功过程建模和过程控制是必不可少的。在本文中,一个数据驱动的方法,其利用的深度学习技术被带到了解决现实世界中的氨浓度数据集。两个基于规则的算法作为基准,其中两种算法基础上,统计功能检测异常。该LSTM方法考虑周期性区分正常与异常行为,与预测的异常数据标记和质量基础上的严重性和可能性的数据是错误的排名(即良好,可能存在故障,可能有问题,肯定是错误的)。该结果表明,基于LSTM算法优于基于规则的算法,其中可以只用一个假阳性被检测的11个异常十个有。成功地检测到两个“真实”的异常。那么“真实”的异常现象的进一步消除时试图流量和温度的数据集。结果表明,温度是不是流数据的完美替代品。在实践中,可能需要一些水质量数据集完全消除降水的影响。该算法已经成功地应用于维护良好的传感器信号,目前正与维护不善的传感器测试,以判断它们在真实世界中的应用的适用性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号