首页> 外文会议>Annual Water Environment Federation technical exhibition and conference >AUTOMATED DETECTION OF ANOMALIES IN HIGH-FREQUENCY WATER QUALITY SENSOR DATA USING MACHINE LEARNING
【24h】

AUTOMATED DETECTION OF ANOMALIES IN HIGH-FREQUENCY WATER QUALITY SENSOR DATA USING MACHINE LEARNING

机译:基于机器学习的高频水质传感器数据异常自动检测

获取原文

摘要

High-quality, high-frequency data is essential for successful process modeling and process control. In this paper, a data-driven approach which makes use of deep learning techniques was taken to solve a real-world ammonia concentration dataset. Two rule-based algorithms serve as the benchmark, where both algorithms detect anomalies based on the statistical features. The LSTM approach considers periodicity to distinguish the normal with the abnormal behaviors, with the predicted anomalous data flagged and qualitatively ranked based on the severity and likelihood that the data are faulty (i.e., good, maybe faulty, probably faulty, definitely faulty).The results show that the LSTM based algorithm outperform the rule-based algorithm, where ten out of 11 anomalies can be detected with only one false positive. Both "real" anomalies were successfully detected. Further elimination of the "real" anomalies was then attempted with the flow and temperature datasets. The results show that temperature is not a perfect substitute for flow data. In practice, some water quality datasets may be needed to fully eliminate the impact of precipitation. The algorithms have been successfully applied to well-maintained sensor signals and are now being tested with poorly maintained sensors to judge their suitability in a real-world application.
机译:高质量,高频数据对于成功的过程建模和过程控制至关重要。在本文中,采用了一种利用深度学习技术的数据驱动方法来解决现实世界中的氨气浓度数据集。两种基于规则的算法用作基准,两种算法都基于统计特征检测异常。 LSTM方法考虑了周期性,以区分正常行为与异常行为,并根据数据出现故障的严重性和可能性(即好,可能有故障,可能有故障,肯定有故障)来标记预测的异常数据并对其进行定性排名。结果表明,基于LSTM的算法优于基于规则的算法,在11种异常中,只有10个假阳性可以检测到10种。两个“真实”异常均已成功检测到。然后尝试使用流量和温度数据集进一步消除“真实”异常。结果表明,温度并不是流量数据的理想替代品。实际上,可能需要一些水质数据集才能完全消除降水的影响。该算法已成功应用于维护良好的传感器信号,目前正在使用维护较差的传感器进行测试,以判断其在实际应用中的适用性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号