首页>
外国专利>
System for dynamic batching at varying granularities using micro-batching to achieve both near real-time and batch processing characteristics
System for dynamic batching at varying granularities using micro-batching to achieve both near real-time and batch processing characteristics
展开▼
机译:使用微批处理以可变粒度进行动态批处理的系统,以实现近实时和批处理特性
展开▼
页面导航
摘要
著录项
相似文献
摘要
This disclosure relates generally to automated workflow for data management, and specifically to efficient data manipulation and information extraction techniques used by a versatile data analytics platform. The information extraction techniques include micro-batching and provenance tracking, as well as integration of provenance-driven policies to improve the efficacy of the analytics. Embodiments disclosed here integrate the concept of real-time or near-real-time data stream processing and event/batch processing into one data processing layer, allowing a single processing definition to be applied at different granularities.
展开▼