首页>
外国专利>
Dynamic scheduling of tasks for collecting and processing data using job configuration data
Dynamic scheduling of tasks for collecting and processing data using job configuration data
展开▼
机译:使用作业配置数据动态调度任务以收集和处理数据
展开▼
页面导航
摘要
著录项
相似文献
摘要
A scheduler manages execution of a plurality of data-collection jobs, assigns individual jobs to specific forwarders in a set of forwarders, and generates and transmits tokens (e.g., pairs of data-collection tasks and target sources) to assigned forwarders. The forwarder uses the tokens, along with stored information applicable across jobs, to collect data from the target source and forward it onto an indexer for processing. For example, the indexer can then break a data stream into discrete events, extract a timestamp from each event and index (e.g., store) the event based on the timestamp. The scheduler can monitor forwarders' job performance, such that it can use the performance to influence subsequent job assignments. Thus, data-collection jobs can be efficiently assigned to and executed by a group of forwarders, where the group can potentially be diverse and dynamic in size.
展开▼