首页>
外国专利>
Live resegmenting of partitions in distributed stream-processing platforms
Live resegmenting of partitions in distributed stream-processing platforms
展开▼
机译:在分布式流处理平台中对分区进行实时重新分段
展开▼
页面导航
摘要
著录项
相似文献
摘要
Techniques for resegmenting a partition in a distributed stream-processing platform are provided. The techniques include receiving a trigger to move a partition of the distributed stream-processing platform from a first broker on a first set of physical resources to a second broker on a second a set of physical resources. In response to the trigger, the partition is allocated on the second broker, and the first broker is configured to redirect, to the second broker, requests for new messages after a last offset in the partition without replicating older messages before the last offset to the second broker. Idempotent produce metadata for the partition from the first broker is then merged into the second broker. Finally, metadata for processing requests for the partition is updated to include the second broker.
展开▼