DYNAMICALLY SCALING A NUMBER OF STREAM SEGMENTS THAT DYNAMICALLY STORE STREAMING DATA WHILE PRESERVING THE ORDER OF WRITES

摘要

Implementations are provided herein for auto-scaling a set of stream segments to a stream. In one implementation, the amount of stream segments can be scaled up and down depending on the amount of data ingested from writers. As the number of stream segments change, writers can have their streaming data transition to a newly merged stream segment or a newly split stream segment. The defined ordering of data as written by the writer is preserved as stream segments are scaled. It can be appreciated that a dynamically scaled stream can offer more capacity than any individual host can provide, while still preserving data order.