首页>
外国专利>
Re-sizing data partitions for ensemble models in a mapreduce framework
Re-sizing data partitions for ensemble models in a mapreduce framework
展开▼
机译:在mapreduce框架中调整整体模型的数据分区的大小
展开▼
页面导航
摘要
著录项
相似文献
摘要
Techniques are described for revising data partition size for use in generating predictive models. In one example, a method includes determining an initial number of base model partitions of data from a plurality of data sources; determining an initial base model partition size based at least in part on the initial number of base model partitions; and evaluating the initial base model partition size at least in part with reference to at least one base model partition size reference. The method further includes determining a finalized number of base model partitions based at least in part on the initial base model partition size; determining a revised base model partition size; and generating revised base models based at least in part on the revised base model partition size, including using a predictive modeling framework to randomly assign input data records from the plurality of data sources into the base model partitions.
展开▼