首页>
外国专利>
System and method for fault-tolerant parallel learning over non-iid data
System and method for fault-tolerant parallel learning over non-iid data
展开▼
机译:用于非iid数据的容错并行学习的系统和方法
展开▼
页面导航
摘要
著录项
相似文献
摘要
A network device, system, and method are provided. The network device includes a processor. The processor is configured to store a local estimate and a dual variable maintaining an accumulated subgradient for the network device. The processor is further configured to collect values of the dual variable of neighboring network devices. The processor is also configured to form a convex combination with equal weight from the collected dual variable of neighboring network devices. The processor is additionally configured to add a most recent local subgradient for the network device, scaled by a scaling factor, to the convex combination to obtain an updated dual variable. The processor is further configured to update the local estimate by projecting the updated dual variable to a primal space.
展开▼