首页>
外国专利>
Structured Weight Based Sparsity In An Artificial Neural Network Compiler
Structured Weight Based Sparsity In An Artificial Neural Network Compiler
展开▼
机译:人工神经网络编译器中基于结构权重的稀疏性
展开▼
页面导航
摘要
著录项
相似文献
摘要
A novel and useful system and method of improved power performance and lowered memory requirements for an artificial neural network based on packing memory utilizing several structured sparsity mechanisms. The invention applies to neural network (NN) processing engines adapted to implement mechanisms to search for structured sparsity in weights and activations, resulting in a considerably reduced memory usage. The sparsity guided training mechanism synthesizes and generates structured sparsity weights A compiler mechanism within a software development kit (SDK), manipulates structured weight domain sparsity to generate a sparse set of static weights for the NN. The structured sparsity static weights are loaded into the NN after compilation and utilized by both the structured weight domain sparsity mechanism and the structured activation domain sparsity mechanism. The application of structured sparsity lowers the span of search options and creates a relatively loose coupling between the data and control planes.
展开▼