Analysis and Optimization of Information Retrieval Algorithms for Unstructured Data

摘要

The Internet has diversified in the form of an explosion in recent years. It has spawned countless forms of Internet branching, and at the same time brought information to the PB level, and massive data is also called big data. More than 85% of the collected data is composed by unstructured and semi-structured data; in order to solve the data group management in the contract system of a large-scale energy enterprise, it aims to realize the interconnection of upstream business data, technology interoperability, research collaboration, and promote the demand for intelligent and massive unstructured data retrieval. This paper proposes a non-institutional data retrieval optimization algorithm based on periodic data heat and category labels. The algorithm is implemented by correlating the user's retrieval behavior in the cycle and combining the defined file category tags. The experimental results show that the method not only can effectively filter and sort unstructured data, but also it can provide strong support for subsequent big data analysis and edge calculation.