海量题库中的特定数据搜索系统的设计与实现

摘要

In the process of mining huge amounts of data set,the traditional massive data retrieval method is unable to adapt to the rapidly increasing trends of data in the massive question banks,and can not achieve the high quality mining results within a limit time. Therefore,the system for specific data fast search in the massive question banks was designed and imple⁃mented with Elastic Search distributed architecture technology. The system consists of user interface,database connection mod⁃ule,data extraction module,index shaping retrieval module,index retrieval module,data search module,etc. The design and implementation processes of data extraction module,index shaping module and index retrieval module are introduced in detail. The three modules accomplish the quick search task of specific data in the massive question bank collaboratively. The experimen⁃tal results show that the system has high performance in three aspects of average response time,system resource consumption and index retrieval performance,and can meet users′ needs to quickly retrieve the specific data.%在挖掘海量数据集过程中，传统海量数据检索方法无法适应海量题库中数据的快速增加趋势，不能在有限时间内获取高质量的挖掘结果。因此，采用Elastic Search 分布式架构技术，设计并实现了海量题库中的特定数据快速搜索系统。该系统由用户界面、数据库连接模块、数据抽取模块、索引塑造检索以及索引检索和数据搜索模块等构成。详细介绍了数据抽取模块、索引塑造模块以及索引检索模块的设计和实现过程，3个模块共同实现海量题库中的特定数据快速搜索任务。实验结果表明，该系统的搜索平均响应时间、系统资源消耗以及索引检索性能三方面的性能较高，能够满足用户快速检索特定数据的需求。