基于超链接和 DOM 结构树的网页标题实时抽取方法

摘要

Correct extraction of Web title is significant to Web text information mining.This paper proposed a method which can get a real-time Web page title extraction.This method first used a real-time analysis model though the catalog page, and then used the hyperlink-based travelsal approach, and used the correspondence between the title and the release time to get the URL of the page and the corresponding anchor text.If the anchor text we have was not the title of the text page, we should get the Web page HTML source code and build a DOM tree for the corresponding theme-based Web page.Based on the visual characteristics of the Web page title, we traversed the DOM tree in depth-first order.The experimental results demonstrate that this method is of high accuracy and can be simply implemented and so on.%网页标题的正确抽取，在Web文本信息抽取领域有着重大意义。本文提出一种网页标题实时抽取方法。首先通过对目录型网页进行实时解析，接着采用基于超链接遍历的方法，并利用标题与发布时间的对应关系，最终获取对应目录型网页的URL及锚文本。若获得锚文本不是网页正文的标题，则获取主题型网页的HTML源码并构建网页DOM树。在此基础上，结合网页标题的视觉特点，深度优先遍历DOM树，正确提取网页正文标题。实验结果表明，本文提出的Web网页标题实时抽取方法，具有实现简单，准确率高等优点。