An Improved Method for Automatically Determining Webpage Cohesiveness for Quality Information Retrieval from World Wide Web

摘要

Cohesiveness plays a major role in evaluating the overall quality of information contained in a webpage. Research has shown that it is an important dimension of quality, specifically for webpages that provide specialized information. This paper presents a new method for automatically measuring the cohesiveness of a webpage by using the semantic similarity score between sentences. Part of an overall research project for retrieving quality medical information from the World Wide Web, in this paper we describe this new measure of webpage cohesiveness, a system that automatically computes the webpage cohesiveness score. In addition, we evaluate the new method and find it to be effective in determining the cohesiveness of a webpage.