Extraction of Website Navigation Label Using A Multiple Web Crawler. A Case Study on 14 University Websites in Indonesia

摘要

Labeling system is designed for a website to find information easily. Labeling system in a website is required to represent the information contents. One of methods to design labeling system is to compare a website with its competitors’ websites. The benefit of comparing labels is to get common labels therefore it will make users to easily find and use the labeling system. Labels are extracted using a web crawler. To make web crawler, it must consider the structure of targeted website. The problems arise when there are several different target websites that will be compared. That means, it is necessary to create some unique and different web crawler program codes, so it takes a long time. This research proposes and analyzes multiple web crawler. The step to make multiple web crawler is, first, start to collect targeted website based on 14 top Indonesia’s University (based on Indonesia Higher Education’s University Ranking). Next step is analyzing the pattern of structure navigation labels. Then the results are used to make a multiple web crawler. The result of this research is a multiple web crawler that can extract navigation label of several different target websites automatically without writing another program code of different web crawler for each crawled website.