Automated Data Augmentation Services Using Text Mining, Data Cleansing and Web Crawling Techniques

摘要

There is a large amount of information about celebrities spread all over the web hidden inside innumerable news and blogs, pictures on Flickr or videos on YouTube. Having this information combined and aggregated would be of great benefit to many customers. In this document we will describe the architecture and the (business) value of a system that not only collates information pre-formatted by other web services but also provides a self-developed named entity recognition algorithm for extracting the names of celebrities from different data sources and then processes and enriches them by our mash-up application.