Data Model for Analysis of Scholarly Documents in the MapReduce Paradigm

摘要

At CeON ICM UW we are in possession of a large collec tion of scholarly documents that we store and process using MapReduce paradigm. One of the main challenges is to design a simple, but effective data model that fits various data access patterns and allows us to perform diverse analysis efficiently. In this paper, we will describe the organiza tion of our data and explain how this data is accessed and processed by open-source tools from Apache Hadoop Ecosystem.