FAST PROCESSING AND EXPLOITATION OF FULL MISSION DATASETS FOR ESA-CCI

摘要

The Calvalus system applies the open-source cluster middleware Apache Hadoop to earth observation for full mission reprocessing and validation. Hadoop comes with good scalability to petabytes of data by processing data-local and avoiding even local area network bottlenecks. The MapReduce programming model and data streaming is complemented by processing workflows, full mission matchup extraction and trend analysis, processor interfaces, and bulk production control provided by Calvalus.