【24h】

Pigeon: A spatial MapReduce language

机译:鸽子:一种空间MapReduce语言

获取原文

摘要

With the huge amounts of spatial data collected everyday, MapReduce frameworks, such as Hadoop, have become a common choice to analyze big spatial data for scientists and people from industry. Users prefer to use high level languages, such as Pig Latin, to deal with Hadoop for simplicity. Unfortunately, these languages are designed for primitive non-spatial data and have no support for spatial data types or functions. This demonstration presents Pigeon, a spatial extension to Pig which provides spatial functionality in Pig. Pigeon is implemented through user defined functions (UDFs) making it easy to use and compatible with all recent versions of Pig. This also allows it to integrate smoothly with existing non-spatial functions and operations such as Filter, Join and Group By. Pigeon is compatible with the Open Geospatial Consortium (OGC) standard which makes it easy to learn and use for users who are familiar with existing OGC-compliant tools such as PostGIS. This demonstrations shows to audience how to work with Pigeon through some interesting applications running on large scale real datasets extracted from OpenStreetMap.
机译:随着每天收集的大量空间数据,诸如Hadoop之类的MapReduce框架已成为分析科学家和业界人士的大空间数据的常见选择。为了简化,用户更喜欢使用高级语言(例如Pig Latin)来处理Hadoop。不幸的是,这些语言是为原始的非空间数据而设计的,不支持空间数据类型或功能。该演示展示了Pigeon,它是Pig的空间扩展,可在Pig中提供空间功能。 Pigeon是通过用户定义的功能(UDF)来实现的,从而使其易于使用并与所有最新版本的Pig兼容。这也使它可以与现有的非空间功能和操作(如过滤器,联接和分组依据)平滑集成。 Pigeon与开放地理空间联盟(OGC)标准兼容,对于熟悉现有OGC兼容工具(如PostGIS)的用户而言,Pigeon使其易于学习和使用。这个演示向观众展示了如何通过一些有趣的应用程序来与Pigeon一起工作,这些应用程序运行在从OpenStreetMap提取的大规模真实数据集上。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号