首页> 外国专利> FLINK ENGINE-BASED DATA PARSING METHOD AND APPARATUS

FLINK ENGINE-BASED DATA PARSING METHOD AND APPARATUS

机译:基于Flink引擎的数据解析方法和装置

摘要

Disclosed in the present invention are a Flink engine-based data parsing method and apparatus. The method comprises: receiving, via a Flink platform external interface, parsing logic and data source information configured by a user; generating a parser according to the parsing logic and the data source information, and uploading the parser to a distributed file system; and parsing data to be parsed sent to a Flink data source in advance and corresponding to the data source information by using the parser obtained from the distributed system to generate parsed data. According to the present invention, a parser is generated according to parsing logic and data source information configured by a user to replace a Flink native parser, so that data to be parsed in different formats can be parsed, thereby meeting various service scenes; the parsing logic and data source information configured by the user are received by developing a Flink platform external interface to generate the parser, so that the expansibility of various services is achieved.
机译:本发明公开了一种基于传递发动机的数据解析方法和装置。该方法包括:通过Flink平台外部接口,解析由用户配置的解析逻辑和数据源信息;根据解析逻辑和数据源信息生成解析器,并将解析器上载到分布式文件系统;并通过使用从分布式系统获得的解析器来预先将要解析的数据分析到传递数据源并与数据源信息相对应地生成解析数据。根据本发明,根据用户配置的解析逻辑和数据源信息来生成解析器以替换传递的传递原生解析器,从而可以解析以不同格式解析的数据,从而满足各种服务场景;通过开发用于生成解析器的传递平台外部接口来接收用户配置的解析逻辑和数据源信息,从而实现各种服务的可扩展性。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号