Method for Extracting InputFormat for Handling Network Packet Data on Hadoop MapReduce

摘要

The present invention for processing packet data in a binary format that has a record of variable length in Hadoop MapReduce relates to a new format, type, the method comprising: obtaining information about the configuration property from the start time and end time, and performing the capture of (A) packet; (B) Hadoop distributed file system comprising: retrieving the start point of the first packet in the data block of the data block must be processed to be stored in (HDFS); (C) defining a InputSplit by the first packet as a starting point to the starting point of the previous InputSplit InputSplit to set the boundaries of their InputSplit; (D) generating a return RecordReader to do their job by reading each captured packet length (capLen) recorded in InpuSplit entire captured packets of each packet from the starting point to the header area (pcap header) defined above, and this Steps to; And (E) a step of extracting said record in the form of a (Key, Value) through RecordReader (LongWritable, BytesWritable);. Is characterized in that comprises a ;