实时网络流特征提取系统设计

摘要

Aiming at the problem that packet sampling technique has lower flow feature extraction accuracy in high-speed network,a real-time network flow feature extraction system is implemented in NetFPGA.Making full use of NetFPGA high running speed and powerful parallel processing ability,the system can support gigabit data throughput.This real-time extraction system consists of two key elements,including address mapping module and flow table core processing module.The former uses pipeline technique to index flow record quickly through Bob Jenkins hash algorithm.The latter can update flow table rapidly by parallelizing query and match flow record.Online traffic test results show that the system can achieve real-time flow feature extraction in 1Gbps Internet connection.%针对包采样技术在高速网络环境中提取流特征准确率低的问题,利用NetFPGA运行速度快,并行处理能力强的优势,实现了一个实时网络流特征提取系统,使其支持千兆级数据吞吐率.该系统有两个重要模块:地址映射模块和流表核心处理模块,前者将Bob Jenkins哈希算法通过流水线方式设计,实现流记录的快速索引;后者通过对流记录的并行查询与匹配,实现对流表的快速更新.对该系统进行在线流量测试,结果表明其能够在1 Gbps网络中实现对网络流特征的实时提取.