基于ELK自动化收集Docker容器日志的分析系统

摘要

针对Docker容器集群中日志的收集和集中处理的问题.本文采用Docker Swarm和Etcd实现容器的管理、服务发现以及调度,并为分布式系统提供支撑.使用主流的开源日志收集系统ELK,并结合分布式消息队列redis部署实时消息自动化系统,能够快速、实时地收集应用日志,提高运维人员的工作效率.详细介绍了Docker、ELK、Docker Swarm和Etcd的功能及原理,最后通过使用容器编排工具docker-compose,一键式构建基于Docker容器的ELK日志收集系统的实验环境,证明了本系统收集Docker容器日志的实时性、稳定性和高可用性.%According to the log Docker container cluster in the collection and centralized processing problems. In this paper, Swarm Docker and Etcd are used to realize the management of containers, service discovery and scheduling, and to provide support for distributed systems. Using the mainstream open source log collection system ELK, combined with distributed message queue redis deployment of real-time message automation system, can quickly and real-time collection of application log, improve the efficiency of operation and maintenance personnel. This paper introduces the function and principle of Docker, ELK, Docker, Swarm and Etcd, finally,by useing the container layout tool docker-compose, one button in the experimental environment of Docker container based on ELK log collection system, it is proved that the system collects the Docker container log in real-time, stable and high availability.