日志监控和分析在保障业务稳定运行时,起到了很重要的作用,不过一般情况下日志都分散在各个生产服务器,且开发人员无法登陆生产服务器,这时候就需要一个集中式的日志收集装置,对日志中的关键字进行监控,触发异常时进行报警,并且开发人员能够查看相关日志。logstash+elasticsearch+kibana3就是实现这样功能的一套系统,并且功能更强大。

  Logstash:负责日志的收集,处理和储存
  Elasticsearch:负责日志检索和分析
  Kibana:负责日志的可视化

1、环境介绍

  elkServer
    IP:192.168.7.27
    OS:Centos7.1
    FQDN:elk.server.com

  elkClient

    IP:192.168.31.23
    OS:Centos7.1

2、下载准备

  官网下载最新的安装包:https://www.elastic.co/downloads(目前有些版本的包可能下载不到了,请到该地址下载——链接:http://pan.baidu.com/s/1gfohO2Z 密码:5s1f)

  1. elasticsearch-1.7..noarch.rpm server上安装)
  2. kibana-4.1.-linux-x64.tar.gz server上安装)
  3. logstash-1.5.-.noarch.rpm server上安装)
  4. logstash-forwarder-0.4.-.x86_64.rpm client上安装)

3、Server端安装

3.1安装jdk1.7

  1. [root@localhost ~]# yum install java-1.7.-openjdk
  2. Loaded plugins: fastestmirror, langpacks
  3. base | 3.6 kB ::
  4. extras | 3.4 kB ::
  5. updates | 3.4 kB ::
  6. Loading mirror speeds from cached hostfile
  7. * base: mirrors.btte.net
  8. * extras: mirrors..com
  9. * updates: mirrors..com
  10. Package :java-1.7.-openjdk-1.7.0.91-2.6.2.1.el7_1.x86_64 already installed and latest version
  11. Nothing to do

3.2安装elasticsearch

  1. [root@localhost elk]# yum localinstall elasticsearch-1.7..noarch.rpm (yum 本地安装elasticsearch
  2. Loaded plugins: fastestmirror, langpacks
  3. Examining elasticsearch-1.7..noarch.rpm: elasticsearch-1.7.-.noarch
  4. elasticsearch-1.7..noarch.rpm: does not update installed package.
  5. Nothing to do
  6. [root@localhost elk]# systemctl daemon-reload
  7. [root@localhost elk]# systemctl enable elasticsearch.service (设置开机自启动)
  8. ln -s '/usr/lib/systemd/system/elasticsearch.service' '/etc/systemd/system/multi-user.target.wants/elasticsearch.service'
  9. [root@localhost elk]# systemctl start elasticsearch.service (开启服务)
  10. [root@localhost elk]# systemctl status elasticsearch.service (查看服务状态)
  11. elasticsearch.service - Elasticsearch
  12. Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled)
  13. Active: active (running) since Sun -- :: CST; 28s ago
  14. Docs: http://www.elastic.co
  15. Main PID: (java)
  16. CGroup: /system.slice/elasticsearch.service
  17. ?.. java -Xms256m -Xmx1g -Djava.awt.headless=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction= -XX:+UseCMSInitiatingOccupancyOnly -XX:+Heap...
  18.  
  19. Nov :: localhost.localdomain systemd[]: Started Elasticsearch.
  20. [root@localhost elk]# rpm -qc elasticsearch
  21. /etc/elasticsearch/elasticsearch.yml
  22. /etc/elasticsearch/logging.yml
  23. /etc/init.d/elasticsearch
  24. /etc/sysconfig/elasticsearch
  25. /usr/lib/sysctl.d/elasticsearch.conf
  26. /usr/lib/systemd/system/elasticsearch.service
  27. /usr/lib/tmpfiles.d/elasticsearch.conf
  28. [root@localhost elk]# netstat -nltp (查看端口监听状况)
  29. Active Internet connections (only servers)
  30. Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
  31. tcp 0.0.0.0: 0.0.0.0:* LISTEN /rpcbind
  32. tcp 0.0.0.0: 0.0.0.0:* LISTEN /sshd
  33. tcp 127.0.0.1: 0.0.0.0:* LISTEN /cupsd
  34. tcp 127.0.0.1: 0.0.0.0:* LISTEN /master
  35. tcp 127.0.0.1: 0.0.0.0:* LISTEN /sshd: root@pt
  36. tcp6 ::: :::* LISTEN /rpcbind
  37. tcp6 0 0 :::9200 :::* LISTEN 15345/java
  38. tcp6 0 0 :::9300 :::* LISTEN 15345/java
  39. tcp6 ::: :::* LISTEN /sshd
  40. tcp6 ::: :::* LISTEN /cupsd
  41. tcp6 ::: :::* LISTEN /master
  42. tcp6 ::: :::* LISTEN /sshd: root@pt
  43. [root@localhost elk]# firewall-cmd --permanent --add-port={/tcp,/tcp} (防火墙添加两个端口)
  44. success
  45. [root@localhost elk]# firewall-cmd --reload (重载防火墙)
  46. success
  47. [root@localhost elk]# firewall-cmd --list-all (查看防火墙开发端口)
  48. public (default, active)
  49. interfaces: ens33
  50. sources:
  51. services: dhcpv6-client ssh
  52. ports: /tcp /tcp
  53. masquerade: no
  54. forward-ports:
  55. icmp-blocks:
  56. rich rules:

3.3安装kibana

  1. [root@localhost elk]# tar zxf kibana-4.1.-linux-x64.tar.gz -C /usr/local/ (解压缩安装包到指定目录中)
  2. [root@localhost elk]# cd /usr/local/
  3. [root@localhost local]# ls
  4. bin etc games include kibana-4.1.-linux-x64 lib lib64 libexec sbin share src
  5. [root@localhost local]# mv kibana-4.1.-linux-x64/ kibana (重命名)
  6. [root@localhost local]# cd kibana/
  7. [root@localhost kibana]# ls
  8. bin config LICENSE.txt node plugins README.txt src
  9. [root@localhost kibana]# cd bin/
  10. [root@localhost bin]# ls (运行./kibana即可开启服务,但我们将其做到service
  11. kibana kibana.bat
  12. [root@localhost bin]# cd /etc/systemd/system/
  13. [root@localhost system]# vi kibana.service (编辑kibana服务)

  14. [Service]
  15. ExecStart=/usr/local/kibana/bin/kibana
  16.  
  17. [Install]
  18. WantedBy=multi-user.target
  19.  
  20. [root@localhost system]# systemctl enable kibana.service (设置开机自启动)
  21. ln -s '/etc/systemd/system/kibana.service' '/etc/systemd/system/multi-user.target.wants/kibana.service'
  22. [root@localhost system]# systemctl start kibana.service (开启服务)
  23. [root@localhost system]# systemctl status kibana.service (查看服务运行状态)
  24. kibana.service
  25. Loaded: loaded (/etc/systemd/system/kibana.service; enabled)
  26. Active: active (running) since Sun -- :: CST; 10s ago
  27. Main PID: (node)
  28. CGroup: /system.slice/kibana.service
  29. ?.. /usr/local/kibana/bin/../node/bin/node /usr/local/kibana/bin/../src/bin/kibana.js
  30.  
  31. Nov :: localhost.localdomain systemd[]: Started kibana.service.
  32. Nov :: localhost.localdomain kibana[]: {"name":"Kibana","hostname":"localhost.localdomain","pid":,"level":,"msg":"No existing kibana index found","time":"20...43Z","v":}
  33. Nov :: localhost.localdomain kibana[]: {"name":"Kibana","hostname":"localhost.localdomain","pid":,"level":,"msg":"Listening on 0.0.0.0:5601","time":"2015-11...93Z","v":}
  34. Hint: Some lines were ellipsized, use -l to show in full.
  35. [root@localhost system]# netstat -nltp (查看端口监听状态)
  36. Active Internet connections (only servers)
  37. Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
  38. tcp 0 0 0.0.0.0:5601 0.0.0.0:* LISTEN 16131/node
  39. tcp 0.0.0.0: 0.0.0.0:* LISTEN /rpcbind
  40. tcp 0.0.0.0: 0.0.0.0:* LISTEN /sshd
  41. tcp 127.0.0.1: 0.0.0.0:* LISTEN /cupsd
  42. tcp 127.0.0.1: 0.0.0.0:* LISTEN /master
  43. tcp 127.0.0.1: 0.0.0.0:* LISTEN /sshd: root@pt
  44. tcp6 ::: :::* LISTEN /rpcbind
  45. tcp6 ::: :::* LISTEN /java
  46. tcp6 ::: :::* LISTEN /java
  47. tcp6 ::: :::* LISTEN /sshd
  48. tcp6 ::: :::* LISTEN /cupsd
  49. tcp6 ::: :::* LISTEN /master
  50. tcp6 ::: :::* LISTEN /sshd: root@pt
  51. [root@localhost system]# firewall-cmd --permanent --add-port=/tcp (防火墙开启5601端口)
  52. success
  53. [root@localhost system]# firewall-cmd --reload (重载防火墙)
  54. success
  55. [root@localhost system]# firewall-cmd --list-all (查看防火墙开放端口)
  56. public (default, active)
  57. interfaces: ens33
  58. sources:
  59. services: dhcpv6-client ssh
  60. ports: /tcp /tcp /tcp
  61. masquerade: no
  62. forward-ports:
  63. icmp-blocks:
  64. rich rules:
  65.  
  66. [root@localhost system]# firewall-cmd --permanent --add-forward-port=port=:proto=tcp:toport= (为5601端口添加80端口的映射,这样在浏览器中就可以不用输入端口了)
  67. success
  68. [root@localhost system]# firewall-cmd --reload (重载防火墙)
  69. success
  70. [root@localhost system]# firewall-cmd --list-all (查看防火墙开放端口)
  71. public (default, active)
  72. interfaces: ens33
  73. sources:
  74. services: dhcpv6-client ssh
  75. ports: /tcp /tcp /tcp
  76. masquerade: no
  77. forward-ports: port=:proto=tcp:toport=:toaddr=
  78. icmp-blocks:
  79. rich rules:

3.4安装logstash

  1. [root@localhost system]# cd /home/elk/
  2. [root@localhost elk]# ls
  3. elasticsearch-1.7..noarch.rpm kibana-4.1.-linux-x64.tar.gz logstash-1.5.-.noarch.rpm logstash-forwarder-0.4.-.x86_64.rpm
  4. [root@localhost elk]# yum localinstall logstash-1.5.-.noarch.rpm yum本地安装logstash
  5. Loaded plugins: fastestmirror, langpacks
  6. Examining logstash-1.5.-.noarch.rpm: :logstash-1.5.-.noarch
  7. Marking logstash-1.5.-.noarch.rpm to be installed
  8. Resolving Dependencies
  9. --> Running transaction check
  10. ---> Package logstash.noarch :1.5.- will be installed
  11. --> Finished Dependency Resolution
  12. base//x86_64 | 3.6 kB ::
  13. extras//x86_64 | 3.4 kB ::
  14. extras//x86_64/primary_db | kB ::
  15. updates//x86_64 | 3.4 kB ::
  16. updates//x86_64/primary_db | 4.7 MB ::
  17.  
  18. Dependencies Resolved
  19.  
  20. ===============================================================================================================================================================================================
  21. Package Arch Version Repository Size
  22. ===============================================================================================================================================================================================
  23. Installing:
  24. logstash noarch :1.5.- /logstash-1.5.-.noarch M
  25.  
  26. Transaction Summary
  27. ===============================================================================================================================================================================================
  28. Install Package
  29.  
  30. Total size: M
  31. Installed size: M
  32. Is this ok [y/d/N]: y
  33. Downloading packages:
  34. Running transaction check
  35. Running transaction test
  36. Transaction test succeeded
  37. Running transaction
  38. Installing : :logstash-1.5.-.noarch /
  39. Verifying : :logstash-1.5.-.noarch /
  40.  
  41. Installed:
  42. logstash.noarch :1.5.-
  43.  
  44. Complete!
  45. [root@localhost tls]# hostname -f (查看当前FQDNFQDN设置参见http://www.cnblogs.com/zhenyuyaodidiao/p/4947930.html)
  46. elk.server.com
  47. [root@localhost ~]# cd /etc/pki/tls/ (进入到/etc/pki/tls/文件夹)
  48. [root@localhost tls]# ls
  49. cert.pem certs misc openssl.cnf private
  50. (以下生成openssl key用于客户端上传日志文件用,在客户端配置时会用到)
  51. [root@localhost tls]# openssl req -subj '/CN=elk.server.com/' -x509 -days -batch -nodes -newkey rsa: -keyout private/logstash-forwarder.key -out certs/logstash-forwarder.crt
  52. Generating a bit RSA private key
  53. ..............+++
  54. .............+++
  55. writing new private key to 'private/logstash-forwarder.key'
  56. -----
  57. [root@localhost tls]# ls
  58. cert.pem certs misc openssl.cnf private
  59. [root@localhost tls]# cd private/
  60. [root@localhost private]# ll
  61. total
  62. -rw-r--r--. root root Nov : logstash-forwarder.key
  63. [root@localhost private]# cd ../certs/
  64. [root@localhost certs]# ll
  65. total
  66. lrwxrwxrwx. root root Apr ca-bundle.crt -> /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem
  67. lrwxrwxrwx. root root Apr ca-bundle.trust.crt -> /etc/pki/ca-trust/extracted/openssl/ca-bundle.trust.crt
  68. -rw-r--r--. root root Nov : logstash-forwarder.crt
  69. -rwxr-xr-x. root root Mar make-dummy-cert
  70. -rw-r--r--. root root Mar Makefile
  71. -rwxr-xr-x. root root Mar renew-dummy-cert
  72. [root@localhost ~]# cd /etc/logstash/conf.d/
  73. [root@localhost conf.d]# vi -logstash-initial.conf (编辑logstash配置文件)

  74. input {
  75. lumberjack {
  76. port =>
  77. type => "logs"
  78. ssl_certificate => "/etc/pki/tls/certs/logstash-forwarder.crt"
  79. ssl_key => "/etc/pki/tls/private/logstash-forwarder.key"
  80. }
  81. }
  82.  
  83. filter {
  84. if [type] == "syslog" {
  85. grok {
  86. match => { "message" => "%{SYSLOGTIMESTAMP:syslog_timestamp} %{SYSLOGHOST:syslog_hostname} %{DATA:syslog_program}(?:\[%{POSINT:syslog_pid}\])?: %{GREEDYDATA:syslog_message}" }
  87. add_field => [ "received_at", "%{@timestamp}" ]
  88. add_field => [ "received_from", "%{host}" ]
  89. }
  90. syslog_pri { }
  91. date {
  92. match => [ "syslog_timestamp", "MMM d HH:mm:ss", "MMM dd HH:mm:ss" ]
  93. }
  94. }
  95. }
  96.  
  97. output {
  98. elasticsearch { host => localhost }
  99. stdout { codec => rubydebug }
  100. }
  101.  
  102. [root@localhost conf.d]# systemctl enable logstash (设置开机自启动)
  103. logstash.service is not a native service, redirecting to /sbin/chkconfig.
  104. Executing /sbin/chkconfig logstash on
  105. The unit files have no [Install] section. They are not meant to be enabled
  106. using systemctl.
  107. Possible reasons for having this kind of units are:
  108. ) A unit may be statically enabled by being symlinked from another unit's
  109. .wants/ or .requires/ directory.
  110. ) A unit's purpose may be to act as a helper for some other unit which has
  111. a requirement dependency on it.
  112. ) A unit may be started when needed via activation (socket, path, timer,
  113. D-Bus, udev, scripted systemctl call, ...).
  114. [root@localhost conf.d]# systemctl start logstash.service (开启logstash服务)
  115. [root@localhost conf.d]# systemctl status logstash.service (查看服务运行状态)
  116. logstash.service - LSB: Starts Logstash as a daemon.
  117. Loaded: loaded (/etc/rc.d/init.d/logstash)
  118. Active: active (running) since Sun -- :: CST; 14s ago
  119. Process: ExecStart=/etc/rc.d/init.d/logstash start (code=exited, status=/SUCCESS)
  120. CGroup: /system.slice/logstash.service
  121. ?.. java -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless=true -XX:CMSInitiatingOccupancyFraction= -XX:+UseCMSInitiatingOccupancyOnly -Djava.io.tmpdir=/var/lib...
  122.  
  123. Nov :: elk logstash[]: logstash started.
  124. Nov :: elk systemd[]: Started LSB: Starts Logstash as a daemon..
  125. [root@localhost conf.d]# netstat -nltp (查看端口占用)
  126. Active Internet connections (only servers)
  127. Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
  128. tcp 0.0.0.0: 0.0.0.0:* LISTEN /node
  129. tcp 0.0.0.0: 0.0.0.0:* LISTEN /rpcbind
  130. tcp 0.0.0.0: 0.0.0.0:* LISTEN /sshd
  131. tcp 127.0.0.1: 0.0.0.0:* LISTEN /cupsd
  132. tcp 127.0.0.1: 0.0.0.0:* LISTEN /master
  133. tcp 127.0.0.1: 0.0.0.0:* LISTEN /sshd: root@pt
  134. tcp 127.0.0.1: 0.0.0.0:* LISTEN /sshd: root@pt
  135. tcp6 0 0 :::5000 :::* LISTEN 20805/java
  136. tcp6 ::: :::* LISTEN /rpcbind
  137. tcp6 ::: :::* LISTEN /java
  138. tcp6 ::: :::* LISTEN /java
  139. tcp6 ::: :::* LISTEN /java
  140. tcp6 ::: :::* LISTEN /sshd
  141. tcp6 ::: :::* LISTEN /cupsd
  142. tcp6 ::: :::* LISTEN /master
  143. tcp6 ::: :::* LISTEN /sshd: root@pt
  144. tcp6 ::: :::* LISTEN /sshd: root@pt
  145. [root@localhost conf.d]# cd /var/log/logstash/
  146. [root@localhost logstash]# ls (日志文件)
  147. logstash.err logstash.log logstash.stdout
  148. [root@localhost logstash]# firewall-cmd --permanent --add-port=/tcp (防火墙开放5000端口)
  149. success
  150. [root@localhost logstash]# firewall-cmd --reload (重载防火墙)
  151. success
  152. [root@localhost logstash]# firewall-cmd --list-all (查看端口开放情况)
  153. public (default, active)
  154. interfaces: ens33
  155. sources:
  156. services: dhcpv6-client ssh
  157. ports: /tcp /tcp /tcp /tcp
  158. masquerade: no
  159. forward-ports: port=:proto=tcp:toport=:toaddr=
  160. icmp-blocks:
  161. rich rules:

4、Client端安装

  1. [root@localhost elk]# vi /etc/hosts (编辑hosts文件)
  2. 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
  3. :: localhost localhost.localdomain localhost6 localhost6.localdomain6
  4. 192.168.7.27 elk.server.com
  5.  
  6. [root@localhost elk]# service network restart
  7. Restarting network (via systemctl): [ OK ]
  8. [root@localhost elk]# ping elk.server.com (测试连接)
  9. PING elk.server.com (192.168.7.27) () bytes of data.
  10. bytes from elk.server.com (192.168.7.27): icmp_seq= ttl= time=0.754 ms
  11. bytes from elk.server.com (192.168.7.27): icmp_seq= ttl= time=0.477 ms
  12. ^C
  13. --- elk.server.com ping statistics ---
  14. packets transmitted, received, % packet loss, time 1000ms
  15. rtt min/avg/max/mdev = 0.477/0.615/0.754/0.140 ms
  16. [root@localhost laizy]# mkdir elk
  17. [root@localhost laizy]# cd elk/
  18. [root@localhost elk]# ls
  19. [root@localhost elk]# scp root@192.168.7.27:/home/elk/logstash-forwarder-0.4.-.x86_64.rpm . (拷贝logstash-forwarder到本地)
  20. The authenticity of host '192.168.7.27 (192.168.7.27)' can't be established.
  21. ECDSA key fingerprint is :b9::::f2:::9b::bb::a5::f1:f9.
  22. Are you sure you want to continue connecting (yes/no)? yes
  23. Warning: Permanently added '192.168.7.27' (ECDSA) to the list of known hosts.
  24. root@192.168.7.27's password:
  25. logstash-forwarder-0.4.-.x86_64.rpm % 1692KB .7MB/s :
  26. [root@localhost elk]# ls
  27. logstash-forwarder-0.4.-.x86_64.rpm
  28. [root@localhost elk]# scp root@192.168.7.27:/etc/pki/tls/certs/logstash-forwarder.crt . (拷贝Server端的key到本地)
  29. root@192.168.7.27's password:
  30. logstash-forwarder.crt % .1KB/s :
  31. [root@localhost elk]# ll
  32. total
  33. -rw-r--r--. root root Nov : logstash-forwarder-0.4.-.x86_64.rpm
  34. -rw-r--r--. root root Nov : logstash-forwarder.crt
  35. [root@localhost elk]# cp logstash-forwarder.crt /etc/pki/tls/certs/ (将key拷贝到/etc/pki/tls/certs/下)
  36. [root@localhost elk]# cd /etc/pki/tls/certs/
  37. [root@localhost certs]# ls
  38. ca-bundle.crt ca-bundle.trust.crt logstash-forwarder.crt make-dummy-cert Makefile renew-dummy-cert
  39. [root@localhost certs]# cd /home/laizy/elk/
  40. [root@localhost elk]# ls
  41. logstash-forwarder-0.4.-.x86_64.rpm logstash-forwarder.crt
  42. [root@localhost elk]# yum localinstall logstash-forwarder-0.4.-.x86_64.rpm (yum本地安装logstash-forwarder)
  43. Loaded plugins: fastestmirror, langpacks
  44. Examining logstash-forwarder-0.4.-.x86_64.rpm: logstash-forwarder-0.4.-.x86_64
  45. Marking logstash-forwarder-0.4.-.x86_64.rpm to be installed
  46. Resolving Dependencies
  47. --> Running transaction check
  48. ---> Package logstash-forwarder.x86_64 :0.4.- will be installed
  49. --> Finished Dependency Resolution
  50. base//x86_64 | 3.6 kB ::
  51. extras//x86_64 | 3.4 kB ::
  52. updates//x86_64 | 3.4 kB ::
  53.  
  54. Dependencies Resolved
  55.  
  56. ===============================================================================================================================================================================================
  57. Package Arch Version Repository Size
  58. ===============================================================================================================================================================================================
  59. Installing:
  60. logstash-forwarder x86_64 0.4.- /logstash-forwarder-0.4.-.x86_64 5.7 M
  61.  
  62. Transaction Summary
  63. ===============================================================================================================================================================================================
  64. Install Package
  65.  
  66. Total size: 5.7 M
  67. Installed size: 5.7 M
  68. Is this ok [y/d/N]: y
  69. Downloading packages:
  70. Running transaction check
  71. Running transaction test
  72. Transaction test succeeded
  73. Running transaction
  74. Installing : logstash-forwarder-0.4.-.x86_64 /
  75. Logs for logstash-forwarder will be in /var/log/logstash-forwarder/
  76. Verifying : logstash-forwarder-0.4.-.x86_64 /
  77.  
  78. Installed:
  79. logstash-forwarder.x86_64 :0.4.-
  80.  
  81. Complete!
  82. [root@localhost elk]# systemctl enable logstash-forwarder (设置开机自启动)
  83. logstash-forwarder.service is not a native service, redirecting to /sbin/chkconfig.
  84. Executing /sbin/chkconfig logstash-forwarder on
  85. The unit files have no [Install] section. They are not meant to be enabled
  86. using systemctl.
  87. Possible reasons for having this kind of units are:
  88. ) A unit may be statically enabled by being symlinked from another unit's
  89. .wants/ or .requires/ directory.
  90. ) A unit's purpose may be to act as a helper for some other unit which has
  91. a requirement dependency on it.
  92. ) A unit may be started when needed via activation (socket, path, timer,
  93. D-Bus, udev, scripted systemctl call, ...).
  94. [root@localhost elk]# systemctl start logstash-forwarder.service (开启服务)
  95. [root@localhost elk]# cd /var/log/logstash-forwarder/ (日志目录)
  96. [root@localhost logstash-forwarder]# ls
  97. logstash-forwarder.err logstash-forwarder.log
  98. [root@localhost elk]# vi /etc/logstash-forwarder.conf (编辑配置文件)

  99. {
  100. "network": {
  101. "servers": [ "elk.server.com:5000" ],
  102.  
  103. "ssl ca": "/etc/pki/tls/certs/logstash-forwarder.crt",
  104.  
  105. "timeout":
  106. },
  107.  
  108. "files": [
  109. {
  110. "paths": [
  111. "/var/log/messages",
  112. "/var/log/secure"
  113. ],
  114.  
  115. "fields": { "type": "syslog" }
  116. }
  117. ]
  118. }
  119.  
  120. [root@localhost elk]# systemctl restart logstash-forwarder.service (重启服务)
  121. [root@localhost elk]# systemctl status logstash-forwarder.service (查看服务运行状态)
  122. logstash-forwarder.service - LSB: no description given
  123. Loaded: loaded (/etc/rc.d/init.d/logstash-forwarder)
  124. Active: active (running) since Sun -- :: CST; 18s ago
  125. Process: ExecStop=/etc/rc.d/init.d/logstash-forwarder stop (code=exited, status=/SUCCESS)
  126. Process: ExecStart=/etc/rc.d/init.d/logstash-forwarder start (code=exited, status=/SUCCESS)
  127. CGroup: /system.slice/logstash-forwarder.service
  128. ?.. /opt/logstash-forwarder/bin/logstash-forwarder -config /etc/logstash-forwarder.conf
  129.  
  130. Nov :: localhost.localdomain systemd[]: Starting LSB: no description given...
  131. Nov :: localhost.localdomain /etc/init.d/logstash-forwarder[]: logstash-forwarder started
  132. Nov :: localhost.localdomain logstash-forwarder[]: logstash-forwarder started
  133. Nov :: localhost.localdomain systemd[]: Started LSB: no description given.

5、界面验证

  首先在client中手动增加一条日志:

  1. [root@localhost elk]# logger zhenyuLogtest

  界面登录 http://192.168.7.27/ ,做如下操作

从图中可以看到,手动添加的日志已经在界面中被搜索到了。

本文主要参考了国外一个搭建ELK的视频,操作的很详细,附上视频的下载链接,仅供参考。

链接:http://pan.baidu.com/s/1jGuBWCQ 密码:h0pq

Centos7下使用ELK(Elasticsearch + Logstash + Kibana)搭建日志集中分析平台的更多相关文章

  1. 使用ELK(Elasticsearch + Logstash + Kibana) 搭建日志集中分析平台实践--转载

    原文地址:https://wsgzao.github.io/post/elk/ 另外可以参考:https://www.digitalocean.com/community/tutorials/how- ...

  2. Centos6.5使用ELK(Elasticsearch + Logstash + Kibana) 搭建日志集中分析平台实践

    Centos6.5安装Logstash ELK stack 日志管理系统 概述:   日志主要包括系统日志.应用程序日志和安全日志.系统运维和开发人员可以通过日志了解服务器软硬件信息.检查配置过程中的 ...

  3. 键盘侠Linux干货| ELK(Elasticsearch + Logstash + Kibana) 搭建教程

    前言 Elasticsearch + Logstash + Kibana(ELK)是一套开源的日志管理方案,分析网站的访问情况时我们一般会借助 Google / 百度 / CNZZ 等方式嵌入 JS ...

  4. 【转】ELK(ElasticSearch, Logstash, Kibana)搭建实时日志分析平台

    [转自]https://my.oschina.net/itblog/blog/547250 摘要: 前段时间研究的Log4j+Kafka中,有人建议把Kafka收集到的日志存放于ES(ElasticS ...

  5. 【Big Data - ELK】ELK(ElasticSearch, Logstash, Kibana)搭建实时日志分析平台

    摘要: 前段时间研究的Log4j+Kafka中,有人建议把Kafka收集到的日志存放于ES(ElasticSearch,一款基于Apache Lucene的开源分布式搜索引擎)中便于查找和分析,在研究 ...

  6. ELK(ElasticSearch+Logstash+ Kibana)搭建实时日志分析平台

    一.简介 ELK 由三部分组成elasticsearch.logstash.kibana,elasticsearch是一个近似实时的搜索平台,它让你以前所未有的速度处理大数据成为可能. Elastic ...

  7. Elasticsearch+Logstash+Kibana搭建日志平台

    1 ELK简介 ELK是Elasticsearch+Logstash+Kibana的简称 ElasticSearch是一个基于Lucene的分布式全文搜索引擎,提供 RESTful API进行数据读写 ...

  8. [Big Data - ELK] ELK(ElasticSearch, Logstash, Kibana)搭建实时日志分析平台

    ELK平台介绍 在搜索ELK资料的时候,发现这篇文章比较好,于是摘抄一小段: 以下内容来自: http://baidu.blog.51cto.com/71938/1676798 日志主要包括系统日志. ...

  9. 13: ELK(ElasticSearch+Logstash+ Kibana)搭建实时日志分析平台

    参考博客:https://www.cnblogs.com/zclzhao/p/5749736.html 51cto课程:https://edu.51cto.com/center/course/less ...

  10. 基于CentOS6.5或Ubuntu14.04下Suricata里搭配安装 ELK (elasticsearch, logstash, kibana)(图文详解)

    前期博客 基于CentOS6.5下Suricata(一款高性能的网络IDS.IPS和网络安全监控引擎)的搭建(图文详解)(博主推荐) 基于Ubuntu14.04下Suricata(一款高性能的网络ID ...

随机推荐

  1. connect调用超时的实现方式

    第二种更通用的.使connect调用超时的方法是使套接字成为无阻塞的,然后用select等待它完成.这种方法避免了使用alarm时遇到的很多问题,但我们必须承认,即使是在UNIX实现中,这种方法还是存 ...

  2. Spring MVC中使用Interceptor拦截器

    SpringMVC 中的Interceptor 拦截器也是相当重要和相当有用的,它的主要作用是拦截用户的请求并进行相应的处理.比如通过它来进行权限验证,或者是来判断用户是否登陆,或者是像12306 那 ...

  3. Activity的四种启动模式和onNewIntent()

    转自:http://blog.csdn.net/linghu_java/article/details/17266603 Android中Activity启动模式详解   在Android中每个界面都 ...

  4. Android --ListView模板

    调整了近一上午的模板 ListView表头 <?xml version="1.0" encoding="utf-8"?> <LinearLay ...

  5. JAX-WS(三)构建简单webservice部署到tomcat上

    前言: 虽然构建本地的jax-ws的webservice很简单,但要部署到tomcat上要绕过点弯. tomcat本身和jdk都没有jaw-ws的API,所以部署的时候需要额外做点事情,有两种选择 1 ...

  6. iOS架构网址

    http://casatwy.com/iosying-yong-jia-gou-tan-kai-pian.html

  7. 转:MIME(Multipurpose Internet Mail Extensions)类型

    MIME(Multipurpose Internet Mail Extensions)多用途互联网邮件扩展类型.是设定某种扩展名的文件用一种应用程序来打开的方式类型,当该扩展名文件被访问的时候,浏览器 ...

  8. fackbook的Fresco的多种图片加载方法以及解码过程

    上篇文章中我们提到了图片加载其实是用了三条线程,如果没看过的同学可以先了解下这里. fackbook的Fresco的Image Pipeline以及自身的缓存机制 那么今天我们就来探索一下如何在代码中 ...

  9. paper 3:matlab中save,load使用方法小结

    功能描述]存储文件[软件界面]MATLAB->File->Save Workspace As将变量存入硬盘中指定路径.[函数用法] save:该函数将所有workspace中变量用二进制格 ...

  10. haskell笔记2

    模式匹配 # haskell_test.hs length' :: [a] -> a length' [] = 0 length' (_:x) = 1 + length' x as模式 xs@x ...