Technology Sharing

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

Table of contents

1. Deploy Filebeat

2. Logstash Configuration

3. Browser kibana access verification

---

ELK, Filebead, Zookeeper, Kafka build can query the previous blog

1. Deploy Filebeat

cd /usr/local/filebeat
 
vim filebeat.yml
注释162、164行内容
163行起添加
output.kafka:
  enabled: true
  hosts: ["192.168.9.210:9092","192.168.9.120","192.168.9.140"]  #指定 Kafka 集群配置
  topic: "nginx"    #指定 Kafka 的 topic
 
————————————

The browser accesses filebeat to generate new log data

（http://192.168.9.111/test.html、http://192.168.9.111/test1.html、http://192.168.9.111/）

启动 filebeat
./filebeat -e -c filebeat.yml

2. Logstash Configuration

cd /etc/logstash/conf.d/
vim kafka.conf
input {
    kafka {
        bootstrap_server => "192.168.9.210:9092,192.168.9.120:9092,192.168.9.140:9092"
        topics => "nginx"
        type => "nginx_kafka"
        auto_offset_reset => "latest"
    }
}
 
#filter {}
 
output {
     elasticsearch {
          hosts => ["192.168.9.114:9200", "192.168.9.115:9200", "192.168.9.116:9200"]
          index => "nginx_kafka-%{+yyyy.MM.dd}"
     }
}
 
 
 
logstash -t -f kafka.conf
logstash -f kafka.conf

3. Browser kibana access verification

Use a browser to access http://192.168.9.116:5601 to log in to Kibana, click the [Manage] button, [Create Index Pattern], search for [nginx_kafka-*], click the [Next] button to create, select the [@timestamp] button, and click [Create Index Pattern]; you can view chart information and log information.