fluent安裝(fluent安裝包)

本文鏈接地址: Kubernetes EFK(Elastic Search, Fluentd, Kibana)搭建 - 慢慢的回味

上一次，我們完成了搭建單節點Kubernetes環境。現在在其基礎上繼續搭建EFK(Elastic Search, Fluentd, Kibana)日志收集系統。

目錄

Elasticarch 安裝時需要開啟HTTPS。

kubectl create namespace efk cat <<EOF > es_extracfg.yaml xpack: curity: enabled: "true" authc: api_key: enabled: "true"EOF helm upgrade --install my-elasticarch bitnami/elasticarch -n efk --t curity.enabled=true --t curity.elasticPassword=YourPassword --t curity.tls.autoGenerated=true --t-file extraConfig=es_extracfg.yaml

需要修改Stateful Set “my-elasticarch-coordinating-only”和“my-elasticarch-master”的內容如下，否則數據傳輸不成功：

resources: requests: cpu: 25m memory: 512MiKibana 安裝

Kibana 安裝的時候需要指定Elastic Search服務器的地址，密碼為Elastic Search服務器的密碼。這兒必須連接HTTPS接口。

helm upgrade --install my-kibana bitnami/kibana -n efk --t elasticarch.hosts[0]=my-elasticarch-coordinating-only --t elasticarch.port=9200 --t elasticarch.curity.auth.enabled=true --t elasticarch.curity.auth.kibanaPassword=YourPassword --t elasticarch.curity.tls.enabled=true --t elasticarch.curity.tls.verificationMode=noneFluentd 安裝

手動添加如下配置，通過@type elasticarch把日志轉發到Elastic Search服務器上面。

kind: ConfigMapapiVersion: v1metadata: name: elasticarch-output namespace: efkdata: fluentd.conf: | # Prometheus Exporter Plugin # input plugin that exports metrics <source> @type prometheus port 24231 </source> # input plugin that collects metrics from MonitorAgent <source> @type prometheus_monitor <labels> host ${hostname} </labels> </source> # input plugin that collects metrics for output plugin <source> @type prometheus_output_monitor <labels> host ${hostname} </labels> </source> # Ignore fluentd own events <match fluent.**> @type null </match> # TCP input to receive logs from the forwarders <source> @type forward bind 0.0.0.0 port 24224 </source> # HTTP input for the liveness and readiness probes <source> @type http bind 0.0.0.0 port 9880 </source> # Throw the healthcheck to the standard output instead of forwarding it <match fluentd.healthcheck> @type stdout </match> # Send the logs to the standard output <match **> @type elasticarch include_tag_key true scheme https host my-elasticarch-coordinating-only port 9200 ur elastic password YourPassword ssl_verify fal logstash_format true logstash_prefix k8s request_timeout 30s <buffer> @type file path /opt/bitnami/fluentd/logs/buffers/logs.buffer flush_thread_count 2 flush_interval 5s </buffer> </match>

helm upgrade --install my-fluentd bitnami/fluentd -n efk --t aggregator.configMap=elasticarch-outputKibana 管理界面

添加Index Pattern后可以查看log