ELK Deployed
Enviroment prepare
rpm -qa | grep java
wget http://download.oracle.com/otn-pub/java/jdk/8u171-b11/512cd62ec5174c3487ac17c61aaa89e8/jdk-8u171-linux-x64.tar.gz
tar -zxvf jdk-8u171-linux-x64.tar.gz -C /usr/local
echo -e 'export JAVA_HOME=/usr/local/jdk1.8.0_171\nexport JRE_HOME=${JAVA_HOME}/jre\nexport CLASSPATH=.:${JAVA_HOME}/lib/dt.JAVA_HOME/lib/tools.jar:${JRE_HOME}/lib\nexport PATH=${JAVA_HOME}/bin:${PATH}' >>/etc/profile
source /etc/profile
java -version
java version "1.8.0_171"
Java(TM) SE Runtime Environment (build 1.8.0_171-b11)
Java HotSpot(TM) -Bit Server VM (build 25.171-b11, mixed mode)
Elasticsearch Install
1. Download Elasticsearch-6.2.3
curl 127.0.0.0.1:9002
{
"name" : "5eRpLYV",
"cluster_name" : "elasticsearch",
"cluster_uuid" : "RrKzHv2bTD2JfcuGxNwGBw",
"version" : {
"number" : "6.2.3",
"build_hash" : "c59ff00",
"build_date" : "2018-03-13T10:06:29.741383Z",
"build_snapshot" : false,
"lucene_version" : "7.2.1",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}
mkdir /elk/ && cd /elk
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.2.3.tar.gz
tar -xzf elasticsearch-6.2..tar.gz
cd elasticsearch-6.2./
2. Create elasticsearch user and Running Elasticsearch as a daemon
useradd elasticsearch
chown -R elasticsearch.elasticsearch /elk/elasticsearch-6.2.
su - elasticsearch
cd /elk/elasticsearch
./bin/elasticsearch -d -p pid
3. Checking that Elasticsearch is running
curl 127.0.0.0.:
{
"name" : "5eRpLYV",
"cluster_name" : "elasticsearch",
"cluster_uuid" : "RrKzHv2bTD2JfcuGxNwGBw",
"version" : {
"number" : "6.2.3",
"build_hash" : "c59ff00",
"build_date" : "2018-03-13T10:06:29.741383Z",
"build_snapshot" : false,
"lucene_version" : "7.2.1",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}
4. Configuring Elasticsearch on the command line
default conf file is $ES_HOME/config/elasticsearch.yml
./bin/elasticsearch -d -Ecluster.name=my_cluster -Enode.name=node_1
curl 127.0.0.1:
{
"name" : "node_1",
"cluster_name" : "my_cluster",
"cluster_uuid" : "RrKzHv2bTD2JfcuGxNwGBw",
"version" : {
"number" : "6.2.3",
"build_hash" : "c59ff00",
"build_date" : "2018-03-13T10:06:29.741383Z",
"build_snapshot" : false,
"lucene_version" : "7.2.1",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}
Logstash Install
1. Download Logstash-6.2.3
cd /elk
wget https://artifacts.elastic.co/downloads/logstash/logstash-6.2.3.tar.gz
tar xf logstash-6.2..tar.gz && cd logstash-6.2.
2. Edit logstash-filter.conf file
cd /elk/logstash-6.2./bin
cat >logstash-filter.conf << EOF
input { stdin { } } filter {
grok {
match => { "message" => "%{COMBINEDAPACHELOG}" }
}
date {
match => [ "timestamp" , "dd/MMM/yyyy:HH:mm:ss Z" ]
}
} output {
elasticsearch { hosts => ["localhost:9200"] }
stdout { codec => rubydebug }
}
EOF
3. Run Logstash with this configuration
cd /elk/logstash-6.2./bin
./logstash -f logstash-filter.conf &
tailf /elk/logstash-6.2./logs/logstash-plain.log
[--14T20::,][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>}
[--14T20::,][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>}
Kibana Install
1. Download Kibana-6.2.3
cd /elk
wget https://artifacts.elastic.co/downloads/kibana/kibana-6.2.3-linux-x86_64.tar.gz
tar xf kibana-6.2.-linux-x86_64.tar.gz && cd kibana-6.2.-linux-x86_64
2. Edit kibana.yml
sed -i '$a server.host: "10.0.0.100"' /elk/kibana-6.2.-linux-x86_64/config/kibana.yml
cd /elk/kibana-6.2.-linux-x86_64/bin/
nohup kibana &
3. HanHua Kibana
git clone https://github.com/anbai-inc/Kibana_Hanization.git
cd Kibana_Hanization/
python main.py python main.py /elk/kibana-6.2.-linux-x86_64/
4. Restart Kibana
bin/kibana &
ELK Deployed的更多相关文章
- ELK日志系统:Filebeat使用及Kibana如何设置登录认证
根据elastic上的说法: Filebeat is a lightweight, open source shipper for log file data. As the next-generat ...
- 5分钟部署ELK+filebeat5.1.1
标题有点噱头,不过网络环境好的情况下也差不多了^_^ 1. 首先保证安装了jdk. elasticsearch, logstash, kibana,filebeat都可以通过yum安装,这里前 ...
- 大数据平台架构(flume+kafka+hbase+ELK+storm+redis+mysql)
上次实现了flume+kafka+hbase+ELK:http://www.cnblogs.com/super-d2/p/5486739.html 这次我们可以加上storm: storm-0.9.5 ...
- ELK+Kafka集群日志分析系统
ELK+Kafka集群分析系统部署 因为是自己本地写好的word文档复制进来的.格式有些出入还望体谅.如有错误请回复.谢谢! 一. 系统介绍 2 二. 版本说明 3 三. 服务部署 3 1) JDK部 ...
- 第三十章 elk(1) - 第一种架构(最简架构)
软件版本: es:2.4.0 logstash:2.4.0 kibana:4.6.1 一.logstash安装(收集.过滤日志.构建索引) 1.下载:https://www.elastic.co/do ...
- #研发解决方案#基于Apriori算法的Nginx+Lua+ELK异常流量拦截方案
郑昀 基于杨海波的设计文档 创建于2015/8/13 最后更新于2015/8/25 关键词:异常流量.rate limiting.Nginx.Apriori.频繁项集.先验算法.Lua.ELK 本文档 ...
- ELK+redis搭建nginx日志分析平台
ELK+redis搭建nginx日志分析平台发表于 2015-08-19 | 分类于 Linux/Unix | ELK简介ELKStack即Elasticsearch + Logstas ...
- ELK日志系统:Elasticsearch + Logstash + Kibana 搭建教程
环境:OS X 10.10.5 + JDK 1.8 步骤: 一.下载ELK的三大组件 Elasticsearch下载地址: https://www.elastic.co/downloads/elast ...
- elk系列4之kibana图形化操作
preface 我们都搭建了ELK系统,且日志也能够正常收集的时候,那么就配置下kibana.我们可以通过kibana配置柱状图,趋势图,统计图,圆饼图等等各类图.下面就拿配置统计图和柱状图为例,结合 ...
随机推荐
- mybatis四(动态sql)
<1><select id="selectUserByConditions" parameterType="user" resultType= ...
- zip和zipPartitions
zip函数用于将两个RDD组合成Key/Value形式的RDD,这里默认两个RDD的partition数量以及元素数量都相同,否则会抛出异常. scala> val aa=sc.makeRDD( ...
- ASPxCallbackPanel(珍藏版)
<%@ Page Language="C#" AutoEventWireup="true" CodeFile="AspxCallbackPane ...
- Mysql中select的正确姿势
引言 大家在开发中,还有很多童鞋在写查询语句的时候,习惯写下面这种不规范sql select * from table 而不写成下面的这种规范方式 select col1,col2,...,coln ...
- 关于阿里云图片识别接口的demo
服务器处理过程 $host = "https://dm-53.data.aliyun.com"; $path = "/rest/160601/ocr/ocr_vehicl ...
- react-navigation设置navigationOptions中Static中使用 this 的方法
使用react-navigation时,单页面设置navigationOptions中,进行Static中 调用this 中的方法或值时,需要做如下操作 static navigationOption ...
- java 常用第3方工具
https://www.cnblogs.com/chenpi/p/5608628.html#_label4
- compute by 的使用
GROUP BY子句有个缺点,就是返回的结果集中只有合计数据,而没有原始的详细记录.如果想在SQL SERVER中完成这项工作,可以使用COMPUTE BY子句.COMPTE生成合计作为附加的汇总列出 ...
- mingw编译ffmpeg 错误:Unknown option "--enable-memalign-hack"
据说mingw编译ffmpeg的话需要添加 --enable-memalign-hack 开关 但如果源码是最新版比如:ffmpeg4.0.2 的话 好像已经禁用了该开关. “我可以确认新的ffmpe ...
- css样式表2
<head> <style type="text/css"> .main { height:42px; width:100%; text-align:cen ...