ELK 安装笔记
logstash
-noverify
-javaagent:E:\svn\other\nn\jrebel6.0.0+crack\jrebel6.0.0-crack\jrebel.jar
-Drebel.dirs=E:\svn\lkStoreServer\trunk\webapp\WEB-INF\classes
-Drebel.spring_plugin=true
-Drebel.struts2-plugin=true
termvectors
termvectors - 必应词典
网络词向量；检索词向量
percolate - 必应词典
美['pɜrkə.leɪt]英['pɜː(r)kəleɪt]
v.渗入；渗透；渗漏；逐渐流传
n.渗出液
网络过滤；过滤出；渗滤液
https://download.elastic.co/demos/logstash/gettingstarted/logstash-tutorial.log.gz
curl -XPUT "http://192.168.4.140:9200/myindex/emp/3" -d '{"name":"lk", "age":23}'
[root@guosen ~]# curl -XGET "192.168.4.140:9200/logstash-2016.09.20/_search?pretty&q=response=200&geoip.city_name=Buffalo"
{
"error" : {
"root_cause" : [ {
"type" : "cluster_block_exception",
"reason" : "blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];"
} ],
"type" : "cluster_block_exception",
"reason" : "blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];"
},
"status" : 503
}
disconnected
Caused by: java.lang.IllegalArgumentException: No custom metadata prototype registered for type [licenses], node like missing plugin
s
at org.elasticsearch.cluster.metadata.MetaData.lookupPrototypeSafe(MetaData.java:119)
at org.elasticsearch.cluster.metadata.MetaData.readFrom(MetaData.java:691)
at org.elasticsearch.cluster.metadata.MetaData$Builder.readFrom(MetaData.java:1212)
at org.elasticsearch.gateway.TransportNodesListGatewayMetaState$NodeGatewayMetaState.readFrom(TransportNodesListGatewayMetaS
tate.java:220)
at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:150)
... 23 more
[2016-09-20 13:49:55,364][WARN ][transport.netty ] [node-2] exception caught on transport layer [[id: 0x201a20e1, /192.168.
4.140:52209 => /192.168.4.49:9300]], closing connection
java.lang.IllegalStateException: Message not fully read (response) for requestId [1188], handler [org.elasticsearch.action.support.n
odes.TransportNodesAction$AsyncAction$2@33184d8e], error [false]; resetting
at org.elasticsearch.transport.netty.MessageChannelHandler$Marker.validateResponse(MessageChannelHandler.java:403)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:126)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at java.lang.Thread.run(Thread.java:745)
[2016-09-20 13:49:55,372][INFO ][gateway ] [node-2] metadata state not restored, reason: found [1] metadata states,
required [2]
[2016-09-20 13:49:55,373][WARN ][discovery.zen ] [node-2] not enough master nodes, current nodes: {{node-2}{oTsjC4pyS72RK
-FbeqZMOw}{192.168.4.140}{192.168.4.140:9300}{rack=r2},}
[2016-09-20 13:49:55,373][INFO ][cluster.service ] [node-2] removed {{node-1}{lcnX80ztQ3WLGJgh5SW2Zw}{192.168.4.49}{192.168
.4.49:9300}{rack=r1},}, reason: zen-disco-node-failed({node-1}{lcnX80ztQ3WLGJgh5SW2Zw}{192.168.4.49}{192.168.4.49:9300}{rack=r1}), reason(transport disconnected)
[2016-09-20 13:49:59,302][INFO ][cluster.service ] [node-2] detected_master {node-1}{lcnX80ztQ3WLGJgh5SW2Zw}{192.168.4.49}{192.168.4.49:9300}{rack=r1}, added {{node-1}{lcnX80ztQ3WLGJgh5SW2Zw}{192.168.4.49}{192.168.4.49:9300}{rack=r1},}, reason: zen-disco-receive(from master [{node-1}{lcnX80ztQ3WLGJgh5SW2Zw}{192.168.4.49}{192.168.4.49:9300}{rack=r1}])
[2016-09-20 13:50:25,262][INFO ][cluster.routing.allocation.decider] [node-2] low disk watermark [85%] exceeded on [oTsjC4pyS72RK-FbeqZMOw][node-2][/var/lib/elasticsearch/my-application/nodes/0] free: 3.6gb[11.7%], replicas will not be assigned to this node
[2016-09-20 13:54:27,695][WARN ][rest.suppressed ] path: /_search, params: {pretty=}
at java.lang.Thread.run(Thread.java:745)
[2016-09-20 13:57:15,116][WARN ][transport ] [node-2] Transport response handler not found of id [1653]
[2016-09-20 13:57:19,241][WARN ][transport ] [node-2] Transport response handler not found of id [1658]
https://discuss.elastic.co/t/shield-problems-transport-response-handler-not-found/60854/2 ---- 好像是没有 license 。。。。
Download and install the public signing key:
rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch
Add the following in your /etc/yum.repos.d/ directory in a file with a .repo suffix, for example elasticsearch.repo
[elasticsearch-2.x]
name=Elasticsearch repository for 2.x packages
baseurl=https://packages.elastic.co/elasticsearch/2.x/centos
gpgcheck=1
gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch
enabled=1
And your repository is ready for use. You can install it with:
yum install elasticsearch
elasticsearch
echo $"Usage: $0 {start|stop|status|restart|condrestart|try-restart|reload|force-reload}"
++++
vi /etc/init.d/elasticsearch
00000
+++++ 插件安装 http://blog.csdn.net/whxaing2011/article/details/18237733 ++++++++++++++++++++
head ：
cd /usr/share/elasticsearch/
./bin/plugin install mobz/elasticsearch-head
http://192.168.4.49:9200/_plugin/bigdesk/
+++++
[root@guosen es]# service elasticsearch restart
停止 elasticsearch：[失败]
正在启动 elasticsearch：Exception in thread "main" java.lang.IllegalStateException: Failed to created node environment
Likely root cause: java.nio.file.AccessDeniedException: /var/lib/elasticsearch/elasticsearch/nodes/1
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:383)
at java.nio.file.Files.createDirectory(Files.java:630)
at java.nio.file.Files.createAndCheckIsDirectory(Files.java:734)
at java.nio.file.Files.createDirectories(Files.java:720)
at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:169)
at org.elasticsearch.node.Node.(Node.java:165)
at org.elasticsearch.node.Node.(Node.java:140)
at org.elasticsearch.node.NodeBuilder.build(NodeBuilder.java:143)
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:194)
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:286)
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)
Refer to the log for complete error details.
[失败]
http://stackoverflow.com/questions/34564625/how-to-solve-accessdeniedexception-in-elasticsearch
chown -R elasticsearch:elasticsearch /var/lib/elasticsearch/
正在启动 elasticsearch：[确定]
[root@guosen es]# Exception in thread "main" BindTransportException[Failed to bind to [9300-9400]]; nested: ChannelException[Failed to bind to: /192.168.1.140:9400]; nested: BindException[无法指定被请求的地址];
Likely root cause: java.net.BindException: 无法指定被请求的地址
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:444)
at sun.nio.ch.Net.bind(Net.java:436)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.jboss.netty.channel.socket.nio.NioServerBoss$RegisterTask.run(NioServerBoss.java:193)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Refer to the log for complete error details.
network.host: 192.168.1.140 写错了！！！ 应该是 network.host: 192.168.4.140
++++++++++++ repo 作怪。。
[root@guosen es]# yum localinstall elasticsearch-2.4.0.rpm
已加载插件：product-id, refresh-packagekit, security, subscription-manager
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
设置本地安装进程
诊断 elasticsearch-2.4.0.rpm: elasticsearch-2.4.0-1.noarch
elasticsearch-2.4.0.rpm 将被安装
elasticsearch-2.x | 2.9 kB 00:00
elasticsearch-2.x/primary_db | 7.3 kB 00:00
zabbix | 951 B 00:00
zabbix/primary | 9.6 kB 00:00
段错误 (core dumped)
[root@guosen es]#
[root@guosen es]#
[root@guosen es]# cd /etc/yum.repos.d
[root@guosen yum.repos.d]#
[root@guosen yum.repos.d]#
[root@guosen yum.repos.d]# mv zabbix.repo zabbix.repo.bak
[root@guosen yum.repos.d]#
[root@guosen yum.repos.d]#
[root@guosen yum.repos.d]# yum clean all
已加载插件：product-id, refresh-packagekit, security, subscription-manager
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Cleaning repos: elasticsearch-2.x
清理一切
[root@guosen yum.repos.d]#
[root@guosen yum.repos.d]# cd /es
[root@guosen es]#
[root@guosen es]# yum localinstall elasticsearch-2.4.0.rpm
已加载插件：product-id, refresh-packagekit, security, subscription-manager
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
设置本地安装进程
诊断 elasticsearch-2.4.0.rpm: elasticsearch-2.4.0-1.noarch
elasticsearch-2.4.0.rpm 将被安装
elasticsearch-2.x | 2.9 kB 00:00
elasticsearch-2.x/primary_db | 7.3 kB 00:00
解决依赖关系
--> 执行事务检查
---> Package elasticsearch.noarch 0:2.4.0-1 will be 安装
--> 完成依赖关系计算
+++++++++++++++
+++++++++++ 集群： 下面的必现开启。 若要取消集群， 下面的必须注释
discovery.zen.minimum_master_nodes: 2
++++++++++++
curl -XGET 'http://192.168.4.49:9200/_license?pretty'
curl -XGET "192.168.4.49:9200/_cluster/health?pretty"
[root@guosen es]# yum localinstall jdk-7u67-linux-x64.rpm
已加载插件：product-id, refresh-packagekit, security, subscription-manager
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
设置本地安装进程
诊断 jdk-7u67-linux-x64.rpm: 2000:jdk-1.7.0_67-fcs.x86_64
jdk-7u67-linux-x64.rpm 将作为 2000:jdk-1.6.0_33-fcs.x86_64 的更新
段错误 (core dumped)
[root@guosen es]#
[root@guosen es]# rpm -ivh jdk-7u67-linux-x64.rpm
Preparing... ########################################### [100%]
file /etc/init.d/jexec from install of jdk-2000:1.7.0_67-fcs.x86_64 conflicts with file from package jdk-2000:1.6.0_33-fcs.x86_64
有台机器开发说要用jdk1.7，因为他们开发环境、测试环境全部都是1.7的。郁闷的是我把服务器都装上1.6版本了，那就改吧。
1.下载1.7新版本的jdk：http://www.oracle.com/technetwork/java/javase/downloads/jdk7-downloads-1880260.html
2.把下载的rpm文件放到/usr/local下去了；
3.然后开始安装，可是：
[root@server-bj001 local]# rpm -ivh jdk-7u67-linux-x64.rpm
Preparing... ########################################### [100%]
file /etc/init.d/jexec from install of jdk-2000:1.7.0_67-fcs.x86_64 conflicts with file from package jdk-2000:1.6.0_29-fcs.x86_64
报错了，把系统默认的openjdk卸掉试试。
4. 卸载系统默认jdk：
[root@server-bj001 local]# rpm -qa |grep java
sun-javadb-demo-10.6.2-1.1.i386
java-1.6.0-openjdk-devel-1.6.0.0-1.50.1.11.5.el6_3.x86_64
sun-javadb-common-10.6.2-1.1.i386
sun-javadb-core-10.6.2-1.1.i386
sun-javadb-javadoc-10.6.2-1.1.i386
tzdata-java-2012j-1.el6.noarch
java_cup-0.10k-5.el6.x86_64
sun-javadb-client-10.6.2-1.1.i386
gcc-java-4.4.7-4.el6.x86_64
java-1.5.0-gcj-1.5.0.0-29.1.el6.x86_64
sun-javadb-docs-10.6.2-1.1.i386
[root@server-bj001 local]# rpm -e --nodeps sun-javadb-demo-10.6.2-1.1.i386
[root@server-bj001 local]# rpm -e --nodeps java-1.6.0-openjdk-devel-1.6.0.0-1.50.1.11.5.el6_3.x86_64
[root@server-bj001 local]# rpm -e --nodeps sun-javadb-common-10.6.2-1.1.i386
[root@server-bj001 local]# rpm -e --nodeps sun-javadb-core-10.6.2-1.1.i386
。。。。。。
5.再装还是那个错，忘了把自己安装的1.6卸掉了，继续来。
[root@server-bj001 local]# rpm -qa |grep jdk
jdk-1.6.0_29-fcs.x86_64
[root@server-bj001 local]# rpm -e --nodeps jdk-1.6.0_29-fcs.x86_64
[root@server-bj001 local]# rpm -ivh jdk-7u67-linux-x64.rpm
Preparing... ########################################### [100%]
1:jdk ########################################### [100%]
Unpacking JAR files...
rt.jar...
jsse.jar...
charsets.jar...
tools.jar...
localedata.jar...
jfxrt.jar...
这回可以安装了。
6.修改配置文件/etc/profile，最后添加下列：
export JAVA_HOME=/usr/lib/jdk/jdk1.7.0_67
export JRE_HOME=/usr/lib/jdk/jdk1.7.0_67/jre
export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$PATH
export CLASSPATH=$CLASSPATH:.:$JAVA_HOME/lib:$JAVA_HOME/jre/lib
PATH=$PATH:/var/lib/mysql/bin
export PATH
source /etc/profile 执行这个让配置文件生效
验证下吧：
[root@server-bj001 jdk1.7.0_67]# java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
终于搞定了，哎。饶了一个大圈，不过想想估计把自己安装的JDK1.6卸载掉应该就可以安装1.7的了，以后试试先。
ELK 安装笔记的更多相关文章
- [2017-07-18]ELK安装笔记
ELK ElasticSearch LogStash Kibana Server:CentOS 7 采用RPM导入官方源方式进行安装 rpm --import https://artifacts.el ...
- ELK安装笔记
1.jdk安装 2.logstash安装使用 #命令方式[root@ELK ELK]# tar xf logstash-5.3.2.tar.gz [root@ELK logstash-5.3.2]# ...
- Elk使用笔记(坑)（2017-02-17更新）
Elk使用笔记(坑)(2017-02-17更新) 作者: admin 时间: 2016-12-07 分类: 工具,数据 主要记录使用过程终于到的一些坑和需要注意的地方,有些坑想不起来了,以后再完善补上 ...
- MonoDevelop 4.2.2/Mono 3.4.0 in CentOS 6.5 安装笔记
MonoDevelop 4.2.2/Mono 3.4.0 in CentOS 6.5 安装笔记 说明 以root账户登录Linux操作系统,注意:本文中的所有命令行前面的 #> 表示命令行提示符 ...
- 基于Ubuntu14.04系统的nvidia tesla K40驱动和cuda 7.5安装笔记
基于Ubuntu14.04系统的nvidia tesla K40驱动和cuda 7.5安装笔记 飞翔的蜘蛛人 注1:本人新手,文章中不准确的地方,欢迎批评指正 注2:知识储备应达到Linux入门级水平 ...
- sublime 安装笔记
sublime 安装笔记 下载地址 安装package control 根据版本复制相应的代码到console,运行 按要求重启几次后再按crtl+shift+p打开命令窗口 输入pcip即可开始安装 ...
- docker在ubuntu14.04下的安装笔记
本文主要是参考官网教程进行ubuntu14.04的安装. 下面是我的安装笔记. 笔记原件完整下载: 链接: https://pan.baidu.com/s/1dEPQ8mP 密码: gq2p
- ArchLinux 安装笔记：续 --zz
续前话 在虚拟机里调试了几天,终于鼓起勇气往实体机安装了,到桌面环境为止的安装过程可以看我的前一篇文章<ArchLinux 安装笔记>.桌面环境我使用的是 GNOME,虽然用了很长一段时间 ...
- Hadoop1.x与2.x安装笔记
Hadoop1.x与2.x安装笔记 Email: chujiaqiang229@163.com 2015-05-09 Hadoop 1.x 安装 Hadoop1.x 集群规划 No 名称 内容 备注 ...
随机推荐
- 随手记_C#验证码
前言 最近在网上偶然看见一个验证码,觉得很有意思,于是搜了下,是使用第三方实现的,先看效果: 总体来说效果还是可以的,官方提供的SDK也比较详细,可配置性很高.在这里在简单啰嗦几句使用方式: 使用步骤 ...
- 关于python的bottle框架跨域请求报错问题的处理
在用python的bottle框架开发时,前端使用ajax跨域访问时,js代码老是进入不了success,而是进入了error,而返回的状态却是200.url直接在浏览器访问也是正常的,浏览器按F12 ...
- 算法与数据结构(十六) 快速排序(Swift 3.0版)
上篇博客我们主要聊了比较高效的归并排序算法,本篇博客我们就来介绍另一种高效的排序算法:快速排序.快速排序的思想与归并排序类似,都是采用分而治之的方式进行排序的.快速排序的思想主要是取出无序序列中第一个 ...
- android 两种实现计时器时分秒的实现，把时间放在你的手中~
可能我们在开发中会时常用到计时器这玩意儿,比如在录像的时候,我们可能需要在右上角显示一个计时器.这个东西其实实现起来非常简单. 只需要用一个控件Chronometer,是的,就这么简单,我都不好意思讲 ...
- javascript arguments(转)
什么是arguments arguments 是是JavaScript里的一个内置对象,它很古怪,也经常被人所忽视,但实际上是很重要的.所有主要的js函数库都利用了arguments对象.所以agru ...
- 统计iOS项目的总代码行数的方法
打开终端, 用cd命令 定位到工程所在的目录,然后调用以下命名即可把每个源代码文件行数及总数统计出来: find . "(" -name "*.m" -or - ...
- Angular2 Hello World 之 2.0.0-beta.14
公司现在采用angualrjs开发一些web应用,采用的是angular1,现在angular2已经差不多了,听说最近rc6已经出来了……其实感觉好慢啊!之前也做过一些anglar2的例子,但是没有记 ...
- 张高兴的 UWP 开发笔记：汉堡菜单进阶
不同于Windows 8应用,Windows 10引入了"汉堡菜单"这一导航模式.说具体点,就拿官方的天气应用来说,左上角三条横杠的图标外加一个SplitView控件组成的这一导航 ...
- 解决mysql插入数据时出现Incorrect string value: '\xF0\x9F...' for column 'name' at row 1的异常
这个问题,原因是UTF-8编码有可能是两个.三个.四个字节.Emoji表情或者某些特殊字符是4个字节,而MySQL的utf8编码最多3个字节,所以数据插不进去. 我的解决方案是这样的 1.在mysql ...
- 利用PowerShell复制SQLServer账户的所有权限
问题 对于DBA或者其他运维人员来说授权一个账户的相同权限给另一个账户是一个很普通的任务.但是随着服务器.数据库.应用.使用人员地增加就变得很枯燥乏味又耗时费力的工作.那么有什么容易的办法来实现这个任 ...