kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
1、刚才未启动zookeeper集群的时候,直接启动kafka脚本程序,kafka报错了,但是进程号启动起来来,再次启动出现如下所示的问题,这里先将进程号杀死,再启动脚本程序。
[hadoop@slaver1 script_hadoop]$ kafka-start.sh
start kafkaServer...
[-- ::,] INFO Verifying properties (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property broker.id is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.retention.check.interval.ms is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.retention.hours is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.segment.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.io.threads is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.network.threads is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.partitions is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property port is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.receive.buffer.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.request.max.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.send.buffer.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property zookeeper.connect is overridden to slaver1:,slaver2:,slaver3: (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property zookeeper.connection.timeout.ms is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO [Kafka Server ], starting (kafka.server.KafkaServer)
[-- ::,] INFO [Kafka Server ], Connecting to zookeeper on slaver1:,slaver2:,slaver3: (kafka.server.KafkaServer)
[-- ::,] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[-- ::,] INFO Client environment:zookeeper.version=3.3.-, built on // : GMT (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:host.name=slaver1 (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.home=/home/hadoop/soft/jdk1..0_79/jre (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8./bin/../core/build/dependant-libs-2.8./*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,143] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@61a2d734 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,223] INFO Opening socket connection to server slaver3/192.168.19.133:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,247] INFO Socket connection established to slaver3/192.168.19.133:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,271] INFO Session establishment complete on server slaver3/192.168.19.133:2181, sessionid = 0x363857e11950000, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,275] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:27,425] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:27,437] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:27,452] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:27,460] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,461] INFO Session: 0x363857e11950000 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,463] INFO [Kafka Server 1], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:27,558] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:30,444] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,525] INFO Property broker.id is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,526] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,526] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.retention.check.interval.ms is overridden to 60000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.segment.bytes is overridden to 536870912 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,528] INFO Property num.io.threads is overridden to 8 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,529] INFO Property num.network.threads is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,530] INFO Property num.partitions is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,532] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,533] INFO Property socket.receive.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,534] INFO Property socket.request.max.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,534] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,535] INFO Property zookeeper.connect is overridden to slaver1:2181,slaver2:2181,slaver3:2181 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,537] INFO Property zookeeper.connection.timeout.ms is overridden to 1000000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,567] INFO [Kafka Server 2], starting (kafka.server.KafkaServer)
[2018-05-22 09:37:30,569] INFO [Kafka Server 2], Connecting to zookeeper on slaver1:2181,slaver2:2181,slaver3:2181 (kafka.server.KafkaServer)
[2018-05-22 09:37:30,622] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:30,674] INFO Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:host.name=slaver2 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.home=/home/hadoop/soft/jdk1.7.0_79/jre (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/dependant-libs-2.8.0/*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,676] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,678] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,678] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,681] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@6ae56499 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,723] INFO Opening socket connection to server slaver1/192.168.19.131:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,732] INFO Socket connection established to slaver1/192.168.19.131:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,752] INFO Session establishment complete on server slaver1/192.168.19.131:2181, sessionid = 0x163857dfeaa0001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,758] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:31,139] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:31,153] INFO [Kafka Server 2], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:31,173] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:31,184] INFO Session: 0x163857dfeaa0001 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:31,185] INFO [Kafka Server 2], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:31,186] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:31,266] INFO [Kafka Server 2], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:33,769] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,891] INFO Property broker.id is overridden to 3 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.retention.check.interval.ms is overridden to 60000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property log.segment.bytes is overridden to 536870912 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property num.io.threads is overridden to 8 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,895] INFO Property num.network.threads is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,896] INFO Property num.partitions is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,897] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,897] INFO Property socket.receive.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,898] INFO Property socket.request.max.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,899] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,900] INFO Property zookeeper.connect is overridden to slaver1:2181,slaver2:2181,slaver3:2181 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,901] INFO Property zookeeper.connection.timeout.ms is overridden to 1000000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,928] INFO [Kafka Server 3], starting (kafka.server.KafkaServer)
[2018-05-22 09:37:33,930] INFO [Kafka Server 3], Connecting to zookeeper on slaver1:2181,slaver2:2181,slaver3:2181 (kafka.server.KafkaServer)
[2018-05-22 09:37:33,989] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:34,010] INFO Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:host.name=slaver3 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.home=/home/hadoop/soft/jdk1.7.0_79/jre (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/dependant-libs-2.8.0/*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,012] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,012] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,013] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,014] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,014] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,015] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,017] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@6ae56499 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,081] INFO Opening socket connection to server slaver1/192.168.19.131:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,091] INFO Socket connection established to slaver1/192.168.19.131:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,106] INFO Session establishment complete on server slaver1/192.168.19.131:2181, sessionid = 0x163857dfeaa0002, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,111] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:34,268] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:34,279] INFO [Kafka Server 3], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:34,304] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:34,311] INFO Session: 0x163857dfeaa0002 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,311] INFO [Kafka Server 3], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:34,312] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,559] INFO [Kafka Server 3], shutting down (kafka.server.KafkaServer)
[hadoop@slaver1 script_hadoop]$ jps
2898 Jps
2802 QuorumPeerMain
2725 Kafka
[hadoop@slaver1 script_hadoop]$
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.的更多相关文章
- kafka启动报错:kafka.common.KafkaException: Failed to acquire lock on file .lock
kafka 异常退出后重启时遇到的问题 解决: 执行 netstat -lnp|grep 9092 在执行结果中找到进程号执行 kill -9 进程号再尝试启动Kafka
- Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
1. 问题现象 启动 kafka 时报错:Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in an ...
- kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
今天在写kafka生产者生成数据的程序并运行时,报如下错误: log4j:WARN No appenders could be found for logger (kafka.utils.Verifi ...
- kafka集群中常见错误的解决方法:kafka.common.KafkaException: Should not set log end offset on partition
问题描述:kafka单台机器做集群操作是没有问题的,如果分布多台机器并且partitions或者备份的个数大于1都会报kafka.common.KafkaException: Should not s ...
- kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries. 最无语的配置
注意: 本文不谈废话,低级问题请自行检查. 我使用Java版本的Kafka Producer生产数据,但是抛出了这个异常.百思不得其解,明明防火墙配置,ZooKeeper,Kafka配置都是没问题的啊 ...
- kafka.common.KafkaException: Socket server failed to bind to hdp1:9092: Cannot assign requested address.
ERROR [KafkaServer id=1] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.K ...
- Thread-0" kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
http://blog.csdn.net/jingshuigg/article/details/25001979 zookeeper.connect=localhost:2181改成zookeeper ...
- 全网最详细的启动Kafka服务时出现kafka.common.InconsistentBrokerIdException: Configured brokerId 3 doesn't match stored brokerId 1 in meta.properties错误的解决办法(图文详解)
不多说,直接上干货! 问题详情 执行bin/kafka-server-start.sh config/server.properties 时, [kfk@bigdata-pro03 kafka_2.- ...
- PMON failed to acquire latch, see PMON dump
前几天,一台Oracle数据库(Oracle Database 10g Release 10.2.0.4.0 - 64bit Production)监控出现"PMON failed to a ...
随机推荐
- shell 在手分析服务器日志【转】
自己的小网站跑在阿里云的 ECS 上面, 偶尔也去分析分析自己网站服务器日志,看看网站的访问量.看看有没有黑阔搞破坏!于是收集,整理一些服务器日志分析命令,大家可以试试! awk '{print $1 ...
- boost.lexical_cast 学习
1,字符串 到 数值类型的转换 2,数值 到 字符串的转换 3,异常处理情况 4,boost::lexical_cast 的原型: template<typename Target, typen ...
- epoll机制详解
epoll机制详解 大牛的详解 epoll详解 什么是epoll? epoll是为处理大批量句柄而作了改进的poll, 是性能最好的多路I/O就绪通知方法; 只有三个系统调用: epoll_creat ...
- druid安装
只要下载duridjar包,然后在web.xml配置拦截器(此处不配置监控无法显示web情况,只能看到sql情况)和servlet, 然后在spring配置文件中修改DataSource即可.
- css和javascript代码写在页面中的位置说明
<!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8&quo ...
- nginx多虚拟主机优先级location匹配规则及tryfiles的使用
nginx多虚拟主机优先级location匹配规则及tryfiles的使用 .相同server_name多个虚拟主机优先级访问 .location匹配优先级 .try_files使用 .nginx的a ...
- nginx负载均衡优化配置
针对nginx做负载均衡时其中一台服务器挂掉宕机时响应速度慢的问题解决 nginx会根据预先设置的权重转发请求,若给某一台服务器转发请求时,达到默认超时时间未响应,则再向另一台服务器转发请求. 默认超 ...
- java压缩图片质量
使用了工具thumbnailator,据说thumbnailator是一个非常好的图片开源工具,使用起来很方便.不过没仔细看过,我只是需要压缩图片,让其占用空间变小而已.使用maven引入jar包 & ...
- [javascript]XMLHttpRequest GET/SET HTTP头与改变HTTP METHOD示例代码
<!DOCTYPE html> <html> <head> <meta charset="utf-8"> <title> ...
- 自定义redis连接池(字典操作)
pool=redis.ConnectionPool(host='127.0.0.1', port=6379,max_connections=1000)conn=redis.Redis(connecti ...