kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
1、刚才未启动zookeeper集群的时候,直接启动kafka脚本程序,kafka报错了,但是进程号启动起来来,再次启动出现如下所示的问题,这里先将进程号杀死,再启动脚本程序。
[hadoop@slaver1 script_hadoop]$ kafka-start.sh
start kafkaServer...
[-- ::,] INFO Verifying properties (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property broker.id is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.retention.check.interval.ms is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.retention.hours is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property log.segment.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.io.threads is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.network.threads is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property num.partitions is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property port is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.receive.buffer.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.request.max.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property socket.send.buffer.bytes is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property zookeeper.connect is overridden to slaver1:,slaver2:,slaver3: (kafka.utils.VerifiableProperties)
[-- ::,] INFO Property zookeeper.connection.timeout.ms is overridden to (kafka.utils.VerifiableProperties)
[-- ::,] INFO [Kafka Server ], starting (kafka.server.KafkaServer)
[-- ::,] INFO [Kafka Server ], Connecting to zookeeper on slaver1:,slaver2:,slaver3: (kafka.server.KafkaServer)
[-- ::,] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[-- ::,] INFO Client environment:zookeeper.version=3.3.-, built on // : GMT (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:host.name=slaver1 (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.home=/home/hadoop/soft/jdk1..0_79/jre (org.apache.zookeeper.ZooKeeper)
[-- ::,] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8./bin/../core/build/dependant-libs-2.8./*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,140] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,141] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,143] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@61a2d734 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,223] INFO Opening socket connection to server slaver3/192.168.19.133:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,247] INFO Socket connection established to slaver3/192.168.19.133:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,271] INFO Session establishment complete on server slaver3/192.168.19.133:2181, sessionid = 0x363857e11950000, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,275] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:27,425] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:27,437] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:27,452] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:27,460] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:27,461] INFO Session: 0x363857e11950000 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:27,463] INFO [Kafka Server 1], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:27,558] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:30,444] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,525] INFO Property broker.id is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,526] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,526] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.retention.check.interval.ms is overridden to 60000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,527] INFO Property log.segment.bytes is overridden to 536870912 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,528] INFO Property num.io.threads is overridden to 8 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,529] INFO Property num.network.threads is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,530] INFO Property num.partitions is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,532] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,533] INFO Property socket.receive.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,534] INFO Property socket.request.max.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,534] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,535] INFO Property zookeeper.connect is overridden to slaver1:2181,slaver2:2181,slaver3:2181 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,537] INFO Property zookeeper.connection.timeout.ms is overridden to 1000000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:30,567] INFO [Kafka Server 2], starting (kafka.server.KafkaServer)
[2018-05-22 09:37:30,569] INFO [Kafka Server 2], Connecting to zookeeper on slaver1:2181,slaver2:2181,slaver3:2181 (kafka.server.KafkaServer)
[2018-05-22 09:37:30,622] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:30,674] INFO Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:host.name=slaver2 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,674] INFO Client environment:java.home=/home/hadoop/soft/jdk1.7.0_79/jre (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/dependant-libs-2.8.0/*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,675] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,676] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,678] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,678] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,679] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,681] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@6ae56499 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:30,723] INFO Opening socket connection to server slaver1/192.168.19.131:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,732] INFO Socket connection established to slaver1/192.168.19.131:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,752] INFO Session establishment complete on server slaver1/192.168.19.131:2181, sessionid = 0x163857dfeaa0001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:30,758] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:31,139] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:31,153] INFO [Kafka Server 2], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:31,173] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:31,184] INFO Session: 0x163857dfeaa0001 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:31,185] INFO [Kafka Server 2], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:31,186] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:31,266] INFO [Kafka Server 2], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:33,769] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,891] INFO Property broker.id is overridden to 3 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.cleaner.enable is overridden to false (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.dirs is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,892] INFO Property log.retention.check.interval.ms is overridden to 60000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property log.segment.bytes is overridden to 536870912 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,893] INFO Property num.io.threads is overridden to 8 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,895] INFO Property num.network.threads is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,896] INFO Property num.partitions is overridden to 2 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,897] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,897] INFO Property socket.receive.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,898] INFO Property socket.request.max.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,899] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,900] INFO Property zookeeper.connect is overridden to slaver1:2181,slaver2:2181,slaver3:2181 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,901] INFO Property zookeeper.connection.timeout.ms is overridden to 1000000 (kafka.utils.VerifiableProperties)
[2018-05-22 09:37:33,928] INFO [Kafka Server 3], starting (kafka.server.KafkaServer)
[2018-05-22 09:37:33,930] INFO [Kafka Server 3], Connecting to zookeeper on slaver1:2181,slaver2:2181,slaver3:2181 (kafka.server.KafkaServer)
[2018-05-22 09:37:33,989] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:34,010] INFO Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:host.name=slaver3 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:java.version=1.7.0_79 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,010] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.home=/home/hadoop/soft/jdk1.7.0_79/jre (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.class.path=:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/dependant-libs-2.8.0/*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../perf/build/libs//kafka-perf_2.8.0*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../clients/build/libs//kafka-clients*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../examples/build/libs//kafka-examples*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/jopt-simple-3.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/kafka_2.9.2-0.8.1.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/log4j-1.2.15.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-annotation-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/metrics-core-2.2.0.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/scala-library-2.9.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-api-1.7.2.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/slf4j-nop-1.7.6.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/snappy-java-1.0.5.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zkclient-0.3.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../libs/zookeeper-3.3.4.jar:/home/hadoop/soft/kafka_2.9.2-0.8.1/bin/../core/build/libs/kafka_2.8.0*.jar (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,011] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,012] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,012] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,013] INFO Client environment:os.version=2.6.32-358.el6.x86_64 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,014] INFO Client environment:user.name=hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,014] INFO Client environment:user.home=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,015] INFO Client environment:user.dir=/home/hadoop (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,017] INFO Initiating client connection, connectString=slaver1:2181,slaver2:2181,slaver3:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@6ae56499 (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,081] INFO Opening socket connection to server slaver1/192.168.19.131:2181 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,091] INFO Socket connection established to slaver1/192.168.19.131:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,106] INFO Session establishment complete on server slaver1/192.168.19.131:2181, sessionid = 0x163857dfeaa0002, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,111] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2018-05-22 09:37:34,268] FATAL Fatal error during KafkaServerStable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:95)
at kafka.log.LogManager$$anonfun$lockLogDirs$1.apply(LogManager.scala:92)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:33)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.WrappedArray.map(WrappedArray.scala:33)
at kafka.log.LogManager.lockLogDirs(LogManager.scala:92)
at kafka.log.LogManager.<init>(LogManager.scala:55)
at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:275)
at kafka.server.KafkaServer.startup(KafkaServer.scala:72)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:34)
at kafka.Kafka$.main(Kafka.scala:46)
at kafka.Kafka.main(Kafka.scala)
[2018-05-22 09:37:34,279] INFO [Kafka Server 3], shutting down (kafka.server.KafkaServer)
[2018-05-22 09:37:34,304] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2018-05-22 09:37:34,311] INFO Session: 0x163857dfeaa0002 closed (org.apache.zookeeper.ZooKeeper)
[2018-05-22 09:37:34,311] INFO [Kafka Server 3], shut down completed (kafka.server.KafkaServer)
[2018-05-22 09:37:34,312] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2018-05-22 09:37:34,559] INFO [Kafka Server 3], shutting down (kafka.server.KafkaServer)
[hadoop@slaver1 script_hadoop]$ jps
2898 Jps
2802 QuorumPeerMain
2725 Kafka
[hadoop@slaver1 script_hadoop]$
kafka.common.KafkaException: Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.的更多相关文章
- kafka启动报错:kafka.common.KafkaException: Failed to acquire lock on file .lock
kafka 异常退出后重启时遇到的问题 解决: 执行 netstat -lnp|grep 9092 在执行结果中找到进程号执行 kill -9 进程号再尝试启动Kafka
- Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.
1. 问题现象 启动 kafka 时报错:Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in an ...
- kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
今天在写kafka生产者生成数据的程序并运行时,报如下错误: log4j:WARN No appenders could be found for logger (kafka.utils.Verifi ...
- kafka集群中常见错误的解决方法:kafka.common.KafkaException: Should not set log end offset on partition
问题描述:kafka单台机器做集群操作是没有问题的,如果分布多台机器并且partitions或者备份的个数大于1都会报kafka.common.KafkaException: Should not s ...
- kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries. 最无语的配置
注意: 本文不谈废话,低级问题请自行检查. 我使用Java版本的Kafka Producer生产数据,但是抛出了这个异常.百思不得其解,明明防火墙配置,ZooKeeper,Kafka配置都是没问题的啊 ...
- kafka.common.KafkaException: Socket server failed to bind to hdp1:9092: Cannot assign requested address.
ERROR [KafkaServer id=1] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.K ...
- Thread-0" kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
http://blog.csdn.net/jingshuigg/article/details/25001979 zookeeper.connect=localhost:2181改成zookeeper ...
- 全网最详细的启动Kafka服务时出现kafka.common.InconsistentBrokerIdException: Configured brokerId 3 doesn't match stored brokerId 1 in meta.properties错误的解决办法(图文详解)
不多说,直接上干货! 问题详情 执行bin/kafka-server-start.sh config/server.properties 时, [kfk@bigdata-pro03 kafka_2.- ...
- PMON failed to acquire latch, see PMON dump
前几天,一台Oracle数据库(Oracle Database 10g Release 10.2.0.4.0 - 64bit Production)监控出现"PMON failed to a ...
随机推荐
- 浅谈Linux下CPU利用率和CPU负载【转】
转自:https://blog.csdn.net/Alisa_xf/article/details/71430406 在Linux/Unix下,CPU利用率(CPU utilization)分为用户态 ...
- Python运维开发基础03-语法基础 【转】
上节作业回顾(讲解+温习60分钟) #!/usr/bin/env python3 # -*- coding:utf-8 -*- # author:Mr.chen #只用变量和字符串+循环实现“用户登陆 ...
- 使用unix的time命令进行简单的计时
/usr/bin/time -p python3 1.py 需要注意这里使用的是/usr/bin/time 命令而不unix系统自带time. 输出 real 0.04 user 0.03 sys 0 ...
- 学习awk命令的使用
作者:邓聪聪 awk是行处理器: 相比较屏幕处理的优点,在处理庞大文件时不会出现内存溢出或是处理缓慢的问题,通常用来格式化文本信息 awk处理过程: 依次对每一行进行处理,然后输出 awk命令形式: ...
- 使用位图字体工具BMFont从图片生成自定义字体
转载自:http://blog.csdn.net/keshuiyun/article/details/9960667 BMFont下载地址: http://www.angelcode.com/prod ...
- iperf 2.05版本升级到2.0.9
将openwrt trunk 分支上iperf 2.0.9移植到 bb版本上时,编译遇到如下问题: make[6]: Entering directory '/home/hbg/bb/build_d ...
- daemon.debug hostapd: wlan0: WPA rekeying GTK
现象描述:client连接上AP后,切换接口(譬如lan口的)模式,静态地址和dhcp模式切换后,一段时间后断开连接,再也连接不上,ap侧日志如下: Wed Nov 8 14:39:31 2017 ...
- $Django 发送邮件--django封装模块和python内置SMTP模块
一 使用SMTP模块发送邮件 import smtplib from email.mime.text import MIMEText from email.header import Header m ...
- sqlserver2008r2还原完整备份和差异备份及自动删除过期备份
本文主要内容: 还原完整和差异备份 删除超过1个月的备份 注:保证SQL Server代理服务启动,并把服务设置为自动启动 完整备份和差异备份还原原理: 差异备份是完整备份的补充,只备份上次完整备份后 ...
- mysql 5.7 Group Replication
MySQL 组复制实现了基于复制协议的多主更新(单主模式). 复制组由多个 server成员构成,并且组中的每个 server 成员可以独立地执行事务.但所有读写(RW)事务只有在冲突检测成功后才会提 ...