kafka安装使用配置1.1

官方文档

rz上传到/usr/local/下

解压 tar xzvf 文件

改名 mv 文件 名字

环境变量 vi /etc/profile

export KAFKA_HOME=/usr/local/kafka

生成环境变量 source /etc/profile

启动zkServer.sh start

cd kafka/

cd config/

/*

或者删除文件 传进来

*/

里面的配置删掉替换为如下：

broker.id=1

listeners=PLAINTEXT://192.168.16.100:9092

#advertised.listeners=PLAINTEXT://your.host.name:9092

#listener.security.protocol.map=PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL

num.network.threads=3

num.io.threads=8

socket.send.buffer.bytes=102400

socket.receive.buffer.bytes=102400

socket.request.max.bytes=104857600

log.dirs=/var/kafka/log

num.partitions=1

num.recovery.threads.per.data.dir=1

offsets.topic.replication.factor=1

transaction.state.log.replication.factor=1

transaction.state.log.min.isr=1

# The number of messages to accept before forcing a flush of data to disk

#log.flush.interval.messages=10000

# The maximum amount of time a message can sit in a log before we force a flush

#log.flush.interval.ms=1000

# The minimum age of a log file to be eligible for deletion due to age

log.retention.hours=168

# A size-based retention policy for logs. Segments are pruned from the log unless the remaining

# segments drop below log.retention.bytes. Functions independently of log.retention.hours.

#log.retention.bytes=1073741824

# The maximum size of a log segment file. When this size is reached a new log segment will be created.

log.segment.bytes=1073741824

# The interval at which log segments are checked to see if they can be deleted according

# to the retention policies

log.retention.check.interval.ms=300000

zookeeper.connect=192.168.16.100:2181

zookeeper.connection.timeout.ms=6000

group.initial.rebalance.delay.ms=0

delete.topic.enable=true

配置完成

二 启动kafka

kafka-server-start.sh /usr/local/kafka/config/server.properties

三 克隆创建一个TOPIC

kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

查看TOPIC

kafka-topics.sh --list --zookeeper localhost:2181

四 发送一个消息

kafka-console-producer.sh --broker-list 192.168.16.100:9092 --topic test

可以输入 DING XIANG HUA等等消息

执行吓一跳命令然后在输入 中文的 丁香花

五 克隆回会话启动消费者可以多启动使用

kafka-console-consumer.sh --bootstrap-server 192.168.16.100:9092 --topic test --from-beginning

删除TOPIC

kafka-topics.sh --delete --topic test --zookeeper localhost:2181