栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

kafka环境搭建

kafka环境搭建

首先软件下载

#wget  https://archive.apache.org/dist/kafka/2.2.0/kafka_2.12-2.2.0.tgz
#tar zxvf kafka_2.12-2.2.0.tgz
修改配置文件
#grep -Ev '^#|^$' server.properties 
broker.id=0
listeners=PLAINTEXT://172.19.220.157:9092
advertised.listeners=PLAINTEXT://172.19.220.157:9092
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.retention.hours=168
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=172.19.220.157:2181
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0

#grep -Ev '^#|^$' zookeeper.properties 
dataDir=/tmp/zookeeper
clientPort=2181
maxClientCnxns=0

配置supervisor管理

kafka服务
#cat kafka.conf 
[program:kafka_service]
command = /soft/kafka_2.12-2.2.0/bin/kafka-server-start.sh config/server.properties
directory = /soft/kafka_2.12-2.2.0
process_name = %(program_name)s_%(process_num)s
numprocs = 1
autorestart = true
startsecs = 1
stdout_logfile_maxbytes = 50MB
stdout_logfile_backups = 20
stdout_logfile = /var/log/kafka_service.log
stderr_logfile = /var/log/kafka_service_error.log

zk服务

cat zk.conf 
[program:kafka_zk]
command = /soft/kafka_2.12-2.2.0/bin/zookeeper-server-start.sh config/zookeeper.properties
directory = /soft/kafka_2.12-2.2.0
process_name = %(program_name)s_%(process_num)s
numprocs = 1
autorestart = true
startsecs = 1
stdout_logfile_maxbytes = 50MB
stdout_logfile_backups = 20
stdout_logfile = /var/log/kafka_zk.log
stderr_logfile = /var/log/kafka_zk_error.log

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/722966.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号