1.HDFS
start-dfs.sh
stop-dfs.sh
2.Yarn;
start-yarn.sh
stop-yarn.sh要先启动ZooKeeper 再启动Kafka 顺序不可以改变。先关闭kafka ，再关闭zookeeper。
3.Zookeeper
zkServer.sh start
zkServer.sh stop
检查ZooKeeper状态：zkServer.sh status
4.kafka
路径根据自己的配置去修改
启动
kafka-server-start.sh -daemon /opt/apps/kafka/config/server.properties
关闭
kafka-server-stop.sh
新建一个主题
kafka-topics.sh --zookeeper node04:2181,node02:2181,node03:2181/kafka --create --replication-factor 1 --partitions 1 --topic topic_spider_jd
kafka-topics.sh --zookeeper node01:2181 --create --replication-factor 3 --partitions 1 --topic t1 Created topic t1.
flume采集数据
flume-ng agent --name a1 --conf-file /opt/apps/flume/conf/spider-flume-kafka.conf &
