栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

SpringBoot2.X项目搭建整合Kafka客户端Demo(初级入门四)

SpringBoot2.X项目搭建整合Kafka客户端Demo(初级入门四)

1.纯净springboot2.x项目加入kafka-client


      org.apache.kafka
      kafka-clients
      2.4.0

2.单元测试配置客户端+创建topic

private static final String TOPIC_NAME = "wnn-topic-test-01";
    
    public static AdminClient initAdminClient(){
        Properties properties = new Properties();
        properties.setProperty(AdminClientConfig.BOOTSTRAP_SERVERS_CONFIG,xx.xx.xx.55.160:9092");

        AdminClient adminClient = AdminClient.create(properties);
        return adminClient;
    }
   
    @Test
    public void createTopicTest(){
        AdminClient adminClient = initAdminClient();

        //指定分区数量,副本数量
        NewTopic newTopic = new NewTopic(TOPIC_NAME,2,(short) 1);

        CreateTopicsResult createTopicsResult = adminClient.createTopics(Arrays.asList(newTopic));
        try {
            //future等待创建,成功则不会有任何报错
            createTopicsResult.all().get();
        } catch (InterruptedException e) {
            e.printStackTrace();
        } catch (ExecutionException e) {
            e.printStackTrace();
        }

    }

查看topic

./kafka-topics.sh --list --zookeeper xxx.xxx.xx.240:2181

 查看broker节点topic状态信息

 三、列举topic /删除topic

   
    @Test
    public void listTopicTest() throws ExecutionException, InterruptedException {
        AdminClient adminClient = initAdminClient();

        //是否查看内部的topic,可以不用
        ListTopicsOptions options = new ListTopicsOptions();
        options.listInternal(true);

        ListTopicsResult listTopicsResult = adminClient.listTopics(options);

        Set topics = listTopicsResult.names().get();
        for(String name : topics){
            System.err.println(name);
        }

    }

 删除Topic

    
    @Test
    public void delTopicTest() throws ExecutionException, InterruptedException {
        AdminClient adminClient = initAdminClient();

        DeleteTopicsResult deleteTopicsResult = adminClient.deleteTopics(Arrays.asList("wnn-topic-test"));

        deleteTopicsResult.all().get();
    }

四、查看topic详情/增加分区数量

    
    @Test
    public void detailTopicTest() throws ExecutionException, InterruptedException {

        AdminClient adminClient = initAdminClient();
        DescribeTopicsResult describeTopicsResult = adminClient.describeTopics(Arrays.asList(TOPIC_NAME));

        Map stringTopicDescriptionMap = describeTopicsResult.all().get();

        Set> entries = stringTopicDescriptionMap.entrySet();

        entries.stream().forEach((entry)-> System.err.println("name :"+entry.getKey()+" , desc: "+ entry.getValue()));
    }

 增加分区数量

    
    @Test
    public void incrPartitionTopicTest() throws ExecutionException, InterruptedException {
        Map infoMap = new HashMap<>(1);


        AdminClient adminClient = initAdminClient();
        NewPartitions newPartitions = NewPartitions.increaseTo(5);

        infoMap.put(TOPIC_NAME,newPartitions);

        CreatePartitionsResult createPartitionsResult = adminClient.createPartitions(infoMap);

        createPartitionsResult.all().get();

    }

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/674294.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号