栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 软件开发 > 后端开发 > Java

Elasticsearch — 聚合查询,先分组后排序 ,分页

Java 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

Elasticsearch — 聚合查询,先分组后排序 ,分页

需求
对明细数据先按 waybillId 分组,再按 eventTime 降序,取最新一条数据。

桶聚合(bucket)
Elasticsearch 桶聚合,目的就是数据分组,先将数据按指定的条件分成多个组,然后对每一个组进行统计。

  1. ES SQL 写法

     {
       "query": {
         "bool": {
           "must": [
             {
               "match_all": {}
             }
           ]
         }
       },
       "aggs": {
         "waybillIdAgg": {
           "terms": {
             "field": "waybillId",
             "size": 1000,
             "min_doc_count": 1
           },
           "aggs": {
             "top1": {
               "top_hits": {
                 "size": 1,
                 "sort": [
                   {
                     "eventTime": {
                       "order": "desc"
                     }
                   }
                 ]
               }
             }
           }
         }
       }
     }
    
  2. Java Elasticsearch 写法及结果解析

     // 查询条件
     BoolQueryBuilder queryBool = QueryBuilders.boolQuery();
    
     BoolQueryBuilder inFilter = new BoolQueryBuilder();
     waybillIds.forEach(
         waybillId -> inFilter.should(QueryBuilders.termQuery("waybillId", waybillId)));
     queryBool.must(inFilter);
    
     // 桶聚合(bucket),按waybillId分组
     TermsAggregationBuilder termsAggregationBuilder =
         AggregationBuilders.terms("waybillIdAgg").field("waybillId").size(1000).minDocCount(1);
     // 嵌套桶,再按时间倒序取第一条数据
     TopHitsAggregationBuilder sort =
         AggregationBuilders.topHits("top1").size(1).sort("eventTime", SortOrder.DESC);
     termsAggregationBuilder.subAggregation(sort);
     // 分页
         SearchSourceBuilder searchSourceBuilder =
             SearchSourceBuilder.searchSource().query(queryBool).aggregation(termsAggregationBuilder)
          	.from(pageIndex <= 1 ? 0 : ((pageIndex - 1) * pageSize)).size(pageSize);
         // 查询请求
     SearchRequest searchRequest = new SearchRequest(esIndexConfig.getIndexNameTrackingDetail());
     searchRequest.source(searchSourceBuilder);
    
     // 执行查询
     SearchResponse searchResponse =
         restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
         
     // 处理聚合查询结果
     Aggregations aggregations = searchResponse.getAggregations();
     Terms terms = aggregations.get("waybillIdAgg");
     List trackingDetails =
         terms.getBuckets().stream()
             .map(
                 t -> {
                   Aggregation top1 = t.getAggregations().get("top1");
                   Optional first =
                       Arrays.stream(((ParsedTopHits) top1).getHits().getHits()).findFirst();
                   if (first.isPresent()) {
                     Map trackingDetailMap = first.get().getSourceAsMap();
                     return BeanUtil.fillBeanWithMap(trackingDetailMap, new TrackingDetail(), false);
                   }
                   return null;
                 })
             .collect(Collectors.toList());
    
转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/888768.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号