栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 面试经验 > 面试问答

从Elasticsearch中的搜索中删除重复的文档

面试问答 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

从Elasticsearch中的搜索中删除重复的文档

您可以使用字段折叠,将结果分组到

name
字段上并将
top_hits
聚合器的大小设置为1。

/POST http://localhost:9200/test/dedup/_search?search_type=count&pretty=true{  "aggs":{    "dedup" : {      "terms":{        "field": "name"       },       "aggs":{         "dedup_docs":{"top_hits":{  "size":1}         }       }        }  }}

这将返回:

{  "took" : 192,  "timed_out" : false,  "_shards" : {    "total" : 1,    "successful" : 1,    "failed" : 0  },  "hits" : {    "total" : 6,    "max_score" : 0.0,    "hits" : [ ]  },  "aggregations" : {    "dedup" : {      "buckets" : [ {        "key" : "name1",        "doc_count" : 2,        "dedup_docs" : {          "hits" : {          "total" : 2,          "max_score" : 1.0,          "hits" : [ { "_index" : "test", "_type" : "dedup", "_id" : "1", "_score" : 1.0, "_source":{domain: "domain1.fr", name: "name1", date: "01-01-2014"}          } ]        }      }    }, {      "key" : "name2",      "doc_count" : 2,      "dedup_docs" : {        "hits" : {          "total" : 2,          "max_score" : 1.0,          "hits" : [ { "_index" : "test", "_type" : "dedup", "_id" : "3", "_score" : 1.0, "_source":{domain: "domain1.fr", name: "name2", date: "01-03-2014"}          } ]        }      }    }, {      "key" : "name3",      "doc_count" : 2,      "dedup_docs" : {        "hits" : {          "total" : 2,          "max_score" : 1.0,          "hits" : [ { "_index" : "test", "_type" : "dedup", "_id" : "5", "_score" : 1.0, "_source":{domain: "domain1.fr", name: "name3", date: "01-05-2014"}} ]         }       }     } ]   } }}


转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/367568.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号