Details
-
Bug
-
Resolution: Fixed
-
Major
-
6.5.0
-
Untriaged
-
No
Description
Build : 6.5.0-2647
This ticket is to track the known issue of slowness with some geo queries. The example queries mentioned below are run on functional test VMs and are just hints on what kind of queries are slow. For detailed analysis, we should rely on perf tests.
This is not an exhaustive list of queries, just a sample.
2019-03-18 20:30:50 | INFO | MainProcess | Cluster_Thread | [task.execute] ----------------------------------------------------- Query # 31 ----------------------------------------------------
|
2019-03-18 20:30:50 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "geo-index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "geo", "bottom_right": {"lat": 27.33, "lon": 52.9}, "top_left": {"lat": 38.83, "lon": -122.82}}, "size": 10000000} on node: 172.23.104.105:
|
2019-03-18 20:31:25 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
|
2019-03-18 20:31:25 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "geo", "bottom_right": {"lat": 27.33, "lon": 52.9}, "top_left": {"lat": 38.83, "lon": -122.82}} is 311 (took 34496.418672ms)
|
2019-03-18 20:31:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filter": {"geo_bounding_box": {"geo": {"bottom_right": {"lat": 27.33, "lon": 52.9}, "top_left": {"lat": 38.83, "lon": -122.82}}}}, "query": {"match_all": {}}} on es_index is 311 (took 9ms)
|
|
|
2019-03-18 20:31:25 | INFO | MainProcess | Cluster_Thread | [task.execute] ----------------------------------------------------- Query # 32 ----------------------------------------------------
|
2019-03-18 20:31:25 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "geo-index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"distance": "10000mi", "location": {"lat": 61.28, "lon": -149.34}, "field": "geo"}, "size": 10000000} on node: 172.23.104.105:
|
2019-03-18 20:31:52 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
|
2019-03-18 20:31:52 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"distance": "10000mi", "location": {"lat": 61.28, "lon": -149.34}, "field": "geo"} is 999 (took 27625.899588ms)
|
2019-03-18 20:31:52 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filter": {"geo_distance": {"distance": "10000mi", "geo": {"lat": 61.28, "lon": -149.34}}}, "query": {"match_all": {}}} on es_index is 999 (took 15ms)
|
2019-03-18 20:31:52 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
|
|
|
2019-03-18 20:32:18 | INFO | MainProcess | Cluster_Thread | [task.execute] ----------------------------------------------------- Query # 38 ----------------------------------------------------
|
2019-03-18 20:32:18 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "geo-index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "geo", "bottom_right": {"lat": 19.32, "lon": -66.54}, "top_left": {"lat": 38.83, "lon": -122.82}}, "size": 10000000} on node: 172.23.104.105:
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "geo", "bottom_right": {"lat": 19.32, "lon": -66.54}, "top_left": {"lat": 38.83, "lon": -122.82}} is 310 (took 20402.082707ms)
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filter": {"geo_bounding_box": {"geo": {"bottom_right": {"lat": 19.32, "lon": -66.54}, "top_left": {"lat": 38.83, "lon": -122.82}}}}, "query": {"match_all": {}}} on es_index is 310 (took 7ms)
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
|
|
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [task.execute] ----------------------------------------------------- Query # 40 ----------------------------------------------------
|
2019-03-18 20:32:38 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "geo-index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "geo", "bottom_right": {"lat": 19.59, "lon": -64.35}, "top_left": {"lat": 39, "lon": -126}}, "size": 10000000} on node: 172.23.104.105:
|
2019-03-18 20:32:57 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
|
2019-03-18 20:32:57 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"field": "geo", "bottom_right": {"lat": 19.59, "lon": -64.35}, "top_left": {"lat": 39, "lon": -126}} is 355 (took 18387.675196ms)
|
2019-03-18 20:32:57 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"filter": {"geo_bounding_box": {"geo": {"bottom_right": {"lat": 19.59, "lon": -64.35}, "top_left": {"lat": 39, "lon": -126}}}}, "query": {"match_all": {}}} on es_index is 355 (took 8ms)
|
2019-03-18 20:32:57 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
|
Dataset : Earthquakes (attached)