Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-24695

[FTS] Query_string query doesn't work well with numeric values anymore

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 5.0.0
    • 5.0.0
    • fts
    • Untriaged
    • Yes

    Description

      Build
      5.0.0-3008

      This is a regression between 5.0.0-2958 and 3008. Possibly from https://github.com/blevesearch/bleve/commit/77101ae424bb385095b8094dc9fd1cd116a3de8c

      Consistently reproducible with the following testcase.

      Testcase
      ./testrunner -i INI_FILE.ini -t fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping,items=1000,custom_map=True,cm_id=0,num_queries=100,compare_es=True

      A sample query that failed-

      On 2958-

      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "custom_index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}, "size": 10000000} on node: 172.23.106.139:8094
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""} is 0 (took 4.504239ms)
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}} on es_index is 0 (took 15ms)
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
      

      On 3008-

      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "custom_index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}, "size": 10000000} on node: 172.23.106.139:8094
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""} is 1000 (took 13.159039ms)
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}} on es_index is 0 (took 5ms)
      2017-06-06 11:18:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1000, while ES hits: 0
      2017-06-06 11:18:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1000 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000538', u'emp10000539', u'emp10000536', u'emp10000537', u'emp10000534', u'emp10000535', u'emp10000532', u'emp10000533', u'emp10000530', u'emp10000531', u'emp10000437', u'emp10000124', u'emp10000127', u'emp10000126', u'emp10000121', u'emp10000120', u'emp10000123', u'emp10000122', u'emp10000719', u'emp10000129', u'emp10000128', u'emp10000439', u'emp10000438', u'emp10000168', u'emp10000472', u'emp10000509', u'emp10000467', u'emp10000351', u'emp10000471', u'emp10000721', u'emp10000446', u'emp10000222', u'emp10000223', u'emp10000220', u'emp10000221', u'emp10000226', u'emp10000227', u'emp10000224', u'emp10000225', u'emp10000543', u'emp10000542', u'emp10000541', u'emp10000229', u'emp10000547', u'emp10000546', u'emp10000545', u'emp10000544', u'emp10000983', u'emp10000982', u'emp10000981']
      

      Not sure if cbcollect will provide the level of info we are looking for in this case. Please let me know if you need them.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty