Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-24695

[FTS] Query_string query doesn't work well with numeric values anymore

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 5.0.0
    • 5.0.0
    • fts
    • Untriaged
    • Yes

    Description

      Build
      5.0.0-3008

      This is a regression between 5.0.0-2958 and 3008. Possibly from https://github.com/blevesearch/bleve/commit/77101ae424bb385095b8094dc9fd1cd116a3de8c

      Consistently reproducible with the following testcase.

      Testcase
      ./testrunner -i INI_FILE.ini -t fts.stable_topology_fts.StableTopFTS.index_query_custom_mapping,items=1000,custom_map=True,cm_id=0,num_queries=100,compare_es=True

      A sample query that failed-

      On 2958-

      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "custom_index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}, "size": 10000000} on node: 172.23.106.139:8094
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""} is 0 (took 4.504239ms)
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}} on es_index is 0 (took 15ms)
      2017-06-06 11:12:59 | INFO | MainProcess | Cluster_Thread | [task.execute] SUCCESS: Docs returned by FTS = docs returned by ES, doc_ids verified
      

      On 3008-

      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [fts_base.run_fts_query] Running query {"indexName": "custom_index", "from": 0, "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}, "size": 10000000} on node: 172.23.106.139:8094
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] Status: {u'successful': 6, u'failed': 0, u'total': 6}
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] FTS hits for query: {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""} is 1000 (took 13.159039ms)
      2017-06-06 11:18:15 | INFO | MainProcess | Cluster_Thread | [task.execute] ES hits for query: {"query_string": {"query": "+mutated:>2 +mutated:<=6112 name:\"Josué\" -manages.reports:\"Maura Keelia Kallie\""}} on es_index is 0 (took 5ms)
      2017-06-06 11:18:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: FTS hits: 1000, while ES hits: 0
      2017-06-06 11:18:15 | ERROR | MainProcess | Cluster_Thread | [task.execute] FAIL: Following 1000 doc(s) were not returned by ES,but FTS, printing 50: [u'emp10000538', u'emp10000539', u'emp10000536', u'emp10000537', u'emp10000534', u'emp10000535', u'emp10000532', u'emp10000533', u'emp10000530', u'emp10000531', u'emp10000437', u'emp10000124', u'emp10000127', u'emp10000126', u'emp10000121', u'emp10000120', u'emp10000123', u'emp10000122', u'emp10000719', u'emp10000129', u'emp10000128', u'emp10000439', u'emp10000438', u'emp10000168', u'emp10000472', u'emp10000509', u'emp10000467', u'emp10000351', u'emp10000471', u'emp10000721', u'emp10000446', u'emp10000222', u'emp10000223', u'emp10000220', u'emp10000221', u'emp10000226', u'emp10000227', u'emp10000224', u'emp10000225', u'emp10000543', u'emp10000542', u'emp10000541', u'emp10000229', u'emp10000547', u'emp10000546', u'emp10000545', u'emp10000544', u'emp10000983', u'emp10000982', u'emp10000981']
      

      Not sure if cbcollect will provide the level of info we are looking for in this case. Please let me know if you need them.

      Attachments

        For Gerrit Dashboard: MB-24695
        # Subject Branch Project Status CR V

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty