Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-18538

[FTS] MOSS: All queries return lesser hits now

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Test Blocker
    • 4.5.0
    • 4.5.0
    • cbft

    Description

      Build
      4.5.0-1666, 4.5.0-1673

      Testcase
      ./testrunner -i INI_FILE.ini -p skip-cleanup=True,get-cbcollect-info=False,get-logs=False,stop-on-failure=False,compare_es=True,cluster=D:F,GROUP=P0 -t fts.stable_topology_fts.StableTopFTS.test_query_type,items=30000,num_queries=100,query_types=match_phrase,compare_es=True,dataset=all,GROUP=P0

      Main suspicion arises from this piece of test log that shows 30K docs indexed in 0.22 mins(15secs)! Subsequently all queries return lesser or no results from FTS when compared to ES.

      Complete test log - https://gist.github.com/arunapiravi/c89d116e576cd0573600

      2016-03-04 15:35:16 | INFO | MainProcess | test_thread | [fts_base.create] Creating fulltext-index default_index on 172.23.106.175
      2016-03-04 15:35:16 | INFO | MainProcess | test_thread | [rest_client.create_fts_index] {"params": {"mapping": {"default_field": "_all", "default_analyzer": "simple", "analysis": {}, "default_datetime_parser": "dateTimeOptional", "default_mapping": {"default_analyzer": "", "dynamic": true, "enabled": false}, "type_field": "type", "byte_array_converter": "json", "default_type": "_default"}, "store": {"kvStoreName": "forestdb"}}, "name": "default_index", "planParams": {"hierarchyRules": null, "nodePlanParams": null, "numReplicas": 0, "planFrozen": false, "maxPartitionsPerPIndex": 32}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "sourceParams": {"authUser": "default", "dataManagerSleepMaxMS": 20000, "authSaslUser": "", "clusterManagerSleepMaxMS": 20000, "authSaslPassword": "", "clusterManagerSleepInitMS": 0, "dataManagerBackoffFactor": 0, "authPassword": "", "dataManagerSleepInitMS": 0, "feedBufferAckThreshold": 0, "feedBufferSizeBytes": 0, "clusterManagerBackoffFactor": 0}, "uuid": ""}
      2016-03-04 15:35:16 | INFO | MainProcess | test_thread | [rest_client.create_fts_index] Index default_index created
      2016-03-04 15:35:17 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Number of PIndexes = 32
      2016-03-04 15:35:18 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Every pIndex serves 32 partitions or lesser
      2016-03-04 15:35:18 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: pIndexes are distributed across [u'eea0ee71b76a9465a68e8767de003297'] 
      2016-03-04 15:35:18 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Expecting num of partitions in each node in range 992-1024
      2016-03-04 15:35:18 | INFO | MainProcess | test_thread | [fts_base.is_index_partitioned_balanced] Validated: Node eea0ee71b76a9465a68e8767de003297 houses 32 pindexes which serve 1024 partitions
      2016-03-04 15:35:19 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] Docs in bucket = 30000, docs in FTS index 'default_index': 3647, docs in ES index: 30000 
      2016-03-04 15:35:31 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] Docs in bucket = 30000, docs in FTS index 'default_index': 30000, docs in ES index: 30000 
      2016-03-04 15:35:31 | INFO | MainProcess | test_thread | [fts_base.wait_for_indexing_complete] FTS indexed 30000 docs in 0.22 mins
      

      Attaching cbcollect info.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty