Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-27535

[FTS-Scorch] Indexing is stuck

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 5.5.0
    • 5.5.0
    • fts
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      Build
      5.5.0-1661

      Testcase
      ./testrunner -i /tmp/testexec.12631.ini cluster=D+F,get-cbcollect-info=True,GROUP=P0,index_type=scorch -t fts.stable_topology_fts.StableTopFTS.test_query_type,items=100000,num_queries=1000,query_types=match,cluster=D,F,F,compare_es=True,GROUP=P

      Multiple tests failed.

      fts_ram_quota = 256mb

       
      		 
      [2018-01-10 11:28:13,408] - [fts_base:876] INFO - Creating fulltext-index default_index on 172.23.107.18
      		 
      [2018-01-10 11:28:13,409] - [rest_client:2596] INFO - {"params": {"store": {"mossStoreOptions": {}, "kvStoreName": "mossStore", "indexType": "scorch"}}, "name": "default_index", "planParams": {"numReplicas": 0, "maxPartitionsPerPIndex": 171}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "uuid": ""}
      		 
      [2018-01-10 11:28:13,446] - [rest_client:2603] INFO - Index default_index created
      		 
      [2018-01-10 11:28:13,447] - [fts_base:3481] INFO - Validating index distribution for default_index ...
      		 
      [2018-01-10 11:28:13,564] - [fts_base:3499] INFO - Validated: Number of PIndexes = 6
      		 
      [2018-01-10 11:28:13,583] - [fts_base:3511] INFO - Validated: Every pIndex serves 171 partitions or lesser
      		 
      [2018-01-10 11:28:13,584] - [fts_base:3535] INFO - Expecting num of partitions in each node in range 853-1024
      		 
      [2018-01-10 11:28:13,584] - [fts_base:3550] INFO - Validated: Node 9335141c174d75b4a735467d1b369c3e houses 6 pindexes which serve 1024 partitions
      		 
      [2018-01-10 11:28:13,793] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:13,846] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 0, docs in ES index: 100000 
      [2018-01-10 11:28:20,082] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:20,152] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4189, docs in ES index: 100000 
      [2018-01-10 11:28:26,196] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:26,247] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:28:32,291] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:32,337] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:28:38,379] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:38,427] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:28:44,467] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:44,511] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:28:50,554] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:50,598] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:28:56,641] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:28:56,684] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:02,730] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:02,773] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:08,821] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:08,868] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:14,911] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:14,954] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:20,995] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:21,037] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:27,079] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:27,124] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:33,167] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:33,208] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:39,254] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:39,301] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:45,339] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:45,385] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:51,427] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:51,473] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:29:57,513] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:29:57,557] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:30:03,594] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:30:03,638] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:30:09,682] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:30:09,730] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:30:15,773] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:30:15,816] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:30:21,863] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:30:21,906] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000 
      [2018-01-10 11:30:27,948] - [rest_client:1864] INFO - http://172.23.107.18:8091/pools/default/buckets/default/stats?zoom=minute
      		 
      [2018-01-10 11:30:27,994] - [fts_base:3409] INFO - Docs in bucket = 100000, docs in FTS index 'default_index': 4584, docs in ES index: 100000

      Attaching logs. I do not see any obvious errors in logs.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty