Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-25685

Doc count is incorrect

    XMLWordPrintable

Details

    • Untriaged
    • Unknown

    Description

      Build
      5.0.0-3490

      Testcase
      ./testrunner -i INI_FILE.ini get-cbcollect-info=True,get-coredumps=True,get-logs=False,stop-on-failure=False,cluster=D+F:F:F,level_compaction=False,GROUP=P0 -t fts.stable_topology_fts.StableTopFTS.run_default_index_query,items=1000,query="""

      {"terms": ["Darcei", "Safiya"], "field":"manages.reports"}

      """,expected_hits=0,GROUP=P0

      This is a weird case where the test loads only 1000 keys but 'curr_items' stat shows 30k. Also the fts_index only contains 1k docs which is correct but the test itself fails because the key-count in storage-engine incorrectly shows 30k.

      Steps
      1. D+F, F, F cluster
      2. create default bucket, load 1k docs into default bucket
      3. create default fts index
      4. check if 1k docs are indexed - 1k docs are indexed but bucket count shows 30k

      Failing for the first time, do not think this is a regression.

      [2017-08-11 10:44:16,425] - [rest_client:2550] INFO - Index default_index_1 created
      		 
      [2017-08-11 10:44:16,425] - [fts_base:3447] INFO - Validating index distribution for default_index_1 ...
      		 
      [2017-08-11 10:44:16,559] - [fts_base:3465] INFO - Validated: Number of PIndexes = 6
      		 
      [2017-08-11 10:44:16,582] - [fts_base:3477] INFO - Validated: Every pIndex serves 171 partitions or lesser
      		 
      [2017-08-11 10:44:16,582] - [fts_base:3495] INFO - Validated: pIndexes are distributed across [u'577799b237b835701a33f411e595e464', u'e14c3a146b21924706dccb16be957c95', u'e830d54331e08c9e7e85b5f43277f94d'] 
      [2017-08-11 10:44:16,582] - [fts_base:3501] INFO - Expecting num of partitions in each node in range 170-512
      		 
      [2017-08-11 10:44:16,582] - [fts_base:3516] INFO - Validated: Node 577799b237b835701a33f411e595e464 houses 2 pindexes which serve 340 partitions
      		 
      [2017-08-11 10:44:16,582] - [fts_base:3516] INFO - Validated: Node e14c3a146b21924706dccb16be957c95 houses 2 pindexes which serve 342 partitions
      		 
      [2017-08-11 10:44:16,582] - [fts_base:3516] INFO - Validated: Node e830d54331e08c9e7e85b5f43277f94d houses 2 pindexes which serve 342 partitions
      		 
      [2017-08-11 10:44:16,660] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 7
      		 
      [2017-08-11 10:44:22,722] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:28,786] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:34,856] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:40,934] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:47,016] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:53,090] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:44:59,186] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:05,268] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:11,345] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:17,439] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:23,536] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:29,626] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:35,729] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:41,814] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:47,899] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:45:53,993] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:00,081] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:06,169] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:12,252] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:18,342] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:24,432] - [fts_base:3377] INFO - Docs in bucket = 30000, docs in FTS index 'default_index_1': 1000
      		 
      [2017-08-11 10:46:30,530] - [fts_base:3605] INFO - Docs in index default_index_1=1000, bucket docs=30000

      On .187, from stats.log I see -

       
      		 
       curr_items:                                            30000
      		 
       curr_items_tot:                                        30000
      		 
       curr_temp_items:                                       0
      		 
       daemon_connections:                                    6
      		 
       decr_hits:                                             0
      		 
       decr_misses:                                           0
      		 
       delete_hits:                                           0
      		 
       delete_misses:                                         0
      		 
       ep_access_scanner_enabled:                             true
      		 
       ep_access_scanner_last_runtime:                        0
      		 
       ep_access_scanner_num_items:                           0
      		 
       ep_access_scanner_task_time:                           2017-08-12 02:00:01
      		 
       ep_active_ahead_exceptions:                            0
      		 
       ep_active_behind_exceptions:                           0
      		 
       ep_active_datatype_json:                               30000

      Also, in fts log, it appears all mutations received by dcp have been indexed.

      "partitions":{"601":{"seq":39,"seqReceived":39,"uuid":"44959070402724"},"572":{"seq":0,"seqReceived":0,"uuid":"210117982396541"},"574":{"seq":27,"seqReceived":27,"uuid":"28180690812604"},"564":{"seq":38,"seqReceived":38,"uuid":"133320702494804"},"653":{"seq":21,"seqReceived":21,"uuid":"255935062382347"},"549":{"seq":32,"seqReceived":32,"uuid":"90521633256106"},"597":{"seq":32,"seqReceived":32,"uuid":"51466914680922"},"515":{"seq":34,"seqReceived":34,"uuid":"197214774548556"},"650":{"seq":25,"seqReceived":25,"uuid":"248027197054745"},"651":{"seq":27,"seqReceived":27,"uuid":"79768912298357"},"621":{"seq":28,"seqReceived":28,"uuid":"212488043787559"},"522":{"seq":0,"seqReceived":0,"uuid":"188442415300220"},"550":{"seq":0,"seqReceived":0,"uuid":"155862208507469"},"569":{"seq":30,"seqReceived":30,"uuid":"224975028766878"},"537":{"seq":0,"seqReceived":0,"uuid":"277874626927408"},"627":{"seq":36,"seqReceived":36,"uuid":"207586807977961"},"523":{"seq":0,"seqReceived":0,"uuid":"115333259826114"},"656":{"seq":24,"seqReceived":24,"uuid":"50425403141110"},"677":{"seq":0,"seqReceived":0,"uuid":"164107941961775"},"577":{"seq":26,"seqReceived":26,"uuid":"280377156289757"},"528":{"seq":0,"seqReceived":0,"uuid":"254097966485331"},"610":{"seq":0,"seqReceived":0,"uuid":"45481291715201"},"664":{"seq":26,"seqReceived":26,"uuid":"49819533590313"},"639":{"seq":32,"seqReceived":32,"uuid":"134028448977387"},"548":{"seq":0,"seqReceived":0,"uuid":"192144959352378"},"629":{"seq":0,"seqReceived":0,"uuid":"235442641971874"},"568":{"seq":24,"seqReceived":24,"uuid":"239671278128065"},"670":{"seq":29,"seqReceived":29,"uuid":"237219603145392"},"571":{"seq":39,"seqReceived":39,"uuid":"254571079498737"},"646":{"seq":0,"seqReceived":0,"uuid":"177829180051918"},"539":{"seq":22,"seqReceived":22,"uuid":"67747487546132"},"585":{"seq":24,"seqReceived":24,"uuid":"24143741145465"},"599":{"seq":36,"seqReceived":36,"uuid":"118780249824389"},"642":{"seq":28,"seqReceived":28,"uuid":"172192287350224"},"518":{"seq":24,"seqReceived":24,"uuid":"14923274349326"},"632":{"seq":23,"seqReceived":23,"uuid":"178592978350366"},"607":{"seq":0,"seqReceived":0,"uuid":"130557414748233"},"517":{"seq":0,"seqReceived":0,"uuid":"279265693381982"},"593":{"seq":0,"seqReceived":0,"uuid":"87695522945891"},"580":{"seq":0,"seqReceived":0,"uuid":"182256128099067"},"560":{"seq":0,"seqReceived":0,"uuid":"234190076565179"},"622":{"seq":0,"seqReceived":0,"uuid":"220499603363929"},"614":{"seq":0,"seqReceived":0,"uuid":"165505007987278"},"513":{"seq":30,"seqReceived":30,"uuid":"329724090963"},"680":{"seq":30,"seqReceived":30,"uuid":"183523933970052"},"552":{"seq":0,"seqReceived":0,"uuid":"135835334291939"},"559":{"seq":0,"seqReceived":0,"uuid":"64924640332939"},"682":{"seq":36,"seqReceived":36,"uuid":"262696199920827"},"669":{"seq":0,"seqReceived":0,"uuid":"109108136098646"},"524":{"seq":0,"seqReceived":0,"uuid":"109237246874263"},"633":{"seq":22,"seqReceived":22,"uuid":"37741805342776"},"576":{"seq":31,"seqReceived":31,"uuid":"237336054118578"},"604":{"seq":0,"seqReceived":0,"uuid":"42340264447038"},"605":{"seq":25,"seqReceived":25,"uuid":"160630196043026"},"541":{"seq":24,"seqReceived":24,"uuid":"122751304131949"},"676":{"seq":34,"seqReceived":34,"uuid":"230670226971130"},"665":{"seq":31,"seqReceived":31,"uuid":"142061107846774"},"624":{"seq":0,"seqReceived":0,"uuid":"101859520638072"},"551":{"seq":41,"seqReceived":41,"uuid":"186558765308196"},"673":{"seq":23,"seqReceived":23,"uuid":"178850958779930"},"562":{"seq":0,"seqReceived":0,"uuid":"62282380946190"},"545":{"seq":0,"seqReceived":0,"uuid":"127080779228710"},"543":{"seq":38,"seqReceived":38,"uuid":"56760842934481"},"573":{"seq":0,"seqReceived":0,"uuid":"7360758133546"},"640":{"seq":39,"seqReceived":39,"uuid":"35962846541874"},"652":{"seq":32,"seqReceived":32,"uuid":"231824500967404"},"662":{"seq":26,"seqReceived":26,"uuid":"163342889585398"},"667":{"seq":0,"seqReceived":0,"uuid":"167215103364701"},"636":{"seq":0,"seqReceived":0,"uuid":"24961539187518"},"525":{"seq":37,"seqReceived":37,"uuid":"275468821349255"},"644":{"seq":25,"seqReceived":25,"uuid":"138698369185842"},"631":{"seq":21,"seqReceived":21,"uuid":"259430376826384"},"661":{"seq":0,"seqReceived":0,"uuid":"31708033882132"},"612":{"seq":0,"seqReceived":0,"uuid":"225807403627955"},"672":{"seq":22,"seqReceived":22,"uuid":"62895856977760"},"600":{"seq":35,"seqReceived":35,"uuid":"225846043122819"},"595":{"seq":25,"seqReceived":25,"uuid":"168392256912031"},"602":{"seq":0,"seqReceived":0,"uuid":"101927989453644"},"514":{"seq":0,"seqReceived":0,"uuid":"57642764139291"},"581":{"seq":38,"seqReceived":38,"uuid":"172982569918588"},"540":{"seq":0,"seqReceived":0,"uuid":"179868935192260"},"611":{"seq":26,"seqReceived":26,"uuid":"29297604234804"},"623":{"seq":37,"seqReceived":37,"uuid":"61993905948489"},"617":{"seq":0,"seqReceived":0,"uuid":"90978878352765"},"565":{"seq":42,"seqReceived":42,"uuid":"17384146031298"},"589":{"seq":0,"seqReceived":0,"uuid":"161707307980534"},"615":{"seq":0,"seqReceived":0,"uuid":"222450577759056"},"626":{"seq":34,"seqReceived":34,"uuid":"249590039669709"},"655":{"seq":0,"seqReceived":0,"uuid":"84510334479547"},"566":{"seq":0,"seqReceived":0,"uuid":"237909074689766"},"608":{"seq":0,"seqReceived":0,"uuid":"55235119500996"},"598":{"seq":0,"seqReceived":0,"uuid":"271345441760285"},"575":{"seq":25,"seqReceived":25,"uuid":"171674602124240"},"649":{"seq":0,"seqReceived":0,"uuid":"212363695640665"},"587":{"seq":42,"seqReceived":42,"uuid":"221128369905998"},"521":{"seq":23,"seqReceived":23,"uuid":"26704221050559"},"590":{"seq":0,"seqReceived":0,"uuid":"63559408361552"},"658":{"seq":42,"seqReceived":42,"uuid":"167986365904741"},"567":{"seq":28,"seqReceived":28,"uuid":"217576902892265"},"555":{"seq":33,"seqReceived":33,"uuid":"146734336011709"},"647":{"seq":0,"seqReceived":0,"uuid":"146821063339923"},"666":{"seq":0,"seqReceived":0,"uuid":"146678814116143"},"563":{"seq":0,"seqReceived":0,"uuid":"263120918511920"},"603":{"seq":28,"seqReceived":28,"uuid":"63694982882042"},"620":{"seq":21,"seqReceived":21,"uuid":"167766074992387"},"588":{"seq":0,"seqReceived":0,"uuid":"74731929389054"},"542":{"seq":33,"seqReceived":33,"uuid":"164810909469744"},"668":{"seq":38,"seqReceived":38,"uuid":"13536619344808"},"582":{"seq":20,"seqReceived":20,"uuid":"139832845273170"},"596":{"seq":21,"seqReceived":21,"uuid":"44582761775601"},"570":{"seq":0,"seqReceived":0,"uuid":"12853867735176"},"519":{"seq":24,"seqReceived":24,"uuid":"279694353671926"},"648":{"seq":0,"seqReceived":0,"uuid":"68686995234648"},"578":{"seq":0,"seqReceived":0,"uuid":"218739091601641"},"546":{"seq":0,"seqReceived":0,"uuid":"202327650368872"},"554":{"seq":25,"seqReceived":25,"uuid":"198405507754887"},"619":{"seq":21,"seqReceived":21,"uuid":"173522423373970"},"534":{"seq":0,"seqReceived":0,"uuid":"34161231006425"},"643":{"seq":0,"seqReceived":0,"uuid":"115648726868418"},"592":{"seq":0,"seqReceived":0,"uuid":"167666687772024"},"635":{"seq":0,"seqReceived":0,"uuid":"269896799969615"},"553":{"seq":36,"seqReceived":36,"uuid":"82344583734248"},"516":{"seq":0,"seqReceived":0,"uuid":"108007385210253"},"625":{"seq":30,"seqReceived":30,"uuid":"275187009754376"},"638":{"seq":20,"seqReceived":20,"uuid":"200937791199363"},"671":{"seq":20,"seqReceived":20,"uuid":"215461819721589"},"663":{"seq":0,"seqReceived":0,"uuid":"190261187833944"},"618":{"seq":27,"seqReceived":27,"uuid":"28998485144783"},"654":{"seq":36,"seqReceived":36,"uuid":"109906153697628"},"532":{"seq":28,"seqReceived":28,"uuid":"99229308148848"},"634":{"seq":0,"seqReceived":0,"uuid":"210044810479385"},"536":{"seq":0,"seqReceived":0,"uuid":"23533843191395"},"591":{"seq":26,"seqReceived":26,"uuid":"194491441743997"},"675":{"seq":0,"seqReceived":0,"uuid":"50315818754347"},"547":{"seq":21,"seqReceived":21,"uuid":"250194025985471"},"556":{"seq":23,"seqReceived":23,"uuid":"186041085095744"},"637":{"seq":34,"seqReceived":34,"uuid":"74032277782697"},"683":{"seq":34,"seqReceived":34,"uuid":"41036059041631"},"558":{"seq":0,"seqReceived":0,"uuid":"4626450574132"},"527":{"seq":28,"seqReceived":28,"uuid":"262591847623071"},"583":{"seq":29,"seqReceived":29,"uuid":"91183622857721"},"609":{"seq":40,"seqReceived":40,"uuid":"234293453058270"},"594":{"seq":27,"seqReceived":27,"uuid":"70039395555873"},"674":{"seq":0,"seqReceived":0,"uuid":"70313737047601"},"657":{"seq":0,"seqReceived":0,"uuid":"144634612630524"},"526":{"seq":0,"seqReceived":0,"uuid":"17975972721077"},"544":{"seq":0,"seqReceived":0,"uuid":"120506829083477"},"659":{"seq":0,"seqReceived":0,"uuid":"21438975090021"},"630":{"seq":0,"seqReceived":0,"uuid":"95179983032950"},"628":{"seq":0,"seqReceived":0,"uuid":"211122776512289"},"606":{"seq":0,"seqReceived":0,"uuid":"261281652427998"},"533":{"seq":23,"seqReceived":23,"uuid":"106129549821162"},"645":{"seq":0,"seqReceived":0,"uuid":"176662242538467"},"681":{"seq":0,"seqReceived":0,"uuid":"147439434512703"},"660":{"seq":0,"seqReceived":0,"uuid":"199309691471128"},"616":{"seq":0,"seqReceived":0,"uuid":"122403547394214"},"520":{"seq":0,"seqReceived":0,"uuid":"259043536705485"},"641":{"seq":35,"seqReceived":35,"uuid":"248757623335611"},"613":{"seq":20,"seqReceived":20,"uuid":"237738950415382"},"529":{"seq":36,"seqReceived":36,"uuid":"29195256854612"},"531":{"seq":26,"seqReceived":26,"uuid":"101225976042764"},"579":{"seq":0,"seqReceived":0,"uuid":"161323094268657"},"584":{"seq":0,"seqReceived":0,"uuid":"72816423970506"},"538":{"seq":0,"seqReceived":0,"uuid":"182029484973332"},"679":{"seq":20,"seqReceived":20,"uuid":"222289567075339"},"557":{"seq":24,"seqReceived":24,"uuid":"243097313065136"},"535":{"seq":0,"seqReceived":0,"uuid":"191819237722432"},"586":{"seq":0,"seqReceived":0,"uuid":"258011543663269"},"678":{"seq":32,"seqReceived":32,"uuid":"61300258146386"},"530":{"seq":20,"seqReceived":20,"uuid":"181973440704621"},"561":{"seq":22,"seqReceived":22,"uuid":"98847094492571"}}}},"manager":{"TotKick":0,"TotSetOptions":0,"TotRegisterFeed":150,"TotUnregisterFeed":148,"TotRegisterPIndex":150,"TotUnregisterPIndex":148,"TotSaveNodeDef":2,"TotSaveNodeDefNil":0,"TotSaveNodeDefGetErr":0,"TotSaveNodeDefSetErr":0,"TotSaveNodeDefRetry":0,"TotSaveNodeDefSame":2,"TotSaveNodeDefOk":2,"TotCreateIndex":26,"TotCreateIndexOk":26,"TotDeleteIndex":31,"TotDeleteIndexOk":27,"TotIndexControl":0,"TotIndexControlOk":0,"TotDeleteIndexBySource":16,"TotDeleteIndexBySourceErr":4,"TotDeleteIndexBySourceOk":12,"TotPlannerOpStart":0,"TotPlannerOpRes":0,"TotPlannerOpErr":0,"TotPlannerOpDone":0,"TotPlannerNOOP":0,"TotPlannerNOOPOk":0,"TotPlannerKick":53,"TotPlannerKickStart":0,"TotPlannerKickChanged":0,"TotPlannerKickErr":0,"TotPlannerKickOk":0,"TotPlannerUnknownErr":0,"TotPlannerSubscriptionEvent":0,"TotPlannerStop":0,"TotJanitorOpStart":587,"TotJanitorOpRes":587,"TotJanitorOpErr":4,"TotJanitorOpDone":587,"TotJanitorNOOP":0,"TotJanitorNOOPOk":0,"TotJanitorKick":587,"TotJanitorKickStart":587,"TotJanitorKickErr":4,"TotJanitorKickOk":583,"TotJanitorClosePIndex":0,"TotJanitorRemovePIndex":0,"TotJanitorRestartPIndex":0,"TotJanitorLoadDataDir":0,"TotJanitorUnknownErr":0,"TotJanitorSubscriptionEvent":586,"TotJanitorStop":0,"TotRefreshLastNodeDefs":138,"TotRefreshLastIndexDefs":374,"TotRefreshLastPlanPIndexes":517}}

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty