Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-6440

queries return "error":"no_active_vbuckets","reason":"Cannot execute view query since the node has no active vbuckets" during rebalance in 1->2

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0
    • Component/s: ns_server
    • Security Level: Public
    • Labels:
      None
    • Environment:
      build 1643, 4 cores VMs, CentOS

      Description

      Test case info:

      Test uses employee data set:
      -documents are structured as

      {"name": name<string>, "join_yr" : year<int>, "join_mo" : month<int>, "join_day" : day<int>, "email": email<string>, "job_title" : title<string>, "type" : type<string>, "desc" : desc<string>}

      Steps to repro:
      1. Start load data (1M items, reproduced for 200 000 also)
      2. start rebalance
      3. start querying
      first queries, when rebalance progress is less than 1 % queries return no_active_vbuckets errors

      Views structures are:
      5 ddocs, 1 view per ddoc
      Views : ['test_view-be32a4c : map_fn=function (doc)

      { if(doc.job_title !== undefined) emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] ); }, reduce_fn=None', 'test_view-c35c1e3 : map_fn=function (doc) { if(doc.job_title !== undefined) { var myregexp = new RegExp("^UI "); if(doc.job_title.match(myregexp)){ emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] );}}}, reduce_fn=None', 'test_view-83e8cd6 : map_fn=function (doc) { if(doc.job_title !== undefined) { var myregexp = new RegExp("^System "); if(doc.job_title.match(myregexp)){ emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] );}}}, reduce_fn=None', 'test_view-b04a750 : map_fn=function (doc) { if(doc.job_title !== undefined) { var myregexp = new RegExp("^Senior "); if(doc.job_title.match(myregexp)){ emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] );}}}, reduce_fn=None', 'test_view-728563e : map_fn=function (doc) { if(doc.job_title !== undefined) emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] ); }

      , reduce_fn=_count', 'test_view-4c75454 : map_fn=function (doc, meta) { if(doc.job_title !== undefined) { var myregexp = new RegExp("^admin"); if(meta.id.match(myregexp))

      { emit([doc.join_yr, doc.join_mo, doc.join_day], [doc.name, doc.email] );}

      }}, reduce_fn=None']

      Exact query example:
      http://10.2.2.63:8092/default/_design/test_view-41833a2/_view/test_view-41833a2?debug=true&start_key=%5B2008%2C7%2Cnull%5D&connection_timeout=60000

      test to reproduce issue:
      -t viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_incrementaly,skip_rebalance=true

      logs are attached

      1. 10.2.2.108-8091-diag.txt.gz
        7.49 MB
        Iryna
      2. 10.2.2.60-8091-diag.txt.gz
        6.72 MB
        Iryna
      3. 10.2.2.63-8091-diag.txt.gz
        2.23 MB
        Iryna
      4. 10.2.2.64-8091-diag.txt.gz
        2.40 MB
        Iryna
      5. 10.2.2.65-8091-diag.txt.gz
        1.58 MB
        Iryna
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        that's probably different bug then. Please file separate bug with diags. This is potentially something very severe.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - that's probably different bug then. Please file separate bug with diags. This is potentially something very severe.
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Also, please, make sure incident is actually covered by debug logs you have.

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Also, please, make sure incident is actually covered by debug logs you have.
        Hide
        alkondratenko Aleksey Kondratenko (Inactive) added a comment -

        Waiting for diags

        Show
        alkondratenko Aleksey Kondratenko (Inactive) added a comment - Waiting for diags
        Hide
        iryna iryna added a comment -

        not reproduced 1747

        Show
        iryna iryna added a comment - not reproduced 1747
        Hide
        iryna iryna added a comment -

        verified build 1857

        Show
        iryna iryna added a comment - verified build 1857

          People

          • Assignee:
            iryna iryna
            Reporter:
            iryna iryna
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes