Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43414

Partition 304 not in active nor passive set - error observed again in alice longevity

    XMLWordPrintable

Details

    • 1

    Description

      6.0.5-3333

      Seeing this issue in 6.0.5 longevity - this is same as MB-19869 which has not occurred in a while in longevity

      diag.log on .103:

      2020-12-22T06:31:15.819-08:00, ns_memcached:0:info:message(ns_1@172.23.106.100) - Shutting down bucket "CUSTOMER" on 'ns_1@172.23.106.100' for deletion
      2020-12-22T06:32:55.851-08:00, ns_vbucket_mover:0:critical:message(ns_1@172.23.108.103) - <0.32316.653> exited with {unexpected_exit,
                                 {'EXIT',<0.32642.653>,
                                  {{error,
                                    {badrpc,
                                     {'EXIT',
                                      {{error,
                                        <<"Partition 304 not in active nor passive set">>},
                                       {gen_server,call,
                                        ['capi_set_view_manager-default',
                                         {wait_index_updated,304},
                                         infinity]}}}}},
                                   {gen_server,call,
                                    [{'janitor_agent-default','ns_1@172.23.108.103'},
                                     {if_rebalance,<0.30817.652>,
                                      {wait_index_updated,304}},
                                     infinity]}}}}
      2020-12-22T06:32:55.951-08:00, ns_orchestrator:0:critical:message(ns_1@172.23.108.103) - Rebalance exited with reason {mover_crashed,
                                    {unexpected_exit,
                                     {'EXIT',<0.32642.653>,
                                      {{error,
                                        {badrpc,
                                         {'EXIT',
                                          {{error,
                                            <<"Partition 304 not in active nor passive set">>},
                                           {gen_server,call,
                                            ['capi_set_view_manager-default',
                                             {wait_index_updated,304},
                                             infinity]}}}}},
                                       {gen_server,call,
                                        [{'janitor_agent-default',
                                          'ns_1@172.23.108.103'},
                                         {if_rebalance,<0.30817.652>,
                                          {wait_index_updated,304}},
                                         infinity]}}}}}
      2020-12-22T06:33:23.391-08:00, compaction_new_daemon:0:warning:message(ns_1@172.23.108.103) - Compactor for view `mapreduce_view/default/_design/scale/replica` (pid [{type,
                                                                               view},
      

      Logs:
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.97.242.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.104.137.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.99.25.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.123.28.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.123.27.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.104.70.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.99.11.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.96.253.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.108.103.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.96.148.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.97.119.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.98.135.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.97.239.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.104.69.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.121.3.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.104.67.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.99.21.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.99.20.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.96.95.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.97.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.97.121.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1608681801/collectinfo-2020-12-23T000322-ns_1%40172.23.104.5.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ankit.prabhu Ankit Prabhu
            arunkumar Arunkumar Senthilnathan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty