Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48194

[System Test] Rebalance exited with reason "bucket_cleanup_failed"

    XMLWordPrintable

Details

    Description

      Build - 7.0.1-6102
      Test -

      -test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml

      Day - 3
      Cycle - 3
      Scale - 3

      TEST STEP

      [2021-08-26T17:00:16-07:00, sequoiatools/couchbase-cli:7.0:564b03] rebalance -c 172.23.97.74:8091 -u Administrator -p password
      		 
      →  
       
      		 
      Error occurred on container - sequoiatools/couchbase-cli:7.0:[rebalance -c 172.23.97.74:8091 -u Administrator -p password]
      		 
       
      		 
      docker logs 564b03
      		 
      docker start 564b03
      		 
       
      		 
      *Unable to display progress bar on this os
      		 
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.
      		 
      [2021-08-26T17:00:43-07:00, sequoiatools/cmd:81e726] 60
      		 
      [2021-08-26T17:01:50-07:00, sequoiatools/cmd:ad54a4] 30
      		 
      [2021-08-26T17:04:01-07:00, sequoiatools/couchbase-cli:7.0:7f925b] rebalance -c 172.23.97.74:8091 --server-remove 172.23.120.74 -u Administrator -p password
      		 
      →  
       
      		 
      Error occurred on container - sequoiatools/couchbase-cli:7.0:[rebalance -c 172.23.97.74:8091 --server-remove 172.23.120.74 -u Administrator -p password]
      		 
       
      		 
      docker logs 7f925b
      		 
      docker start 7f925b
      		 
       
      		 
      *Unable to display progress bar on this os
      		 
      JERROR: Rebalance failed. See logs for detailed reason. You can try again.

      2 Occurrences of Rebalance exited with "bucket_cleanup_failed" in quick succession.

      On 172.23.97.74
      ns_server.debug.log

      [rebalance:error,2021-08-26T17:00:35.559-07:00,ns_1@172.23.97.74:<0.26694.1851>:ns_rebalancer:maybe_cleanup_old_buckets:941]Failed to cleanup old buckets on node 'ns_1@172.23.123.26': {badrpc,
      		 
                                                                   {'EXIT',timeout}}
      		 
      [ns_server:info,2021-08-26T17:00:35.561-07:00,ns_1@172.23.97.74:rebalance_agent<0.22070.0>:rebalance_agent:handle_down:290]Rebalancer process <0.26694.1851> died (reason {buckets_cleanup_failed,
      		 
                                                      ['ns_1@172.23.123.26']}).
      		 
      [ns_server:debug,2021-08-26T17:00:35.561-07:00,ns_1@172.23.97.74:leader_activities<0.23455.0>:leader_activities:handle_activity_down:505]Activity terminated with reason {shutdown,
      		 
                                       {async_died,
      		 
                                        {raised,
      		 
                                         {exit,
      		 
                                          {buckets_cleanup_failed,
      		 
                                           ['ns_1@172.23.123.26']},
      		 
                                          [{ns_rebalancer,rebalance_kv,4,
      		 
                                            [{file,"src/ns_rebalancer.erl"},
      		 
                                             {line,602}]},
      		 
                                           {ns_rebalancer,rebalance_body,5,
      		 
                                            [{file,"src/ns_rebalancer.erl"},
      		 
                                             {line,556}]},
      		 
                                           {async,'-async_init/4-fun-1-',3,
      		 
                                            [{file,"src/async.erl"},
      		 
                                             {line,191}]}]}}}}. Activity:
      		 
      {activity,<0.29036.1851>,#Ref<0.3648888551.3028549638.183159>,default,
      		 
                <<"5733b46753bb092077bb9e90f53979c7">>,
      		 
                [rebalance],
      		 
                majority,[]}
      		 
      [error_logger:error,2021-08-26T17:00:35.562-07:00,ns_1@172.23.97.74:<0.26198.1851>:ale_error_logger_handler:do_log:101]
      		 
      =========================CRASH REPORT=========================
      		 
        crasher:
      		 
          initial call: erlang:apply/2
      		 
          pid: <0.26198.1851>
      		 
          registered_name: []
      		 
          exception exit: {buckets_cleanup_failed,['ns_1@172.23.123.26']}
      		 
            in function  ns_rebalancer:rebalance_kv/4 (src/ns_rebalancer.erl, line 602)
      		 
            in call from ns_rebalancer:rebalance_body/5 (src/ns_rebalancer.erl, line 556)
      		 
            in call from async:'-async_init/4-fun-1-'/3 (src/async.erl, line 191)
      		 
          ancestors: [<0.23486.0>,ns_orchestrator_child_sup,ns_orchestrator_sup,
      		 
                        mb_master_sup,mb_master,leader_registry_sup,
      		 
                        leader_services_sup,<0.22005.0>,ns_server_sup,
      		 
                        ns_server_nodes_sup,<0.258.0>,ns_server_cluster_sup,
      		 
                        root_sup,<0.140.0>]
      		 
          message_queue_len: 0
      		 
          messages: []
      		 
          links: [<0.23486.0>]
      		 
          dictionary: []
      		 
          trap_exit: false
      		 
          status: running
      		 
          heap_size: 75113
      		 
          stack_size: 27
      		 
          reductions: 12440
      		 
        neighbours:
      		 
       
      		 
      [user:error,2021-08-26T17:00:35.562-07:00,ns_1@172.23.97.74:<0.23486.0>:ns_orchestrator:log_rebalance_completion:1416]Rebalance exited with reason {buckets_cleanup_failed,['ns_1@172.23.123.26']}.
      		 
      Rebalance Operation Id = b06d4c675802ff97cec996a5bcad0a01


      [rebalance:error,2021-08-26T17:04:19.613-07:00,ns_1@172.23.97.74:<0.11938.1854>:ns_rebalancer:maybe_cleanup_old_buckets:941]Failed to cleanup old buckets on node 'ns_1@172.23.123.33': {badrpc,
      		 
                                                                   {'EXIT',timeout}}
      		 
      [rebalance:error,2021-08-26T17:04:19.613-07:00,ns_1@172.23.97.74:<0.11938.1854>:ns_rebalancer:maybe_cleanup_old_buckets:941]Failed to cleanup old buckets on node 'ns_1@172.23.120.77': {badrpc,
      		 
                                                                   {'EXIT',timeout}}
      		 
      [rebalance:error,2021-08-26T17:04:19.613-07:00,ns_1@172.23.97.74:<0.11938.1854>:ns_rebalancer:maybe_cleanup_old_buckets:941]Failed to cleanup old buckets on node 'ns_1@172.23.120.86': {badrpc,
      		 
                                                                   {'EXIT',timeout}}
      		 
      [ns_server:info,2021-08-26T17:04:19.614-07:00,ns_1@172.23.97.74:rebalance_agent<0.22070.0>:rebalance_agent:handle_down:290]Rebalancer process <0.11938.1854> died (reason {buckets_cleanup_failed,
      		 
                                                      ['ns_1@172.23.123.33',
      		 
                                                       'ns_1@172.23.120.77',
      		 
                                                       'ns_1@172.23.120.86']}).
      		 
      [ns_server:debug,2021-08-26T17:04:19.614-07:00,ns_1@172.23.97.74:leader_activities<0.23455.0>:leader_activities:handle_activity_down:505]Activity terminated with reason {shutdown,
      		 
                                       {async_died,
      		 
                                        {raised,
      		 
                                         {exit,
      		 
                                          {buckets_cleanup_failed,
      		 
                                           ['ns_1@172.23.123.33',
      		 
                                            'ns_1@172.23.120.77',
      		 
                                            'ns_1@172.23.120.86']},
      		 
                                          [{ns_rebalancer,rebalance_kv,4,
      		 
                                            [{file,"src/ns_rebalancer.erl"},
      		 
                                             {line,602}]},
      		 
                                           {ns_rebalancer,rebalance_body,5,
      		 
                                            [{file,"src/ns_rebalancer.erl"},
      		 
                                             {line,556}]},
      		 
                                           {async,'-async_init/4-fun-1-',3,
      		 
                                            [{file,"src/async.erl"},
      		 
                                             {line,191}]}]}}}}. Activity:
      		 
      {activity,<0.7257.1854>,#Ref<0.3648888551.3028811779.97808>,default,
      		 
                <<"b0b0e2db350ee191d257c48381aff17e">>,
      		 
                [rebalance],
      		 
                majority,[]}
      		 
      [error_logger:error,2021-08-26T17:04:19.616-07:00,ns_1@172.23.97.74:<0.19021.1854>:ale_error_logger_handler:do_log:101]
      		 
      =========================CRASH REPORT=========================
      		 
        crasher:
      		 
          initial call: erlang:apply/2
      		 
          pid: <0.19021.1854>
      		 
          registered_name: []
      		 
          exception exit: {buckets_cleanup_failed,
      		 
                              ['ns_1@172.23.123.33','ns_1@172.23.120.77',
      		 
                               'ns_1@172.23.120.86']}
      		 
            in function  ns_rebalancer:rebalance_kv/4 (src/ns_rebalancer.erl, line 602)
      		 
            in call from ns_rebalancer:rebalance_body/5 (src/ns_rebalancer.erl, line 556)
      		 
            in call from async:'-async_init/4-fun-1-'/3 (src/async.erl, line 191)
      		 
          ancestors: [<0.23486.0>,ns_orchestrator_child_sup,ns_orchestrator_sup,
      		 
                        mb_master_sup,mb_master,leader_registry_sup,
      		 
                        leader_services_sup,<0.22005.0>,ns_server_sup,
      		 
                        ns_server_nodes_sup,<0.258.0>,ns_server_cluster_sup,
      		 
                        root_sup,<0.140.0>]
      		 
          message_queue_len: 0
      		 
          messages: []
      		 
          links: [<0.23486.0>]
      		 
          dictionary: []
      		 
          trap_exit: false
      		 
          status: running
      		 
          heap_size: 75113
      		 
          stack_size: 27
      		 
          reductions: 12440
      		 
        neighbours:
      		 
       
      		 
      [user:error,2021-08-26T17:04:19.616-07:00,ns_1@172.23.97.74:<0.23486.0>:ns_orchestrator:log_rebalance_completion:1416]Rebalance exited with reason {buckets_cleanup_failed,
      		 
                                       ['ns_1@172.23.123.33','ns_1@172.23.120.77',
      		 
                                        'ns_1@172.23.120.86']}.
      		 
      Rebalance Operation Id = 7fc214ef6dfb501e6e6fa4f73923631e

      Attachments

        1. Cpu_utilization.png
          Cpu_utilization.png
          624 kB
        2. sync over 5s node .26.png
          sync over 5s node .26.png
          127 kB
        3. sync over 5s node .33.png
          sync over 5s node .33.png
          136 kB
        4. sync over 5s node .86.png
          sync over 5s node .86.png
          137 kB
        5. sync over 5s node 120.77.png
          sync over 5s node 120.77.png
          139 kB

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-47169 [high-bucket] - 30 multi bucket test rebalance failed with buckets_cleanup_failed error

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Ascending order - Click to sort in descending order
            sujay.gad Sujay Gad created issue -
            meni.hillel Meni Hillel (Inactive) made changes -
            Field Original Value New Value
            Assignee Meni Hillel [ JIRAUSER25407 ] Abhijeeth Nuthan [ abhijeeth.nuthan ]
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Attachment Cpu_utilization.png [ 157168 ]
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Attachment sync over 5s node .26.png [ 157169 ]
            Attachment sync over 5s node .33.png [ 157170 ]
            Attachment sync over 5s node .86.png [ 157171 ]
            Attachment sync over 5s node 120.77.png [ 157172 ]
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Attachment sync over 5s node 120.77-1.png [ 157173 ]
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Attachment sync over 5s node 120.77-1.png [ 157173 ]
            Abhijeeth.Nuthan Abhijeeth Nuthan made changes -
            Link This issue relates to MB-47169 [ MB-47169 ]
            Aliaksey Artamonau Aliaksey Artamonau (Inactive) added a comment -

            Note, that this is on 7.0.1. It does not have either the changes to chronicle that I made to make it a bit less sensitive to disk latency, or the changes to cbcollect_info that were meant to lower the pressure on disk it creates when logs are collected. The issue occurred when cbcollect_info was running. So I'll close it as a duplicate of MB-46099

            The evidence indicating that cluster-wide cbcollect_info collection was ongoing:

                       [{type,cluster_logs_collect},
            		 
                        {status,running},
            		 
                        {progress,10},
            		 
                        {timestamp,{{2021,8,26},{23,57,49}}},
            		 
                        {perNode,
            		 
                            [{'ns_1@172.23.106.134',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.106.134.zip"},
            		 
                                  {status,startingUpload}]},
            		 
                             {'ns_1@172.23.106.136',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.106.136.zip"},
            		 
                                  {status,startingUpload}]},
            		 
                             {'ns_1@172.23.120.58',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.58.zip"},
            		 
                                  {status,startedUpload},
            		 
                                  {url,
            		 
                                      "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.120.58.zip"}]},
            		 
                             {'ns_1@172.23.120.73',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.73.zip"},
            		 
                                  {status,startingUpload}]},
            		 
                             {'ns_1@172.23.120.74',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.74.zip"}]},
            		 
                             {'ns_1@172.23.120.77',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.77.zip"}]},
            		 
                             {'ns_1@172.23.120.81',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.81.zip"}]},
            		 
                             {'ns_1@172.23.120.86',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.86.zip"}]},
            		 
                             {'ns_1@172.23.123.24',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.24.zip"}]},
            		 
                             {'ns_1@172.23.123.25',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.25.zip"}]},
            		 
                             {'ns_1@172.23.123.26',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.26.zip"}]},
            		 
                             {'ns_1@172.23.123.31',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.31.zip"},
            		 
                                  {status,uploaded},
            		 
                                  {url,
            		 
                                      "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.123.31.zip"}]},
            		 
                             {'ns_1@172.23.123.32',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.32.zip"},
            		 
                                  {status,uploaded},
            		 
                                  {url,
            		 
                                      "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.123.32.zip"}]},
            		 
                             {'ns_1@172.23.123.33',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.33.zip"}]},
            		 
                             {'ns_1@172.23.96.122',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.122.zip"}]},
            		 
                             {'ns_1@172.23.96.14',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.14.zip"}]},
            		 
                             {'ns_1@172.23.96.243',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.243.zip"}]},
            		 
                             {'ns_1@172.23.96.254',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.254.zip"}]},
            		 
                             {'ns_1@172.23.96.48',
            		 
                                 [{path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.48.zip"},
            		 
                                  {status,uploaded},
            		 
                                  {url,
            		 
                                      "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.96.48.zip"}]},
            		 
                             {'ns_1@172.23.97.105',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.105.zip"}]},
            		 
                             {'ns_1@172.23.97.110',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.110.zip"}]},
            		 
                             {'ns_1@172.23.97.112',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.112.zip"}]},
            		 
                             {'ns_1@172.23.97.148',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.148.zip"}]},
            		 
                             {'ns_1@172.23.97.149',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.149.zip"}]},
            		 
                             {'ns_1@172.23.97.150',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.150.zip"}]},
            		 
                             {'ns_1@172.23.97.151',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.151.zip"}]},
            		 
                             {'ns_1@172.23.97.241',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.241.zip"}]},
            		 
                             {'ns_1@172.23.97.74',
            		 
                                 [{status,started},
            		 
                                  {path,
            		 
                                      "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.74.zip"}]}]}]

            Aliaksey Artamonau Aliaksey Artamonau (Inactive) added a comment - Note, that this is on 7.0.1. It does not have either the changes to chronicle that I made to make it a bit less sensitive to disk latency, or the changes to cbcollect_info that were meant to lower the pressure on disk it creates when logs are collected. The issue occurred when cbcollect_info was running. So I'll close it as a duplicate of MB-46099 The evidence indicating that cluster-wide cbcollect_info collection was ongoing: [{type,cluster_logs_collect}, {status,running}, {progress,10}, {timestamp,{{2021,8,26},{23,57,49}}}, {perNode, [{'ns_1@172.23.106.134', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.106.134.zip"}, {status,startingUpload}]}, {'ns_1@172.23.106.136', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.106.136.zip"}, {status,startingUpload}]}, {'ns_1@172.23.120.58', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.58.zip"}, {status,startedUpload}, {url, "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.120.58.zip"}]}, {'ns_1@172.23.120.73', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.73.zip"}, {status,startingUpload}]}, {'ns_1@172.23.120.74', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.74.zip"}]}, {'ns_1@172.23.120.77', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.77.zip"}]}, {'ns_1@172.23.120.81', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.81.zip"}]}, {'ns_1@172.23.120.86', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.120.86.zip"}]}, {'ns_1@172.23.123.24', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.24.zip"}]}, {'ns_1@172.23.123.25', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.25.zip"}]}, {'ns_1@172.23.123.26', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.26.zip"}]}, {'ns_1@172.23.123.31', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.31.zip"}, {status,uploaded}, {url, "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.123.31.zip"}]}, {'ns_1@172.23.123.32', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.32.zip"}, {status,uploaded}, {url, "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.123.32.zip"}]}, {'ns_1@172.23.123.33', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.123.33.zip"}]}, {'ns_1@172.23.96.122', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.122.zip"}]}, {'ns_1@172.23.96.14', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.14.zip"}]}, {'ns_1@172.23.96.243', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.243.zip"}]}, {'ns_1@172.23.96.254', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.254.zip"}]}, {'ns_1@172.23.96.48', [{path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.96.48.zip"}, {status,uploaded}, {url, "https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630022267/collectinfo-2021-08-26T235749-ns_1%40172.23.96.48.zip"}]}, {'ns_1@172.23.97.105', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.105.zip"}]}, {'ns_1@172.23.97.110', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.110.zip"}]}, {'ns_1@172.23.97.112', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.112.zip"}]}, {'ns_1@172.23.97.148', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.148.zip"}]}, {'ns_1@172.23.97.149', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.149.zip"}]}, {'ns_1@172.23.97.150', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.150.zip"}]}, {'ns_1@172.23.97.151', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.151.zip"}]}, {'ns_1@172.23.97.241', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.241.zip"}]}, {'ns_1@172.23.97.74', [{status,started}, {path, "/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-08-26T235749-ns_1@172.23.97.74.zip"}]}]}]
            Aliaksey Artamonau Aliaksey Artamonau (Inactive) added a comment -

            Duplicate of MB-46099.

            Aliaksey Artamonau Aliaksey Artamonau (Inactive) added a comment - Duplicate of MB-46099 .
            Aliaksey Artamonau Aliaksey Artamonau (Inactive) made changes -
            Resolution Duplicate [ 3 ]
            Status Open [ 1 ] Resolved [ 5 ]
            mihir.kamdar Mihir Kamdar (Inactive) added a comment -

            Bulk closing all not-fixed issues

            mihir.kamdar Mihir Kamdar (Inactive) added a comment - Bulk closing all not-fixed issues
            mihir.kamdar Mihir Kamdar (Inactive) made changes -
            Status Resolved [ 5 ] Closed [ 6 ]

            People

              Abhijeeth.Nuthan Abhijeeth Nuthan
              sujay.gad Sujay Gad
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty