Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-25636

gsi rebalance with replica indexes fails with "{lost_connection,shutdown}"

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • 5.0.0
    • 5.0.0
    • secondary-index
    • Enterprise Edition 5.0.0 build 3484
    • No

    Description

      Steps to Repro:
      This was seen while running a 2i system test on the local laptop cluster.
      1) 8 node cluster 2 kv, 4 index,1nql
      2) Create lot of indexes with max replicas upto 2
      3) Run kv ops and queries in parallel
      4) Multiple failover/remove of indexer nodes were performed. Some of the rebalance fails with "Rebalance exited with reason {service_rebalance_failed,index, {lost_connection,shutdown}}"

      Here are logs and few node's logs are attached-
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.33.zip
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.41.zip
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.66.zip
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.68.zip
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.69.zip
      https://s3.amazonaws.com/bugdb/jira/lost_connection/collectinfo-2017-08-10T135735-ns_1%40172.16.12.70.zip

      Attachments

        1. 172.16.12.33.zip
          69.97 MB
        2. 172.16.12.57_indexer.log.zip
          2.28 MB
        3. 172.16.12.57.zip
          65.59 MB
        4. 172.16.12.67_indexer.log.zip
          1.30 MB
        5. 172.16.12.67.zip
          83.88 MB
        6. indexer_log_archives1.zip
          72.48 MB
        7. indexer_log_archives2.zip
          46.20 MB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            mahesh.mandhare Mahesh Mandhare (Inactive)
            mahesh.mandhare Mahesh Mandhare (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty