Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42614

[BP 6.6.1] panic: Timestamp mismatch between snapshot

    XMLWordPrintable

    Details

    • Triage:
      Untriaged
    • Story Points:
      1
    • Is this a Regression?:
      Unknown

      Description

      Build: 6.6.0-7909

      Test is as mentioned in : https://docs.google.com/document/d/1QWiyp5EAv_BHSQGjn7koyvfKMnF3d1l_nQhP2ufL0hM/edit#

      No. of Nodes : 11
      Services : 6 kv+n1ql, 5 fts + index
      Number of GSI indexes: 9 with replica 1 / partitions 15
      Numeber of FTS indexes : 2 with replica 3 / partitions 17
      Number of docs: 1M

      Test run: http://qa.sc.couchbase.com/job/test_suite_executor/270889/console

      During swap rebalance (adding node: 172.23.106.243 and ejecting node: 172.23.106.242), Rebalance failed and found below panic:

      2020-10-26T18:43:50.507-07:00 [Warn] Rebalancer::checkValidNotifyStateDest Detected Invalid State Change Notification. Token Id TransferToken78:d:d1:28:82:49:1f:b0 Local State TransferTokenMerge Metakv State TransferTokenInProgress
      panic: Timestamp mismatch between snapshot
       target bucket: , vbuckets: 0 Crc64: 0 snapType NO_SNAP -
          {vbno, vbuuid, seqno, snapshot-start, snapshot-end}
       
       source bucket: default, vbuckets: 1024 Crc64: 7612910606757529219 snapType DISK_SNAP -
          {vbno, vbuuid, seqno, snapshot-start, snapshot-end}
          {    0     98944deb2e28        968          0        968}
          {    1     c2c698165834        983          0        983}
      
      

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.0-7924 contains indexing commit 1606445 with commit message:
            MB-42614 [BP 6.6.1] wait for first in-mem snapshot before using fast flush

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.0-7924 contains indexing commit 1606445 with commit message: MB-42614 [BP 6.6.1] wait for first in-mem snapshot before using fast flush
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.0-7924 contains indexing commit bbee0b9 with commit message:
            Revert "MB-42614 [BP 6.6.1] use fast_flush_mode only for forestdb"

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.0-7924 contains indexing commit bbee0b9 with commit message: Revert " MB-42614 [BP 6.6.1] use fast_flush_mode only for forestdb"
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.0-7924 contains indexing commit d9c7d60 with commit message:
            Revert "MB-42614 [BP 6.6.1] add internal setting for fast flush"

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.0-7924 contains indexing commit d9c7d60 with commit message: Revert " MB-42614 [BP 6.6.1] add internal setting for fast flush"
            Hide
            deepkaran.salooja Deepkaran Salooja added a comment -

            The fix has been merged to 6.6.1 and 6.6.0 branch for MP4.

            Show
            deepkaran.salooja Deepkaran Salooja added a comment - The fix has been merged to 6.6.1 and 6.6.0 branch for MP4.
            Hide
            girish.benakappa Girish Benakappa added a comment - - edited

            Verified with 6.6.1-9192 and 6.6.0-7924- No issues seen with tests : https://docs.google.com/document/d/1QWiyp5EAv_BHSQGjn7koyvfKMnF3d1l_nQhP2ufL0hM/edit#heading=h.hcywjh2uumv8
            No issues seen with related regression jobs

            Show
            girish.benakappa Girish Benakappa added a comment - - edited Verified with 6.6.1-9192 and 6.6.0-7924- No issues seen with tests : https://docs.google.com/document/d/1QWiyp5EAv_BHSQGjn7koyvfKMnF3d1l_nQhP2ufL0hM/edit#heading=h.hcywjh2uumv8 No issues seen with related regression jobs

              People

              Assignee:
              mihir.kamdar Mihir Kamdar
              Reporter:
              deepkaran.salooja Deepkaran Salooja
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  PagerDuty