Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59677

[System Test] Fatal error - PlasmaId found for new instance

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      Not really sure if these errors signify anything,

      Seen on 171

      2023-11-15T11:29:25.876-08:00 [Info] tenant '': findInstance:/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/docIndex with alternateId:17542482186002181126-1-1
      		 
      2023-11-15T11:29:25.876-08:00 [Error] Shard /data/@2i/shards/shard7781074776685923538(7781074776685923538)(17542482186002181126-1-1) : (fatal error - PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/docIndex, plasmaId=1)
      		 
      2023-11-15T11:29:25.876-08:00 [Info] tenant '': findInstance:/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex with alternateId:17542482186002181126-1-0
      		 
      2023-11-15T11:29:25.876-08:00 [Error] Shard /data/@2i/shards/shard15677490784459649784(15677490784459649784)(17542482186002181126-1-0) : (fatal error - PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1)
      		 
      Destory instances matching prefix /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index in /data/@2i ...
      		 
      2023-11-15T11:29:25.876-08:00 [Info] Shard /data/@2i/shards/shard15677490784459649784(15677490784459649784)(17542482186002181126-1-0) : destroying instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex ...
      		 
      2023-11-15T11:29:25.877-08:00 [Info] Shard /data/@2i/shards/shard15677490784459649784(15677490784459649784)(17542482186002181126-1-0) : removed plasmaId 1 for instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex ...
      		 
      2023-11-15T11:29:25.877-08:00 [Info] Shard /data/@2i/shards/shard15677490784459649784(15677490784459649784)(17542482186002181126-1-0) : metadata saved successfully
      		 
      2023-11-15T11:29:25.877-08:00 [Info] Shard /data/@2i/shards/shard15677490784459649784(15677490784459649784)(17542482186002181126-1-0) : instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex sucessfully destroyed
      		 
      2023-11-15T11:29:25.877-08:00 [Info] Shard /data/@2i/shards/shard7781074776685923538(7781074776685923538)(17542482186002181126-1-1) : destroying instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/docIndex ...
      		 
      2023-11-15T11:29:25.877-08:00 [Info] Shard /data/@2i/shards/shard7781074776685923538(7781074776685923538)(17542482186002181126-1-1) : removed plasmaId 1 for instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/docIndex ...
      		 
      2023-11-15T11:29:25.883-08:00 [Info] Shard /data/@2i/shards/shard7781074776685923538(7781074776685923538)(17542482186002181126-1-1) : metadata saved successfully
      		 
      2023-11-15T11:29:25.883-08:00 [Info] Shard /data/@2i/shards/shard7781074776685923538(7781074776685923538)(17542482186002181126-1-1) : instance /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/docIndex sucessfully destroyed
      		 
      All instances matching prefix /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index destroyed
      		 
      2023-11-15T11:29:25.884-08:00 [Error] Indexer::initPartnInstance Error creating slice Unable to initialize /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, err = PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1. Abort.
      		 
      2023-11-15T11:29:25.884-08:00 [Info] Indexer::run:msg_loop: CLUST_MGR_CREATE_INDEX_DDL message from internalAdminRecvCh channel processing took 8.063895ms
      		 
      2023-11-15T11:29:25.884-08:00 [Info] Indexer::listenAdminMsgs:msg_loop: CLUST_MGR_CREATE_INDEX_DDL message from adminRecvCh channel processing took 8.203658ms
      		 
      2023-11-15T11:29:25.884-08:00 [Error] clustMgrAgent::OnIndexCreate: Error for Create Index: instId 7844939606224612434, indexDefn DefnId: 7581299827281207712 Name: idx12_U5aOh3 Using: plasma Bucket: bucket1 Scope/Id: scope_1/a Collection/Id: coll_1/18 IsPrimary: false NumReplica: 3 InstVersion: 1 
      		SecExprs: <ud>([`name` `phone` `type`])</ud> 
      		Desc: [true false false]
      		 
      		IndexMissingLeadingKey: true
      		 
      		IsPartnKeyDocId: true
      		 
      		PartitionScheme: KEY 
      		HashScheme: CRC32 PartitionKeys: [(meta().`id`)] WhereExpr: <ud>()</ud> RetainDeletedXATTR: false 
      		AlternateShardIds: map[3:[17542482186002181126-1-0 17542482186002181126-1-1]] . Error: Error creating slice Unable to initialize /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, err = PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1.
      		 
      2023-11-15T11:29:25.884-08:00 [Error] LifecycleMgr.CreateIndexInstance() : CreateIndexInstance fails. Reason = Error creating slice Unable to initialize /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, err = PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1
      		 
      2023-11-15T11:29:25.884-08:00 [Info] LifecycleMgr.DeleteIndexInstance() : index defnId 7581299827281207712 instance id 7844939606224612434
      		 
      2023-11-15T11:29:25.889-08:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_CREATE_INDEX_REBAL elapsed 18.091412ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error Error creating slice Unable to initialize /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, err = PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1
      		 
      2023-11-15T11:29:25.889-08:00 [Error] Rebalancer::processTokenAsDest: Error cloning index 127.0.0.1:9102/createIndexRebalance Error creating slice Unable to initialize /data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, err = PlasmaId found for new instance. Path=/data/@2i/bucket1_idx12_U5aOh3_7844939606224612434_3.index/mainIndex, plasmaId=1
      		 
      2023-11-15T11:29:25.891-08:00 [Info] Rebalancer::decodeTransferToken TransferToken TransferToken24:24:81:f:0:4c:29:d4  MasterId: 0a0126e5b0a8901d71f7073afa316a8a SourceId:  DestId: 9dbc4b746dbcb7b0d2309d7ab88bb6a4 (172.23.106.171:8091) RebalId: aa31b6803f21d3f8f4d6ac05f5bb0d6e State: TransferTokenCreated BuildSource: Dcp TransferMode: Copy InstId: 2894524599475665452 RealInstId: 16506633486113985353 Partitions: [1] Versions: [1] IsEmptyNodeBatch: false IsPendingReady: false

      Cbcollect logs:

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.106.171.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.106.176.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.97.109.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1700089038/collectinfo-2023-11-15T230948-ns_1%40172.23.97.67.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavan.pb Pavan PB
            pavan.pb Pavan PB
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty