Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58962

[System Test] Index creation failure because of Replica violation

    XMLWordPrintable

Details

    • Untriaged
    • 0
    • Unknown

    Description

      During the system test run, some index create statements seem to have thrown errors. There are replica violation errors seen in query.log.

      Seen on 172.23.97.100

      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 2, bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Can move to 172.23.105.122:8091: NoViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Cannot move to 172.23.97.108:8091: ReplicaViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Can move to 172.23.106.30:8091: NoViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Cannot move to 172.23.106.171:8091: ReplicaViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 3 (replica 1), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Cannot move to 172.23.105.122:8091: ReplicaViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Can move to 172.23.97.108:8091: NoViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Cannot move to 172.23.106.30:8091: ReplicaViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Can move to 172.23.106.171:8091: NoViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 2 (replica 2), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Can move to 172.23.105.122:8091: NoViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Cannot move to 172.23.97.108:8091: ReplicaViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Can move to 172.23.106.30:8091: NoViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Cannot move to 172.23.106.171:8091: ReplicaViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 3 (replica 3), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Cannot move to 172.23.105.122:8091: ReplicaViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Can move to 172.23.97.108:8091: NoViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Cannot move to 172.23.106.30:8091: ReplicaViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Can move to 172.23.106.171:8091: NoViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      2023-10-04T08:32:58.055-07:00 [Error] Encounter planner error for index. Error: 
      MemoryQuota: 10096738304
      		 
      CpuQuota: 8
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 2, bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Can move to 172.23.105.122:8091: NoViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Cannot move to 172.23.97.108:8091: ReplicaViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Can move to 172.23.106.30:8091: NoViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Cannot move to 172.23.106.171:8091: ReplicaViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 3 (replica 1), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Cannot move to 172.23.105.122:8091: ReplicaViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Can move to 172.23.97.108:8091: NoViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Cannot move to 172.23.106.30:8091: ReplicaViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Can move to 172.23.106.171:8091: NoViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 2 (replica 2), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Can move to 172.23.105.122:8091: NoViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Cannot move to 172.23.97.108:8091: ReplicaViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Can move to 172.23.106.30:8091: NoViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Cannot move to 172.23.106.171:8091: ReplicaViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      --- Violations for index <idx7_6YCR6MMXR3_idxprefix 3 (replica 3), bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO> (mem 0, cpu 0) at node 172.23.97.109:8091 
      	Cannot move to 172.23.105.122:8091: ReplicaViolation (free mem 92.714M, free cpu -2.622018321185564)
      		 
      	Can move to 172.23.97.108:8091: NoViolation (free mem 1.67772e+07T, free cpu 0.8756095931591963)
      		 
      	Cannot move to 172.23.106.30:8091: ReplicaViolation (free mem 475.62M, free cpu -2.6716476614634352)
      		 
      	Can move to 172.23.106.171:8091: NoViolation (free mem 17.7485M, free cpu -2.1086756740774195)
      		 
      : Index:bucket5, wMwKEPtn8OaK9gX57lsDZR, ZccZirmO, idx7_6YCR6MMXR3_idxprefix

      Cbcollect logs:

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.105.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.106.171.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.106.30.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.96.198.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.96.230.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.96.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.97.100.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.97.108.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.97.109.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.97.66.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1696433943/collectinfo-2023-10-04T154741-ns_1%40172.23.97.67.zip

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pavan.pb Pavan PB
            pavan.pb Pavan PB
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty