Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41535

[Collection-GSI]: Seeing IndexFailureException from Java client during collections based n1ql select operations

    XMLWordPrintable

Details

    Description

      Build: 7.0.0-3019

      Hitting IndexFailureException randomly during select operation on collections.

      com.couchbase.client.core.error.IndexFailureException: The server reported an issue with the underlying index {"completed":true,"coreId":"0x68de519b0000000d","errors":[{"additional":{"retry":true},"code":12008,"message":"Error performing bulk get operation  - cause: {2 errors, starting with bulkget exceeded MaxBulkRetries for travel-sample(vbid:956,keys:<ud>[route_15495]</ud>)}"}],"idempotent":false,"lastDispatchedFrom":"172.23.107.249:57006","lastDispatchedTo":"172.23.105.155:8093","requestId":40373,"requestType":"QueryRequest","retried":1,"retryReasons":["ENDPOINT_TEMPORARILY_NOT_AVAILABLE"],"service":{"operationId":"365d8b3d-a21f-42f0-b2b3-777a4ded79eb","statement":"\n        SELECT DISTINCT(sourceairport) as airport \n        FROM `travel-sample`.`airlines`.`routes` \n        ","type":"query"},"timeoutMs":75000,"timings":{"dispatchMicros":666259,"totalMicros":671585}}

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-39804 Query service returns Error performing bulk get operation

          • Critical - Crashes, loss of data, severe memory leak.
          • Open
          For Gerrit Dashboard: MB-41535
          # Subject Branch Project Status CR V
          143411,2 MB-41535: Adding retry logic to avoid test failure master TAF Status: MERGED +2 +1

          Activity

            Ascending order - Click to sort in descending order
            View 19 older comments
            ashwin.govindarajulu Ashwin Govindarajulu added a comment -

            Works fine from curl now. Not sure about the outcome immediately when the issue is seen.

            # curl http://172.23.123.103:8093/query/service -u Administrator:password -d 'statement=select * from `travel-sample` use keys "airport_1307"'
            		 
            {
            		 
            "requestID": "ba5d1eac-632a-4b8e-b01d-0f09ad761f8d",
            		 
            "signature": {"*":"*"},
            		 
            "results": [
            		 
            {"travel-sample":{"id":1307,"type":"airport","airportname":"Houssen","city":"Colmar","country":"France","faa":"CMR","icao":"LFGA","tz":"Europe/Paris","geo":{"lat":48.109853,"lon":7.359011,"alt":628.0}}}
            		 
            ],
            		 
            "status": "success",
            		 
            "metrics": {"elapsedTime": "2.500397ms","executionTime": "2.395794ms","resultCount": 1,"resultSize": 202,"serviceLoad": 6}
            		 
            }

            ashwin.govindarajulu Ashwin Govindarajulu added a comment - Works fine from curl now. Not sure about the outcome immediately when the issue is seen. # curl http://172.23.123.103:8093/query/service -u Administrator:password -d 'statement=select * from `travel-sample` use keys "airport_1307"' { "requestID": "ba5d1eac-632a-4b8e-b01d-0f09ad761f8d", "signature": {"*":"*"}, "results": [ {"travel-sample":{"id":1307,"type":"airport","airportname":"Houssen","city":"Colmar","country":"France","faa":"CMR","icao":"LFGA","tz":"Europe/Paris","geo":{"lat":48.109853,"lon":7.359011,"alt":628.0}}} ], "status": "success", "metrics": {"elapsedTime": "2.500397ms","executionTime": "2.395794ms","resultCount": 1,"resultSize": 202,"serviceLoad": 6} }
            marco.greco Marco Greco added a comment -

            Were you rebalancing or something? That error literally means - "I tried to get the document, KV said try later, I tried n more times but KV did not change response".

            marco.greco Marco Greco added a comment - Were you rebalancing or something? That error literally means - "I tried to get the document, KV said try later, I tried n more times but KV did not change response".
            ashwin.govindarajulu Ashwin Govindarajulu added a comment -

            No Marco Greco. This is test setUp phase and cluster is in steady state.

            ashwin.govindarajulu Ashwin Govindarajulu added a comment - No Marco Greco . This is test setUp phase and cluster is in steady state.
            marco.greco Marco Greco added a comment -

            This is still a duplicate of MB-39804

            marco.greco Marco Greco added a comment - This is still a duplicate of MB-39804
            ashwin.govindarajulu Ashwin Govindarajulu added a comment -

            Closing since this is a duplicate. Will validate once the original ticket gets fixed.

            ashwin.govindarajulu Ashwin Govindarajulu added a comment - Closing since this is a duplicate. Will validate once the original ticket gets fixed.

            People

              marco.greco Marco Greco
              ashwin.govindarajulu Ashwin Govindarajulu
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty