Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58810

Monitor: Few n1ql queries are unambiguously timed out while streaming/receiving rows during incremental index building + scans

    XMLWordPrintable

Details

    • 0

    Description

      1. Create a 3 KV node, 2 GSI, 2 N1QL node cluster.
      2. Create bucket, load data, start queries asynchronously. Start KV workload(Reads: 80%, 20% Expiry)
      3. Scale up the cluster by 1KV, 1 GSI, 1 N1QL node.
      4. During the KV rebalancing few queries are seeing:

        com.couchbase.client.core.error.UnambiguousTimeoutException: Query timed out while streaming/receiving rows {"completed":true,"coreId":"0x8ab26ede00000002","errors":[{"code":1080,"message":"Timeout 1m15s exceeded","retry":true}],"httpStatus":200,"idempotent":false,"lastDispatchedFrom":"172.31.29.8:41622","lastDispatchedTo":"svc-q-node-004.mkb6whgtakzdm6qq.sandbox.nonprod-project-avengers.com:18093","requestId":207487219,"requestType":"QueryRequest","retried":0,"service":{"bucket":"default0","operationId":"query_thread_default043803","scope":"_default","statement":"select meta().id from VolumeCollection0 where country is not null and `type` is not null and (any r in reviews satisfies r.ratings.`Check in / front desk` is not null end) limit 100","type":"query"},"timeoutMs":75000,"timings":{"dispatchMicros":75003182,"totalDispatchMicros":75003182,"totalMicros":75003678}}
        

      Attachments

        1. aggregated_memory_stats.png
          aggregated_memory_stats.png
          283 kB
        2. default0_idx_VolumeCollection0_0_resident_ratio_node06_01.png
          default0_idx_VolumeCollection0_0_resident_ratio_node06_01.png
          453 kB
        3. default0_idx_VolumeCollection0_0_resident_ratio_node06_02.png
          default0_idx_VolumeCollection0_0_resident_ratio_node06_02.png
          258 kB
        4. HeapInUse_HeapAlloc.png
          HeapInUse_HeapAlloc.png
          139 kB
        5. image.png
          image.png
          71 kB
        6. index_avg_resident_ratio.png
          index_avg_resident_ratio.png
          130 kB
        7. memory_stats.png
          memory_stats.png
          154 kB
        8. memprofile.png
          memprofile.png
          584 kB
        9. plasma_current_quota.png
          plasma_current_quota.png
          51 kB
        10. rate_num_rows_returned.png
          rate_num_rows_returned.png
          93 kB
        11. rate_of_mallocs.png
          rate_of_mallocs.png
          108 kB
        12. total_req_returned_scanned.png
          total_req_returned_scanned.png
          123 kB
        13. total_requests_total_rows_returned.png
          total_requests_total_rows_returned.png
          71 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sai.teja Sai Krishna Teja
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty