Uploaded image for project: 'Couchbase Java Client'
  1. Couchbase Java Client
  2. JCBC-267

Memcached bucket still fails with all workloads

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.6
    • Component/s: None
    • Security Level: Public
    • Labels:
      None

      Description

      Attaching all the tests ran against memcached buckets.

      1) Basic tests - the gets fail, whereas the sets pass.

      2) Failover and readd - Here there are many assertion errors with the I/O being problematic

      3) Rebalance - Here there are many assertion errors with the I/O being problematic

      In 2nd and 3rd cases, the probable cause may be the following -

      [SDKD(WARNING) 268.72 cbsdk.sdkd.local executor.py:66] Exception in thread "Memcached IO over

      {MemcachedConnection to /10.3.121.212:11210 /10.3.121.208:11210}

      " java.lang.AssertionError: Attempting to overwrite channel
      [SDKD(WARNING) 268.72 cbsdk.sdkd.local executor.py:66] at net.spy.memcached.protocol.TCPMemcachedNodeImpl.setChannel(TCPMemcachedNodeImpl.java:496)

      4) Failover - Here there are failures in the rebalance phase, bt the rebound phase breaks in SDKD. Another SDKD issue is filed to take care of the same.

      We also need to investigate the SDKD code. There might be something wrong there in handling the memcached buckets. But, till now the issue looks more likely to be with the java sdk.

      1. assertion_error_mem_bkt.log
        98 kB
        Deepti Dawar
      2. mem_bkt_base_raw_1.1.4.log
        32 kB
        Deepti Dawar
      3. mem_bkt_failover_1.1.6_server1.8.1_working_fyn.log
        8 kB
        Deepti Dawar
      4. mem_bkt_failover_1.1.6_server2.0.1_working_fyn.log
        10 kB
        Deepti Dawar
      5. mem_bkt_faiover_1.1.6.log
        18 kB
        Deepti Dawar
      6. mem_bkt_latest_run_1.1.4.log
        38 kB
        Deepti Dawar
      7. mem_bkt_readd_1.1.6_server1.8.1_working_fyn.log
        10 kB
        Deepti Dawar
      8. mem_bkt_readd_1.1.6_server2.0.1_working_fyn.log
        12 kB
        Deepti Dawar
      9. mem_bkt_readd_1.1.6.log
        16 kB
        Deepti Dawar
      10. mem_bkt_rebalance_1.1.6_server1.8.1_working_fyn.log
        9 kB
        Deepti Dawar
      11. mem_bkt_rebalance_1.1.6_server2.0.1_working_fyn.log
        9 kB
        Deepti Dawar
      12. mem_bkt_rebalance_1.1.6.log
        16 kB
        Deepti Dawar
      13. memcached_bucket_basic_json.log
        26 kB
        Deepti Dawar
      14. memcached_bucket_basic.log
        7 kB
        Deepti Dawar
      15. memcached_bucket_failover.log
        28 kB
        Deepti Dawar
      16. memcached_bucket_readd.log
        68 kB
        Deepti Dawar
      17. memcached_bucket_rebalance.log
        68 kB
        Deepti Dawar
      18. test_run.tar.gz
        18 kB
        Deepti Dawar

        Issue Links

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          Hide
          deeptida Deepti Dawar added a comment - - edited

          Alright Michael.

          I think we are good with the fix for the scenarios of basic test and the test with failover and readd.
          There are no assertion errors for these two cases now.

          But in the case of failover and rebalance tests there are still errors existing.

          Please find the zip file for all the runs.

          I'll tell Saran to get back to customer with the latest build 1.1.4 and verify.

          Thanks !

          Show
          deeptida Deepti Dawar added a comment - - edited Alright Michael. I think we are good with the fix for the scenarios of basic test and the test with failover and readd. There are no assertion errors for these two cases now. But in the case of failover and rebalance tests there are still errors existing. Please find the zip file for all the runs. I'll tell Saran to get back to customer with the latest build 1.1.4 and verify. Thanks !
          Hide
          daschl Michael Nitschinger added a comment -

          Whats the status on this?

          Show
          daschl Michael Nitschinger added a comment - Whats the status on this?
          Hide
          deeptida Deepti Dawar added a comment -

          As already stated, the failover and the rebalance cause an issue still.

          You can have a look at the logs in the attached zip file.

          Show
          deeptida Deepti Dawar added a comment - As already stated, the failover and the rebalance cause an issue still. You can have a look at the logs in the attached zip file.
          Hide
          deeptida Deepti Dawar added a comment -

          There is a marked improvement in these scenarios. But the tests are failing still. Please have a look at the latest attachments from the cbc version 1.1.6.

          Show
          deeptida Deepti Dawar added a comment - There is a marked improvement in these scenarios. But the tests are failing still. Please have a look at the latest attachments from the cbc version 1.1.6.
          Hide
          deeptida Deepti Dawar added a comment -

          Tested with the latest version of the client i.e. 1.16.
          All the scenarios are passing. Hence, closing the issue.

          Show
          deeptida Deepti Dawar added a comment - Tested with the latest version of the client i.e. 1.16. All the scenarios are passing. Hence, closing the issue.

            People

            • Assignee:
              deeptida Deepti Dawar
              Reporter:
              deeptida Deepti Dawar
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Gerrit Reviews

                There are no open Gerrit changes