Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-8687

Server failed, data corrupted and view intermittent

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • 2.2.0
    • 2.0.1
    • ns_server, view-engine
    • Security Level: Public
    • Cluster has three machines, all have 3.1GHz processors and 8GB RAM. Two of them have 1TB HDDs and Ubuntu 12.04.2 LTS and the other one has 500GB HDD and Debian 6.0.7.

      Couchbase 2.0.1 is installed, community version

    Description

      One of the Ubuntu servers auto-failover-ed tonight and although it came back up, we had some downtime reported on the website that uses it (so we still noticed a problem which we shouldn't have done as it should handle it shouldn't it?) and (at least) one of the documents was corrupted. This particular document is stored in bzcompress() format (via PHP) and is a relatively core piece of data to the website that uses it, so this had to be rebuilt. Fortunately it was only cached data rather than actual data but this is very concerning for me as I'm trying to move away from MySQL at the moment and rely solely on Couchbase but I can't have that data corrupted.

      We also have some view queries ran on page load to retrieve certain things that are critical and whilst the rebalance was taking place the results of the view queries were intermittent to say the list. All queries were "stale=false" so it was trying to build the index each time, however according to the documentation it's supposed to handle this too.

      I'm also unsure as to why the server failed in the first place as there doesn't look to have been anything wrong with the actual server.

      I've ran the cbcollect_info and I've attached it. Any advice and/or recommendations on preventing this from happening again in the future is greatly received!

      Will delete the zip from the server when someone can confirm it's ok to do so.

      Thanks,

      Graeme

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sundar Sundar Sridharan (Inactive)
            glambert Graeme Lambert
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty