Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7510

badarith when try to get bucket stats for node after upgrade: http://IP:8091/pools/default/buckets/BUCKET/nodes/IP:8091/stats

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.1
    • Fix Version/s: 2.0.1
    • Component/s: installer, ns_server
    • Security Level: Public
    • Labels:
      None

      Description

      upgrade 1.8.1 -> 2.0.1-120-rel
      http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
      /testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=1.8.1-942-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1

      upgrade 2.0.0-1978-rel -> 2.0.1-120-rel
      http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
      ./testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=2.0.0-1978-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1

      after upgrade we wait warmup, ep_queue_size 0 == 0 , ep_flusher_todo 0 == 0, check vb_active_curr_items and curr_items, verify all items and only then to verify that
      sum_of_curr_items == total_items we do:

      [2013-01-09 03:13:43,690] - [rebalance_helper:259] INFO - waiting for sum_of_curr_items == total_items....
      [2013-01-09 03:13:43,787] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.13:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
      [2013-01-09 03:13:43,788] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.13:8091
      [2013-01-09 03:13:43,836] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.14:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
      [2013-01-09 03:13:43,837] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.14:8091
      [2013-01-09 03:13:44,054] - [rebalance_helper:270] INFO - unable to retrieve stats for any node. returning true
      [2013-01-09 03:13:44,125] - [data_helper:289] INFO - creating direct client 10.3.3.14:11210 default
      2013-01-09 03:13:43.592 menelaus_web:19:warning:server error during request processing(ns_1@10.3.3.11) - Server error during processing: ["web request failed",

      {path, "/pools/default/buckets/default/nodes/10.3.3.13:8091/stats"}

      ,

      {type,error}

      ,

      {what, badarith}

      ,
      {trace,
      [

      {menelaus_stats, '-computed_stats_lazy_proplist/0-fun-8-', 2}

      ,

      {lists,zipwith,3}

      ,

      {menelaus_stats, '-samples_to_proplists/1-fun-3-',2}

      ,

      {lists,map,2}

      ,

      {menelaus_stats,samples_to_proplists,1}

      ,

      {menelaus_stats, build_buckets_stats_ops_response,4}

      ,

      {menelaus_stats, '-handle_bucket_node_stats/4-fun-0-',7}

      ,

      {menelaus_web_buckets, checking_bucket_access,4}

      ]}]

      1. fd5f9014-a888-4df5-913a-1ad6325d0fc4-10.3.3.11-diag.txt.gz
        268 kB
        Andrei Baranouski
      2. fd5f9014-a888-4df5-913a-1ad6325d0fc4-10.3.3.13-diag.txt.gz
        248 kB
        Andrei Baranouski
      3. fd5f9014-a888-4df5-913a-1ad6325d0fc4-10.3.3.14-diag.txt.gz
        244 kB
        Andrei Baranouski
      4. fd5f9014-a888-4df5-913a-1ad6325d0fc4-10.3.3.16-diag.txt.gz
        249 kB
        Andrei Baranouski
      5. test.log
        178 kB
        Andrei Baranouski
      No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

        Show
        Aliaksey Artamonau Aliaksey Artamonau added a comment - http://review.couchbase.org/23961
        Hide
        Aliaksey Artamonau Aliaksey Artamonau added a comment -

        merged

        Show
        Aliaksey Artamonau Aliaksey Artamonau added a comment - merged

          People

          • Assignee:
            Aliaksey Artamonau Aliaksey Artamonau
            Reporter:
            andreibaranouski Andrei Baranouski
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Gerrit Reviews

              There are no open Gerrit changes