Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7770

[RN 2.0.2] 2.0.0 to 2.0.1 upgrade didn't replace couchdb's file2.beam with latest version (was: [centos 32] views are broken after upgrade 2.0.0->2.0.1)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 2.1.0
    • 2.0.1
    • installer
    • Security Level: Public
    • None
    • build 2.0.1-160-rel
    • Release Note

    Description

      http://qa.hq.northscale.net/job/centos-32-2.0-upgrade/32/consoleFull
      ./testrunner -i /tmp/upgrade.ini -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=2.0.0-1976-rel,ddocs-num=2,upgrade_version=2.0.1-160-rel

      steps:
      1. cluster with 2*2.0.0-1976 nodes
      2. default bucket with 2*2 views
      3. after offline( the same is for online tests as well)

      [2013-02-18 09:22:36,045] - [rest_client:329] INFO - index query url: http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view0?connectionTimeout=60000
      [2013-02-18 09:22:36,191] - [rest_client:329] INFO - index query url: http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view1?connectionTimeout=60000
      [2013-02-18 09:22:36,249] - [rest_client:329] INFO - index query url: http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view0?connectionTimeout=60000
      [2013-02-18 09:22:36,324] - [task:1323] INFO - (1000 rows) expected, (0 rows) returned
      [2013-02-18 09:22:36,354] - [rest_client:329] INFO - index query url: http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view1?connectionTimeout=60000
      [2013-02-18 09:22:36,385] - [task:1323] INFO - (1000 rows) expected, (0 rows) returned

      perform manually:

      andrey@baranouski:~/repository/testrunner$ curl -X GET http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view1?stale=False
      {"total_rows":0,"rows":[
      ],
      "errors":[

      {"from":"local","reason":"undef"}

      ,

      {"from":"http://10.1.4.14:8092/_view_merge/?stale=false","reason":"undef"}

      ]
      }
      andrey@baranouski:~/repository/testrunner$ curl -X GET http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view1?stale=update_after

      {"total_rows":0,"rows":[ ] }

      andrey@baranouski:~/repository/testrunner$ curl -X GET http://10.1.4.24:8092/default/_design/upgrade-test-view0/_view/upgrade-test-view1?stale=update_after

      {"total_rows":0,"rows":[ ] }

      andrey@baranouski:~/repository/testrunner$ python scripts/ssh.py -i centos-32-2.0-upgrade.ini "ls -la /opt/couchbase/var/lib/couchbase/data/@indexes/default"
      10.1.4.14
      total 32
      drwxr-xr-x 2 couchbase couchbase 4096 Feb 19 01:54 .
      drwxr-xr-x 3 couchbase couchbase 4096 Feb 19 01:53 ..
      rw-rr- 1 couchbase couchbase 10531 Feb 19 01:53 main_d3bab589b07b8f398f39483b2e415d07.view.1
      rw-rr- 1 couchbase couchbase 10540 Feb 19 01:53 replica_d3bab589b07b8f398f39483b2e415d07.view.1

      10.1.4.24
      total 32
      drwxr-xr-x 2 couchbase couchbase 4096 Feb 19 01:54 .
      drwxr-xr-x 3 couchbase couchbase 4096 Feb 19 01:53 ..
      rw-rr- 1 couchbase couchbase 10545 Feb 19 01:53 main_d3bab589b07b8f398f39483b2e415d07.view.1
      rw-rr- 1 couchbase couchbase 10528 Feb 19 01:53 replica_d3bab589b07b8f398f39483b2e415d07.view.1

      from server logs:

      [ns_server:debug,2013-02-19T3:28:03.690,ns_1@10.1.4.24:<0.29104.0>:compaction_daemon:bucket_needs_compaction:966]`default` data size is 95325, disk size is 16840750
      [ns_server:debug,2013-02-19T3:28:03.691,ns_1@10.1.4.24:<0.29106.0>:compaction_daemon:view_needs_compaction:1123]`default/_design/upgrade-test-view1/main` data_size is 0, disk_size is 10545
      [ns_server:debug,2013-02-19T3:28:03.691,ns_1@10.1.4.24:<0.29107.0>:compaction_daemon:view_needs_compaction:1123]`default/_design/upgrade-test-view1/replica` data_size is 0, disk_size is 10528
      [ns_server:debug,2013-02-19T3:28:03.691,ns_1@10.1.4.24:<0.29109.0>:compaction_daemon:view_needs_compaction:1123]`default/_design/upgrade-test-view0/main` data_size is 0, disk_size is 10545
      [ns_server:debug,2013-02-19T3:28:03.691,ns_1@10.1.4.24:<0.29110.0>:compaction_daemon:view_needs_compaction:1123]`default/_design/upgrade-test-view0/replica` data_size is 0, disk_size is 10528
      [ns_server:debug,2013-02-19T3:28:03.691,ns_1@10.1.4.24:compaction_daemon<0.6699.0>:compaction_daemon:handle_info:457]Finished compaction iteration.
      [ns_server:debug,2013-02-19T3:28:03.692,ns_1@10.1.4.24:compaction_daemon<0.6699.0>:compaction_daemon:schedule_next_compaction:1442]Finished compaction too soon. Next run will be in 30s
      [couchdb:error,2013-02-19T3:28:20.929,ns_1@10.1.4.24:<0.29182.0>:couch_log:error:42]Set view `default`, main group `_design/upgrade-test-view1`, writer error
      error: undef
      stacktrace: [

      {file2,ensure_dir, ["/opt/couchbase/var/lib/couchbase/data/@indexes/default/tmp_d3bab589b07b8f398f39483b2e415d07_main/e9e434b58f3fac3310504249a00254f9.sort"]}

      ,

      {couch_set_view_util,do_new_sort_file_path,2},
      {couch_set_view_updater,'-maybe_flush_merge_buffers/2-fun-1-',7},
      {lists,foldl,3},
      {couch_set_view_updater,flush_writes,1},
      {couch_set_view_updater,'-update/8-fun-1-',15}]

      [couchdb:error,2013-02-19T3:28:20.929,ns_1@10.1.4.24:<0.6720.0>:couch_log:error:42]Set view `default`, main group `_design/upgrade-test-view1`, received error from updater: undef
      [couchdb:error,2013-02-19T3:28:23.505,ns_1@10.1.4.24:<0.29209.0>:couch_log:error:42]Set view `default`, main group `_design/upgrade-test-view1`, writer error
      error: undef
      stacktrace: [{file2,ensure_dir, ["/opt/couchbase/var/lib/couchbase/data/@indexes/default/tmp_d3bab589b07b8f398f39483b2e415d07_main/e9e434b58f3fac3310504249a0025544.sort"]},
      {couch_set_view_util,do_new_sort_file_path,2}

      ,

      {couch_set_view_updater,'-maybe_flush_merge_buffers/2-fun-1-',7}

      ,

      {lists,foldl,3}

      ,

      {couch_set_view_updater,flush_writes,1}

      ,

      {couch_set_view_updater,'-update/8-fun-1-',15}

      ]

      [couchdb:error,2013-02-19T3:28:23.506,ns_1@10.1.4.24:<0.6720.0>:couch_log:error:42]Set view `default`, main group `_design/upgrade-test-view1`, received error from updater: undef

      Attachments

        1. 10.1.4.14-2192013-1441-diag.zip
          1.52 MB
        2. 10.1.4.24-2192013-1439-diag.zip
          1.62 MB
        3. index_upgrade_centos32_1.png
          index_upgrade_centos32_1.png
          98 kB
        4. index_upgrade_centos32.png
          index_upgrade_centos32.png
          57 kB
        5. test.log
          91 kB
        For Gerrit Dashboard: MB-7770
        # Subject Branch Project Status CR V

        Activity

          People

            andreibaranouski Andrei Baranouski
            andreibaranouski Andrei Baranouski
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty