Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48783

Offline upgrade from 7.0.0 or 7.0.1 on debian and ubuntu package install corrupts config files

    XMLWordPrintable

Details

    • Untriaged
    • Ubuntu 64-bit
    • 1
    • Yes
    • Build Team 2021 Sprint 20

    Description

      Problem
      When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (https://forums.couchbase.com/t/couchbase-upgrade-issues-from-7-0-0-to-7-0-1/31867/2).

      Steps to reproduce
      1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
      2. Create the travel-sample bucket
      3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

      What happens:

      Upgrade is marked as successful in the CLI but the admin console does not come up

      What is expected to happen:

      Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

      Logs:
      This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

      Appendix
      QE has validated that this issue is not observed in all other supported platforms (Centos 7/8, Rhel 7/8, Suse 12/15, Oel 7/8, Amazon Linux 2 and Windows). It is only observed in deb installs in QE testing (Debian 10/11, Ubuntu 18/20).

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            thuan Thuan Nguyen created issue -
            thuan Thuan Nguyen made changes -
            meni.hillel Meni Hillel (Inactive) made changes -
            Assignee Meni Hillel [ JIRAUSER25407 ] Bryan McCoid [ JIRAUSER25453 ]
            thuan Thuan Nguyen made changes -
            Summary [Upgrade] Erlang crashed in ubuntu 18.04 when upgrade from 6.5.1 -> 7.0.0 -> 7.0.1 [Upgrade][Ubuntu 18.04] Erlang crashed in ubuntu 18.04 when upgrade from 6.5.1 -> 7.0.0 -> 7.0.1
            thuan Thuan Nguyen made changes -
            Summary [Upgrade][Ubuntu 18.04] Erlang crashed in ubuntu 18.04 when upgrade from 6.5.1 -> 7.0.0 -> 7.0.1 [Upgrade] Erlang crashed in ubuntu 18.04 when upgrade from 6.5.1 -> 7.0.0 -> 7.0.1
            bryan.mccoid Bryan McCoid made changes -
            Assignee Bryan McCoid [ JIRAUSER25453 ] Thuan Nguyen [ thuan ]
            thuan Thuan Nguyen made changes -
            Assignee Thuan Nguyen [ thuan ] Bryan McCoid [ JIRAUSER25453 ]
            thuan Thuan Nguyen made changes -
            thuan Thuan Nguyen made changes -
            Attachment node_down_upgrade.zip [ 162908 ]
            bryan.mccoid Bryan McCoid made changes -
            Attachment image-2021-10-06-18-03-19-099.png [ 162926 ]
            thuan Thuan Nguyen made changes -
            Description Create 2 nodes cluster 6.5.1 in Ubuntu 18.04 in AWS.
            Create travel-sample bucket.
            Upgrade cluster to 7.0.0 using offline upgrade. Upgrade passed. UI is up and running ok.
            Upgrade again this cluster to 7.0.1 using offline upgrade. Upgrade successfull in command line but failed to start UI.

            http://ec2-54-189-144-232.us-west-2.compute.amazonaws.com:8091/ui/index.html#/servers/list?commonBucket=travel-sample&scenarioZoom=minute&scenario=vfkz40slg

            Tested in centos 7.7 in AWS. After upgrade to 7.0.1, UI on both nodes are up as expected.
            Create 2 nodes cluster 6.5.1 in Ubuntu 18.04 in AWS.
            Create travel-sample bucket.
            Upgrade cluster to 7.0.0 using offline upgrade. Upgrade passed. UI is up and running ok.
            Upgrade again this cluster to 7.0.1 using offline upgrade. Upgrade successfull in command line but failed to start UI.

            http://ec2-54-189-144-232.us-west-2.compute.amazonaws.com:8091/ui/index.html#/servers/list?commonBucket=travel-sample&scenarioZoom=minute&scenario=vfkz40slg

            I tried to test in other operating system like centos 7.7 in AWS. I could not reproduce this issue in centos 7.7. After upgrade to 7.0.1, UI on both nodes are up as expected. So this issue may be on ubuntu 18.04 only.
            bryan.mccoid Bryan McCoid made changes -
            Attachment image-2021-10-07-12-48-55-553.png [ 163156 ]
            raju Raju Suravarjjala made changes -
            Fix Version/s 7.0.2 [ 18012 ]
            bryan.mccoid Bryan McCoid made changes -
            Attachment image-2021-10-07-13-46-41-040.png [ 163168 ]
            bryan.mccoid Bryan McCoid made changes -
            Attachment image-2021-10-06-18-03-19-099.png [ 162926 ]
            Aliaksey Artamonau Aliaksey Artamonau (Inactive) made changes -
            Assignee Bryan McCoid [ JIRAUSER25453 ] Chris Hillery [ ceej ]
            Aliaksey Artamonau Aliaksey Artamonau (Inactive) made changes -
            Component/s build [ 10200 ]
            Component/s ns_server [ 10019 ]
            ceej Chris Hillery made changes -
            Assignee Chris Hillery [ ceej ] Aliaksey Artamonau [ aliaksey artamonau ]
            ceej Chris Hillery made changes -
            Remote Link This issue links to "Page (Couchbase, Inc. Wiki)" [ 23262 ]
            ceej Chris Hillery made changes -
            Comment [ Is "chronicle" only used in clusters with more than one node? ]
            ceej Chris Hillery made changes -
            Assignee Aliaksey Artamonau [ aliaksey artamonau ] Chris Hillery [ ceej ]
            ceej Chris Hillery made changes -
            Sprint Build Team 2021 Sprint 20 [ 1788 ]
            ceej Chris Hillery made changes -
            Component/s installer [ 10221 ]
            Component/s tools [ 10223 ]
            Component/s build [ 10200 ]
            ceej Chris Hillery made changes -
            Worklog Id 15238 [ 15238 ]
            Remaining Estimate 0h [ 0 ]
            Time Spent 3h [ 10800 ]
            wayne Wayne Siu made changes -
            Link This issue blocks MB-46308 [ MB-46308 ]
            wayne Wayne Siu made changes -
            Labels upgrade approved-for-7.0.2 upgrade
            ceej Chris Hillery made changes -
            Assignee Chris Hillery [ ceej ] Thuan Nguyen [ thuan ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            ceej Chris Hillery made changes -
            Labels approved-for-7.0.2 upgrade approved-for-7.0.2 releasenote upgrade
            dhaikney David Haikney made changes -
            Link This issue relates to CBSP-3934 [ CBSP-3934 ]
            lynn.straus Lynn Straus made changes -
            Summary [Upgrade] Erlang crashed in ubuntu 18.04 when upgrade from 6.5.1 -> 7.0.0 -> 7.0.1 [Upgrade] Offline Upgrade corrupts cluster config on ubuntu & debian 7.0.0 -> 7.0.x and 7.0.1 ->7.0.x
            lynn.straus Lynn Straus made changes -
            Link This issue is triggering FEWD-6045 [ FEWD-6045 ]
            lynn.straus Lynn Straus made changes -
            Link This issue is triggering FEWD-6046 [ FEWD-6046 ]
            lynn.straus Lynn Straus made changes -
            Link This issue is triggering MB-48828 [ MB-48828 ]
            lynn.straus Lynn Straus made changes -
            Link This issue is triggering K8S-2462 [ K8S-2462 ]
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Summary [Upgrade] Offline Upgrade corrupts cluster config on ubuntu & debian 7.0.0 -> 7.0.x and 7.0.1 ->7.0.x Offline upgrade on debian package installs corrupts config files
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Summary Offline upgrade on debian package installs corrupts config files Offline upgrade from 7.0.0 or 7.0.1 on debian and ubuntu package installs corrupts config files
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Affects Version/s 7.0.0 [ 17233 ]
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Environment Ubuntu 18.04 in AWS Ubuntu 18.04
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Description Create 2 nodes cluster 6.5.1 in Ubuntu 18.04 in AWS.
            Create travel-sample bucket.
            Upgrade cluster to 7.0.0 using offline upgrade. Upgrade passed. UI is up and running ok.
            Upgrade again this cluster to 7.0.1 using offline upgrade. Upgrade successfull in command line but failed to start UI.

            http://ec2-54-189-144-232.us-west-2.compute.amazonaws.com:8091/ui/index.html#/servers/list?commonBucket=travel-sample&scenarioZoom=minute&scenario=vfkz40slg

            I tried to test in other operating system like centos 7.7 in AWS. I could not reproduce this issue in centos 7.7. After upgrade to 7.0.1, UI on both nodes are up as expected. So this issue may be on ubuntu 18.04 only.
            +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229

            +Steps to reproduce+
            1. Create a 2 node cluster on 7.0.0 or 7.0.1 in Ubuntu 18.04
            Create travel-sample bucket.
            Upgrade cluster to 7.0.0 using offline upgrade. Upgrade passed. UI is up and running ok.
            Upgrade again this cluster to 7.0.1 using offline upgrade. Upgrade successfull in command line but failed to start UI.

            http://ec2-54-189-144-232.us-west-2.compute.amazonaws.com:8091/ui/index.html#/servers/list?commonBucket=travel-sample&scenarioZoom=minute&scenario=vfkz40slg

            I tried to test in other operating system like centos 7.7 in AWS. I could not reproduce this issue in centos 7.7. After upgrade to 7.0.1, UI on both nodes are up as expected. So this issue may be on ubuntu 18.04 only.
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Description +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229

            +Steps to reproduce+
            1. Create a 2 node cluster on 7.0.0 or 7.0.1 in Ubuntu 18.04
            Create travel-sample bucket.
            Upgrade cluster to 7.0.0 using offline upgrade. Upgrade passed. UI is up and running ok.
            Upgrade again this cluster to 7.0.1 using offline upgrade. Upgrade successfull in command line but failed to start UI.

            http://ec2-54-189-144-232.us-west-2.compute.amazonaws.com:8091/ui/index.html#/servers/list?commonBucket=travel-sample&scenarioZoom=minute&scenario=vfkz40slg

            I tried to test in other operating system like centos 7.7 in AWS. I could not reproduce this issue in centos 7.7. After upgrade to 7.0.1, UI on both nodes are up as expected. So this issue may be on ubuntu 18.04 only.
            +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (

            +Steps to reproduce+
            1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
            2. Create the travel-sample bucket
            3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

            +What happens:+

            Upgrade is marked as successful in the CLI but the admin console does not come up

            +What is expected to happen:+

            Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

            +Logs:+
            This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

            +Appendix+
            QE has been able to confirm that this issue is not observed in centos 7. We are validating all other supported platforms currently.
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Description +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (

            +Steps to reproduce+
            1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
            2. Create the travel-sample bucket
            3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

            +What happens:+

            Upgrade is marked as successful in the CLI but the admin console does not come up

            +What is expected to happen:+

            Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

            +Logs:+
            This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

            +Appendix+
            QE has been able to confirm that this issue is not observed in centos 7. We are validating all other supported platforms currently.
            +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (https://forums.couchbase.com/t/couchbase-upgrade-issues-from-7-0-0-to-7-0-1/31867/2).

            +Steps to reproduce+
            1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
            2. Create the travel-sample bucket
            3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

            +What happens:+

            Upgrade is marked as successful in the CLI but the admin console does not come up

            +What is expected to happen:+

            Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

            +Logs:+
            This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

            +Appendix+
            QE has been able to confirm that this issue is not observed in centos 7. We are validating all other supported platforms currently.
            raju Raju Suravarjjala made changes -
            Summary Offline upgrade from 7.0.0 or 7.0.1 on debian and ubuntu package installs corrupts config files Offline upgrade from 7.0.0 or 7.0.1 on debian and ubuntu package install corrupts config files
            owend Daniel Owen made changes -
            Component/s tools [ 10223 ]
            arunkumar Arunkumar Senthilnathan (Inactive) made changes -
            Description +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (https://forums.couchbase.com/t/couchbase-upgrade-issues-from-7-0-0-to-7-0-1/31867/2).

            +Steps to reproduce+
            1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
            2. Create the travel-sample bucket
            3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

            +What happens:+

            Upgrade is marked as successful in the CLI but the admin console does not come up

            +What is expected to happen:+

            Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

            +Logs:+
            This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

            +Appendix+
            QE has been able to confirm that this issue is not observed in centos 7. We are validating all other supported platforms currently.
            +Problem+
            When an offline upgrade is performed on a debian or ubuntu package install of 7.0.0 or 7.0.1, the chronicle directory gets erased due to an issue in the installer. This regression was introduced due to the fix made for MB-44229. This issue was originally reported by a forum user (https://forums.couchbase.com/t/couchbase-upgrade-issues-from-7-0-0-to-7-0-1/31867/2).

            +Steps to reproduce+
            1. Create a 2 node Ubuntu 18.04 cluster on 7.0.0 or 7.0.1
            2. Create the travel-sample bucket
            3. Offline upgrade cluster to 7.0.1 (steps can be found here: https://docs.couchbase.com/server/current/install/upgrade-cluster-offline.html)

            +What happens:+

            Upgrade is marked as successful in the CLI but the admin console does not come up

            +What is expected to happen:+

            Upgrade goes through fine and we are able to access the admin console. All the data remains intact.

            +Logs:+
            This issue was originally reproduced on an AWS instance. Logs to which have been attached to the ticket.

            +Appendix+
            QE has validated that this issue is not observed in all other supported platforms (Centos 7/8, Rhel 7/8, Suse 12/15, Oel 7/8, Amazon Linux 2 and Windows). It is only observed in deb installs in QE testing (Debian 10/11, Ubuntu 18/20).
            thuan Thuan Nguyen made changes -
            Attachment ss 2021-10-11 at 11.38.54 AM.png [ 163539 ]
            thuan Thuan Nguyen made changes -
            Attachment ss 2021-10-11 at 11.38.54 AM-1.png [ 163549 ]
            Attachment ss 2021-10-11 at 11.52.43 AM.png [ 163550 ]
            thuan Thuan Nguyen made changes -
            Attachment ss 2021-10-11 at 11.38.54 AM.png [ 163539 ]
            thuan Thuan Nguyen made changes -
            Attachment ss 2021-10-11 at 12.12.58 PM.png [ 163554 ]
            thuan Thuan Nguyen made changes -
            Sprint Status Current Sprint [ 10027 ]
            Status Resolved [ 5 ] Closed [ 6 ]
            ceej Chris Hillery made changes -
            Remote Link This issue links to "Page (Couchbase, Inc. Wiki)" [ 23278 ]
            malarky Chris Malarky made changes -
            Link This issue relates to CBSP-3952 [ CBSP-3952 ]
            tony.hillman Tony Hillman made changes -
            Link This issue relates to DOC-9298 [ DOC-9298 ]

            People

              thuan Thuan Nguyen
              thuan Thuan Nguyen
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h
                  3h

                  Gerrit Reviews

                    There are no open Gerrit changes

                    PagerDuty