Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-51788

ns server is going down after creating few collections.

    XMLWordPrintable

Details

    • Bug
    • Resolution: User Error
    • Test Blocker
    • None
    • 7.1.1
    • ns_server
    • 7.1.1-3015
    • Untriaged
    • 1
    • Unknown

    Description

      1. Create a 1 node cluster and create a bucket. Try creating some 50 collections.
      2. After 32(VolumeCollection0 - VolumeCollection32) collections created, the below error is seen in the logs:

      [chronicle:info,2022-04-11T09:19:34.093-07:00,ns_1@cb.local:chronicle_storage_writer<0.236.0>:chronicle_storage:create_log:268]Creating log file /opt/couchbase/var/lib/couchbase/config/chronicle/logs/1.log (high seqno = 100)

      =========================CRASH REPORT=========================
        crasher:
          initial call: chronicle_storage:'-spawn_writer/1-fun-0-'/0
          pid: <0.236.0>
          registered_name: chronicle_storage_writer
          exception exit: {create_log_failed,
                              "/opt/couchbase/var/lib/couchbase/config/chronicle/logs/1.log",
                              enoent}
            in function  chronicle_storage:create_log/4 (src/chronicle_storage.erl, line 275)
            in call from chronicle_storage:writer_handle_rollover/5 (src/chronicle_storage.erl, line 1545)
            in call from chronicle_storage:writer_loop/1 (src/chronicle_storage.erl, line 1471)
          ancestors: [chronicle_agent,chronicle_agent_sup,chronicle_sup,<0.225.0>]
          message_queue_len: 1
          messages: [{#Ref<0.724746664.1088421889.168579>,
                         {append,
                             {snapshot,100,<<"332095703f82032515c76feb5f598ee9">>,
                                 {2,'ns_1@cb.local'},
                                 {log_entry,<<"332095703f82032515c76feb5f598ee9">>,
                                     {2,'ns_1@cb.local'},
                                     21,
                                     {config,
                                         {<<"340a4f0e4dc0fa232835cd598ff48418">>,0,
                                          1},
                                         0,<<"48115e1f2a31b16b1a4e6ea4b59c3a6d">>,
                                         #{'ns_1@cb.local' =>
                                               #{id =>
                                                     <<"340a4f0e4dc0fa232835cd598ff48418">>,
                                                 role => voter}},
                                         undefined,
                                         #{chronicle_config_rsm =>
                                               {rsm_config,chronicle_config_rsm,[]},
                                           kv => {rsm_config,chronicle_kv,[]}},
                                         #{},undefined,
                                         [{<<"332095703f82032515c76feb5f598ee9">>,
                                           0}]}}}}}]
          links: [<0.235.0>]
          dictionary: []
          trap_exit: true
          status: running
          heap_size: 2586
          stack_size: 29
          reductions: 37275
        neighbours:
          neighbour:
            pid: <0.235.0>
            registered_name: chronicle_agent
            initial call: chronicle_agent:init/1
            current_function: {gen_statem,loop_receive,3}
            ancestors: [chronicle_agent_sup,chronicle_sup,<0.225.0>]
            message_queue_len: 0
            links: [<0.232.0>,<0.236.0>]
            trap_exit: false
            status: waiting
            heap_size: 4185
            stack_size: 11
            reductions: 105869
            current_stacktrace: [{gen_statem,loop_receive,3,
                                    [{file,"gen_statem.erl"},{line,1034}]},
                        {proc_lib,init_p_do_apply,3,
                                  [{file,"proc_lib.erl"},{line,226}]}]
      [chronicle:info,2022-04-11T09:19:34.095-07:00,ns_1@cb.local:chronicle_proposer<0.291.0>:chronicle_proposer:handle_down:1142]Observed agent {chronicle_agent,'ns_1@cb.local'} on peer 'ns_1@cb.local' go down with reason {create_log_failed,[47,111,112,116,47,99,111|...],enoent}
      [chronicle:error,2022-04-11T09:19:34.095-07:00,ns_1@cb.local:chronicle_proposer<0.291.0>:chronicle_proposer:handle_down:1147]Terminating proposer because local agent {chronicle_agent,'ns_1@cb.local'} terminated
      [error_logger:error,2022-04-11T09:19:34.095-07:00,ns_1@cb.local:chronicle_agent_sup<0.232.0>:ale_error_logger_handler:do_log:101]
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            ritesh.agarwal Ritesh Agarwal
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty