Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50557

Indexing.log covers less than 24hours

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Problem
      The indexer log on node 172.23.96.251 only covers 22 hours. Marking this as critical because it limits the ability to debug problems.

      % head -n5 ns_server.indexer.log
      ==============================================================================
      couchbase logs (indexer.log)
      cbbrowse_logs indexer.log
      ==============================================================================
      2022-01-20T17:11:43.774-08:00 [Info] MutationStreamReader::updateSnapInFilter Huge Snapshot Received for bucket7 186 MAINT_STREAM 0-112967
      % tail -n1 ns_server.indexer.log
      2022-01-21T15:07:04.426-08:00 [Info] serviceChangeNotifier: received PoolChangeNotification
      % du -sh ns_server.indexer.log
      412M    ns_server.indexer.log
      

      These logs are from the QE longevity, there is a lot going on in the cluster.

      Expectation
      For the logs to cover ideally 5 days (long weekend). At the very least give the late stage in Neo the logs need to cover 24 hours.

      Logs
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.104.155.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.104.67.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.104.69.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.104.70.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.105.107.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.105.111.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.105.168.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.106.100.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.108.103.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.120.107.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.120.245.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.121.117.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.123.28.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.96.148.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.96.251.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.96.252.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.96.253.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.97.121.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.97.122.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.97.239.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.98.135.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.99.11.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.99.20.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.99.21.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1642806235/collectinfo-2022-01-21T230358-ns_1%40172.23.99.25.zip

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              mihir.kamdar Mihir Kamdar (Inactive)
              pvarley Patrick Varley (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty