Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44446

[System Test][ERRO] manager: could not open pindex: PINDEX_META: no such file or directory

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.1.0
    • Cheshire-Cat
    • fts
    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.0.0-4476
      Componet Clusterops test: -test tests/fts/cheshire-cat/test_fts_clusterops_cheshire_cat_coll_crud.yml -scope tests/fts/cheshire-cat/scope_fts_cheshire_cat.yml
      Test Cycle: 1

      Test with Index create/drop loop

      Seeing the below error message for one of the index on node 172.23.107.5 when rebalance out of kv node 172.23.97.232 happening:

      fts.log.1:2021-02-18T12:12:43.915-08:00 [ERRO] manager: could not open pindex path: /data/@fts/bucket_bucket2_idx_vkmvt-type-public_likes-free_parking-Overall_43bbac4a723c7fa7_61a9188b.pindex, err: pindex: could not load PINDEX_META_FILENAME, path: /data/@fts/bucket_bucket2_idx_vkmvt-type-public_likes-free_parking-Overall_43bbac4a723c7fa7_61a9188b.pindex, err: open /data/@fts/bucket_bucket2_idx_vkmvt-type-public_likes-free_parking-Overall_43bbac4a723c7fa7_61a9188b.pindex/PINDEX_META: no such file or directory -- cbgt.(*Manager).LoadDataDir.func1() at manager.go:605

      Before rebalance out, fts was killed on this node : 172.23.107.5 and waited for 15 mins for it to come back and recover.

      Test step:

      [2021-02-18T11:17:46-08:00, vijayviji/sshpass:886f18] sshpass -p couchbase ssh -o StrictHostKeyChecking=no root@172.23.107.5 kill -SIGKILL $(pgrep cbft)
      		 
      [pull] sequoiatools/cmd
      		 
      [2021-02-18T11:17:51-08:00, sequoiatools/cmd:fcca54] 900
      		 
      [pull] sequoiatools/couchbase-cli:7.0
      		 
      [2021-02-18T11:32:59-08:00, sequoiatools/couchbase-cli:7.0:e5b3a7] rebalance -c 172.23.97.215:8091 --server-remove 172.23.97.232 -u Administrator -p password

      cbcollect logs:

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.107.2.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.107.3.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.107.4.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.107.5.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.215.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.216.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.217.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.227.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.232.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.235.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.236.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1613678484/collectinfo-2021-02-18T200126-ns_1%40172.23.97.237.zip

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-45375 CBGT loadDataDir and janitor operations overlap

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MB-44631 [System Test][ERRO]manager: could not open pindex path:err: cannot open index, metadata missing

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              girish.benakappa Girish Benakappa
              girish.benakappa Girish Benakappa
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  PagerDuty