Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49141

[System Test] ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: no such file or directory

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Major
    • 7.1.0
    • 7.1.0
    • fts
    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.1.0-1558
      Test: -test tests/integration/neo/test_neo_couchstore_milestone2.yml -scope tests/integration/neo/scope_couchstore.yml
      Test Cycle Number : 1

      We are seeing below errors in the fts logs, during failover/rebalance of 2 kv nodes :

      172.23.104.157 : fts
      		 
      2021-10-24T23:22:10.280-07:00 [ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: /data/@fts/bucket_bucket6_idx_lzjtb-type-public_likes-price-Overall_6917f3a4c91bd673_527bf675.pindex, err: open /data/@fts/bucket_bucket6_idx_lzjtb-type-public_likes-price-Overall_6917f3a4c91bd673_527bf675.pindex: no such file or directory -- rest.ShowErrorBody() at rest.go:62
      		 
      2021-10-24T23:22:12.294-07:00 [ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: /data/@fts/bucket_bucket6_idx_lzjtb-type-public_likes-price-Overall_6917f3a4c91bd673_527bf675.pindex, err: open /data/@fts/bucket_bucket6_idx_lzjtb-type-public_likes-price-Overall_6917f3a4c91bd673_527bf675.pindex: no such file or directory -- rest.ShowErrorBody() at rest.go:62
      		 
      2021-10-24T23:22:13.819-07:00 [ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: /data/@fts/bucket_bucket6_idx_whezl-type-public_likes_477b134626d408a3_527bf675.pindex, err: open /data/@fts/bucket_bucket6_idx_whezl-type-public_likes_477b134626d408a3_527bf675.pindex: no such file or directory -- rest.ShowErrorBody() at rest.go:62
      		 
      2021-10-24T23:22:13.886-07:00 [ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: /data/@fts/bucket_bucket6_idx_wwxxu-type-price_5c17b8f8d40b0d9f_b6d0c5f9.pindex, err: open /data/@fts/bucket_bucket6_idx_wwxxu-type-price_5c17b8f8d40b0d9f_b6d0c5f9.pindex: no such file or directory -- rest.ShowErrorBody() at rest.go:62
      		 
      2021-10-24T23:22:15.904-07:00 [ERRO] rest: error code: 400, msg: rest_pindex_streamer: read failed for path: /data/@fts/bucket_bucket6_idx_wwxxu-type-price_5c17b8f8d40b0d9f_b6d0c5f9.pindex, err: open /data/@fts/bucket_bucket6_idx_wwxxu-type-price_5c17b8f8d40b0d9f_b6d0c5f9.pindex: no such file or directory -- rest.ShowErrorBody() at rest.go:62

      Test Step:

      [2021-10-24T23:14:57-07:00, sequoiatools/couchbase-cli:7.0:ecd2e8] failover -c 172.23.108.103:8091 --server-failover 172.23.96.148:8091 -u Administrator -p password
      		 
      [2021-10-24T23:18:29-07:00, sequoiatools/couchbase-cli:7.0:b3c49d] failover -c 172.23.108.103:8091 --server-failover 172.23.97.239:8091 -u Administrator -p password --hard
      		 
      [2021-10-24T23:18:41-07:00, sequoiatools/couchbase-cli:7.0:2b447c] rebalance -c 172.23.108.103:8091 -u Administrator -p password
      		 
      [2021-10-24T23:43:29-07:00, sequoiatools/cmd:09960f] 60
      		 
      [2021-10-24T23:44:35-07:00, sequoiatools/cmd:ce38f4] 600

      Logs:

      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.137.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.155.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.157.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.5.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.67.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.69.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.104.70.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.106.188.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.108.103.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.120.245.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.121.117.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.121.3.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.123.27.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.123.28.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.96.251.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.96.252.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.96.253.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.97.119.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.97.121.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.97.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.97.242.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.98.135.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.99.11.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.99.20.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.99.21.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1635147350/collectinfo-2021-10-25T073554-ns_1%40172.23.99.25.zip

      Cluster spec:

      ########## Cluster config ##################
      		 
      ######  fts : 2 ===== > [172.23.104.155:8091 172.23.104.157:8091]  ###########
      		 
      ######  kv : 11 ===== > [172.23.104.5:8091 172.23.106.100:8091 172.23.108.103:8091 172.23.96.148:8091 172.23.97.119:8091 172.23.97.121:8091 172.23.97.122:8091 172.23.97.239:8091 172.23.99.20:8091 172.23.99.21:8091 172.23.99.25:8091]  ###########
      		 
      ######  index : 6 ===== > [172.23.104.67:8091 172.23.104.69:8091 172.23.120.245:8091 172.23.121.117:8091 172.23.96.252:8091 172.23.96.253:8091]  ###########
      		 
      ######  cbas : 3 ===== > [172.23.106.188:8091 172.23.121.3:8091 172.23.97.242:8091]  ###########
      		 
      ######  backup : 1 ===== > [172.23.123.28:8091]  ###########
      		 
      ######  n1ql : 2 ===== > [172.23.96.251:8091 172.23.99.11:8091]  ###########
      		 
      ######  eventing : 3 ===== > [172.23.104.137:8091 172.23.123.27:8091 172.23.98.135:8091]  ###########

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-49219 index reader err: rest_pindex_streamer: no IndexReaderCopyable implementation found

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              abhinav Abhi Dangeti
              girish.benakappa Girish Benakappa
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty