Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-43072

Optimize the ns_server calls in openFeeder function

    XMLWordPrintable

    Details

    • Story Points:
      1

      Description

      It was observed in a customer setup that the delay in ns_server API (i.e. in connectBucket function) seems to be causing the indexer to projector connection time out. The delay in between the starting the endpoint and flushing the data to it is causing the timeout. This needs to be fixed.

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

            Hide
            mihir.kamdar Mihir Kamdar added a comment -

            Girish Benakappa can you pls validate this one ?

            Show
            mihir.kamdar Mihir Kamdar added a comment - Girish Benakappa can you pls validate this one ?
            Hide
            girish.benakappa Girish Benakappa added a comment -

            Verified with 6.6.2-9469

             

             

            Show
            girish.benakappa Girish Benakappa added a comment - Verified with 6.6.2-9469    
            Hide
            girish.benakappa Girish Benakappa added a comment -

            With 7.0.0 build 4746, I see below ns_server calls made to other bucket scopes. Is this expected ? Sai Krishna Teja

            MTR requests in index log:

            2021-03-23T06:26:31.010-07:00 [Info] KVSender::sendMutationTopicRequest Projector 172.23.97.211:9999 Topic INIT_STREAM_TOPIC_50365826dd17836410ffdf3067797a3e bucket1 
            2021-03-23T06:26:32.473-07:00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23.97.211:9999 Topic INIT_STREAM_TOPIC_50365826dd17836410ffdf3067797a3e bucket1 InstanceIds [14070497863504274383] 

            in projector log:

            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:31 -0700] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1" 0
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:31 -0700] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:31 -0700] "GET /pools/default/buckets/bucket1?bucket_uuid=4e5ed30f4a76f90195e9d4d1d5d862bf HTTP/1.1" 200 10634 - "Go-http-client/1.1" 5
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets?v=30878082&uuid=ef33b72edfd2e6a12f6f637193dc582d HTTP/1.1" 200 53172 - "Go-http-client/1.1-indexer-projector" 19
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets/bucket1/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/b/bucket2 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets/bucket2/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/b/bucket3 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets/bucket3/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/b/bucket4 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 2
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets/bucket4/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/b/bucket5 HTTP/1.1" 200 8545 - "Go-http-client/1.1-indexer-projector" 0
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:35 -0700] "GET /pools/default/buckets/bucket5/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 0
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:36 -0700] "GET /pools/default/buckets/bucket1?bucket_uuid=4e5ed30f4a76f90195e9d4d1d5d862bf HTTP/1.1" 200 10634 - "Go-http-client/1.1" 5
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets?v=30878082&uuid=ef33b72edfd2e6a12f6f637193dc582d HTTP/1.1" 200 53172 - "Go-http-client/1.1-indexer-projector" 21
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 0
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets/bucket1/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/b/bucket2 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets/bucket2/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/b/bucket3 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets/bucket3/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/b/bucket4 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets/bucket4/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/b/bucket5 HTTP/1.1" 200 8545 - "Go-http-client/1.1-indexer-projector" 1
            127.0.0.1 - @projector-cbauth [23/Mar/2021:06:26:40 -0700] "GET /pools/default/buckets/bucket5/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 2

            Show
            girish.benakappa Girish Benakappa added a comment - With 7.0.0 build 4746, I see below ns_server calls made to other bucket scopes. Is this expected ?  Sai Krishna Teja MTR requests in index log: 2021 - 03 -23T06: 26 : 31.010 - 07 : 00 [Info] KVSender::sendMutationTopicRequest Projector 172.23 . 97.211 : 9999 Topic INIT_STREAM_TOPIC_50365826dd17836410ffdf3067797a3e bucket1 2021 - 03 -23T06: 26 : 32.473 - 07 : 00 [Info] KVSender::sendMutationTopicRequest Success Projector 172.23 . 97.211 : 9999 Topic INIT_STREAM_TOPIC_50365826dd17836410ffdf3067797a3e bucket1 InstanceIds [ 14070497863504274383 ] in projector log: 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 31 - 0700 ] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1" 0 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 31 - 0700 ] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 31 - 0700 ] "GET /pools/default/buckets/bucket1?bucket_uuid=4e5ed30f4a76f90195e9d4d1d5d862bf HTTP/1.1" 200 10634 - "Go-http-client/1.1" 5 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets?v=30878082&uuid=ef33b72edfd2e6a12f6f637193dc582d HTTP/1.1" 200 53172 - "Go-http-client/1.1-indexer-projector" 19 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets/bucket1/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/b/bucket2 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets/bucket2/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/b/bucket3 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets/bucket3/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/b/bucket4 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 2 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets/bucket4/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/b/bucket5 HTTP/1.1" 200 8545 - "Go-http-client/1.1-indexer-projector" 0 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 35 - 0700 ] "GET /pools/default/buckets/bucket5/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 0 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 36 - 0700 ] "GET /pools/default/buckets/bucket1?bucket_uuid=4e5ed30f4a76f90195e9d4d1d5d862bf HTTP/1.1" 200 10634 - "Go-http-client/1.1" 5 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets?v=30878082&uuid=ef33b72edfd2e6a12f6f637193dc582d HTTP/1.1" 200 53172 - "Go-http-client/1.1-indexer-projector" 21 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/b/bucket1 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 0 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets/bucket1/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/b/bucket2 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets/bucket2/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/b/bucket3 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets/bucket3/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/b/bucket4 HTTP/1.1" 200 8544 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets/bucket4/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/b/bucket5 HTTP/1.1" 200 8545 - "Go-http-client/1.1-indexer-projector" 1 127.0 . 0.1 - @projector -cbauth [ 23 /Mar/ 2021 : 06 : 26 : 40 - 0700 ] "GET /pools/default/buckets/bucket5/scopes HTTP/1.1" 200 109 - "Go-http-client/1.1-indexer-projector" 2
            Hide
            sai.teja Sai Krishna Teja added a comment -

            Looks good Girish Benakappa others calls can be made for a different notification. Assuming you are building index for bucket1 within the time period of the MTR you are not seeing the request to buckets end point and request to fetch data for all other buckets.

            Show
            sai.teja Sai Krishna Teja added a comment - Looks good Girish Benakappa others calls can be made for a different notification. Assuming you are building index for bucket1 within the time period of the MTR you are not seeing the request to buckets end point and request to fetch data for all other buckets.
            Hide
            girish.benakappa Girish Benakappa added a comment -

            Closing based on above comments

            Show
            girish.benakappa Girish Benakappa added a comment - Closing based on above comments

              People

              Assignee:
              girish.benakappa Girish Benakappa
              Reporter:
              sai.teja Sai Krishna Teja
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                    PagerDuty