[MB-32545] Swap index+n1ql node rebalance failed - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Reopened
Priority: Critical
Resolution: Unresolved
Affects Version/s: 6.0.0
Fix Version/s: bug-backlog
Component/s: query
Labels:
- deferred-from-Mad-Hatter
- high-bucket-density

Triage:
Untriaged
Is this a Regression?:
Unknown

Description

Build 6.0.0-1693

Observed that in high data density test with 30 buckets, swap rebalance for index+query node failed with reason "cannot assign requested address"
The setup has 30 buckets and 2 indexes per bucket and ongoing queries on each bucket.
Note that swap rebalance after this failed rebalance is successful.

Logs-
Index+query node which is rebalanced in- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.97.15.zip
Index+query node- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.97.19.zip
Index+query node which is rebalanced out- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.97.20.zip
KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.12.zip
KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.13.zip
KV node- https://s3.amazonaws.com/bugdb/jira/index_reb_multibucket/collectinfo-2019-01-08T151840-ns_1%40172.23.97.14.zip
FTS node- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.96.20.zip
Analytics node- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.96.23.zip
Eventing node- https://s3-us-west-2.amazonaws.com/perf-artifacts/jenkins-arke-multi-bucket-249/172.23.97.177.zip

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

cbq-engine_go_dump_172-23-97-15.txt
60 kB
04/Sep/19 8:49 PM
cbq-engine_go_dump_172-23-97-19.txt
60 kB
04/Sep/19 8:49 PM
cbq-engine_go_dump_172-23-97-20.txt
63 kB
04/Sep/19 8:49 PM
info.zip
6.69 MB
20/Nov/19 5:46 AM
lsof_6.5.0-4059_172-23-97-20.txt
31.33 MB
04/Sep/19 8:49 PM
lsof.txt
48.66 MB
04/Jul/19 4:21 AM

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

Ascending order - Click to sort in descending order

Mahesh Mandhare (Inactive) created issue - 08/Jan/19 9:03 PM

Raju Suravarjjala made changes - 08/Jan/19 10:10 PM

Field	Original Value	New Value
Fix Version/s		Mad-Hatter [ 15037 ]

Sitaram Vemulapalli made changes - 09/Jan/19 1:41 PM

Component/s

query [ 10718 ]

Sitaram Vemulapalli made changes - 09/Jan/19 1:42 PM

Assignee

Keshav Murthy [ keshav ]

Jeelan Poola [ jeelan.poola ]

Jeelan Poola made changes - 09/Jan/19 6:12 PM

Assignee

Jeelan Poola [ jeelan.poola ]

Varun Velamuri [ varun.velamuri ]

Shivani Gupta made changes - 17/Jan/19 10:13 AM

Priority

Major [ 3 ]

Critical [ 2 ]

John Liang made changes - 05/Feb/19 1:47 PM

Assignee

Varun Velamuri [ varun.velamuri ]

Deepkaran Salooja [ deepkaran.salooja ]

Deepkaran Salooja made changes - 05/Feb/19 3:40 PM

Resolution		Won't Fix [ 2 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Deepkaran Salooja made changes - 05/Feb/19 3:40 PM

Actual End

2019-02-05 17:40 (issue has been resolved)

Wayne Siu made changes - 05/Feb/19 10:15 PM

Assignee

Deepkaran Salooja [ deepkaran.salooja ]

Mahesh Mandhare [ mahesh.mandhare ]

Mahesh Mandhare (Inactive) made changes - 26/Feb/19 8:06 PM

Assignee	Mahesh Mandhare [ mahesh.mandhare ]	Deepkaran Salooja [ deepkaran.salooja ]
Resolution	Won't Fix [ 2 ]
Status	Resolved [ 5 ]	Reopened [ 4 ]

Deepkaran Salooja made changes - 13/Mar/19 6:03 PM

Assignee

Deepkaran Salooja [ deepkaran.salooja ]

Mahesh Mandhare [ mahesh.mandhare ]

Mahesh Mandhare (Inactive) made changes - 24/Mar/19 11:34 PM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Deepkaran Salooja [ deepkaran.salooja ]

Deepkaran Salooja made changes - 11/Apr/19 2:50 PM

Assignee

Deepkaran Salooja [ deepkaran.salooja ]

Mahesh Mandhare [ mahesh.mandhare ]

Mahesh Mandhare (Inactive) made changes - 04/Jul/19 4:21 AM

Attachment

lsof.txt [ 70182 ]

Mahesh Mandhare (Inactive) made changes - 04/Jul/19 4:22 AM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Deepkaran Salooja [ deepkaran.salooja ]

Deepkaran Salooja made changes - 19/Jul/19 4:33 PM

Assignee

Deepkaran Salooja [ deepkaran.salooja ]

Keshav Murthy [ keshav ]

Deepkaran Salooja made changes - 19/Jul/19 4:33 PM

Component/s		query [ 10718 ]
Component/s	secondary-index [ 11211 ]

Keshav Murthy made changes - 19/Jul/19 4:35 PM

Assignee

Keshav Murthy [ keshav ]

Isha Kandaswamy [ isha ]

Keshav Murthy made changes - 03/Sep/19 2:47 PM

Assignee

Isha Kandaswamy [ isha ]

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Sitaram Vemulapalli made changes - 03/Sep/19 3:11 PM

Assignee

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Mahesh Mandhare [ mahesh.mandhare ]

Mahesh Mandhare (Inactive) made changes - 04/Sep/19 8:49 PM

Attachment		cbq-engine_go_dump_172-23-97-15.txt [ 73435 ]
Attachment		cbq-engine_go_dump_172-23-97-19.txt [ 73436 ]
Attachment		cbq-engine_go_dump_172-23-97-20.txt [ 73437 ]
Attachment		lsof_6.5.0-4059_172-23-97-20.txt [ 73438 ]

Mahesh Mandhare (Inactive) made changes - 04/Sep/19 8:55 PM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Sitaram Vemulapalli made changes - 16/Sep/19 9:05 AM

Assignee

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Mahesh Mandhare [ mahesh.mandhare ]

Keshav Murthy made changes - 26/Sep/19 10:55 AM

Resolution		Done [ 6 ]
Status	Reopened [ 4 ]	Resolved [ 5 ]

Raju Suravarjjala made changes - 17/Oct/19 2:24 PM

Status

Resolved [ 5 ]

Closed [ 6 ]

Mahesh Mandhare (Inactive) made changes - 14/Nov/19 5:50 AM

Resolution	Done [ 6 ]
Status	Closed [ 6 ]	Reopened [ 4 ]

Mahesh Mandhare (Inactive) made changes - 14/Nov/19 5:54 AM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Sitaram Vemulapalli made changes - 14/Nov/19 6:01 AM

Assignee

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Kamini Jagtiani [ kamini.jagtiani ]

Sitaram Vemulapalli made changes - 14/Nov/19 9:44 PM

Assignee

Kamini Jagtiani [ kamini.jagtiani ]

Mahesh Mandhare [ mahesh.mandhare ]

Lynn Straus made changes - 19/Nov/19 8:11 AM

Fix Version/s		Cheshire-Cat [ 15915 ]
Fix Version/s	Mad-Hatter [ 15037 ]

Lynn Straus made changes - 19/Nov/19 8:11 AM

Labels

high-bucket-density

deferred-from-Mad-Hatter high-bucket-density

Mahesh Mandhare (Inactive) made changes - 20/Nov/19 5:46 AM

Attachment

info.zip [ 77960 ]

Kamini Jagtiani (Inactive) made changes - 06/Jan/20 10:01 AM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Marco Greco [ marco.greco ]

Marco Greco made changes - 06/Jan/20 10:18 AM

Assignee

Marco Greco [ marco.greco ]

Mahesh Mandhare [ mahesh.mandhare ]

Raju Suravarjjala made changes - 05/Mar/20 1:47 PM

Assignee

Mahesh Mandhare [ mahesh.mandhare ]

Sharath Sulochana [ sharath.sulochana ]

Raju Suravarjjala made changes - 27/May/20 1:37 PM

Assignee

Sharath Sulochana [ sharath.sulochana ]

Korrigan Clark [ korrigan.clark ]

Wayne Siu made changes - 19/Aug/20 6:24 PM

Assignee

Korrigan Clark [ korrigan.clark ]

Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ]

Kamini Jagtiani (Inactive) made changes - 07/Dec/20 10:00 PM

Fix Version/s		bug-backlog [ 11600 ]
Fix Version/s	Cheshire-Cat [ 15915 ]

Wayne Siu made changes - 29/Jun/21 8:43 PM

Assignee

Prajwal‌ Kiran Kumar‌ [ prajwal.kirankumar ]

Jyotsna Nayak [ jyotsna.nayak ]

People

Assignee:: Jyotsna Nayak

Reporter:: Mahesh Mandhare (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 11 Start watching this issue

Dates

Created:: 08/Jan/19 9:03 PM

Updated:: 29/Jun/21 8:43 PM

Gerrit Reviews

There are no open Gerrit changes

Couchbase Server

Swap index+n1ql node rebalance failed

Details

Description

Attachments

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty