[MB-47678] [Flex]Operator Cluster: Error while refreshing FTS indexer n1fty:cause: authentication failure - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: Cheshire-Cat, 7.0.1
Fix Version/s: 7.1.0, 7.0.2, 7.0.1
Component/s: fts
Labels:

Triage:
Untriaged
Story Points:
1
Is this a Regression?:
Unknown

Description

Build: 7.0.1 build 5960

Setup a Cluster through Operator. operator naturally uses alternate addresses
Load travel -sample
Create below index :

  "type": "fulltext-index",

  "name": "test1",

  "uuid": "6f5c202bb4135c09",

  "sourceType": "gocbcore",

  "sourceName": "travel-sample",

  "sourceUUID": "eaf803dd55f4441c00a0f90725278a91",

  "planParams": {

    "maxPartitionsPerPIndex": 1024,

    "indexPartitions": 1

},

  "params": {

    "doc_config": {

      "docid_prefix_delim": "",

      "docid_regexp": "",

      "mode": "type_field",

      "type_field": "type"

},

    "mapping": {

      "analysis": {},

      "default_analyzer": "keyword",

      "default_datetime_parser": "dateTimeOptional",

      "default_field": "_all",

      "default_mapping": {

        "dynamic": true,

        "enabled": true

},

      "default_type": "_default",

      "docvalues_dynamic": false,

      "index_dynamic": true,

      "store_dynamic": false,

      "type_field": "_type"

},

    "store": {

      "indexType": "scorch",

      "segmentVersion": 15

},

  "sourceParams": {}

Below Flex query errors with "No index available on keyspace `default`:`travel-sample` that matches your query. Use CREATE PRIMARY INDEX ON `default`:`travel-sample` to create a primary index, or check that your expected index is online"

select meta().id from `travel-sample` USE INDEX(USING FTS) where country = "United States"

Seeing below errors in the logs:

_time=2021-07-31T02:50:33.720+00:00 _level=INFO _msg=(GOCBCORE) Found couchbase bucket and HTTP poller in use. Resetting pollers to start cccp.

_time=2021-07-31T02:50:33.740+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861200 failed to bootstrap: authentication failure | {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.12:31947","last_dispatched_from":"10.128.0.17:49000","last_connection_id":"6fcbafcf18fae4e5/93aceaf0d4d433a9"}

_time=2021-07-31T02:50:33.752+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861380 failed to bootstrap: authentication failure | {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.11:30976","last_dispatched_from":"10.128.0.17:46172","last_connection_id":"6fcbafcf18fae4e5/136dbe80ea76d007"}

_time=2021-07-31T02:50:33.754+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861320 failed to bootstrap: authentication failure | {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"}

_time=2021-07-31T02:50:33.781+00:00 _level=ERROR _msg= Error while refreshing FTS indexer - n1fty:  - cause: authentication failure | {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"}

Logs:

https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0004.cb-example.default.svc.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0005.cb-example.default.svc.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0006.cb-example.default.svc.zip

Attachments

Issue Links

is a backport of

MB-47457 FTS is broken with Alternate Addresses set

Closed

mentioned in: Page Loading...

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

For Gerrit Dashboard: MB-47678
#	Subject	Branch	Project	Status	CR	V
158590,3	MB-47678: NetworkType:default for gocbcore AgentConfig	cheshire-cat	n1fty	Status: MERGED	+2	+1
158600,3	MB-47678: NetworkType:default for gocbcore AgentConfig	master	n1fty	Status: MERGED	+2	+1
158601,1	MB-47678: [BP] NetworkType:default for gocbcore AgentConfig	mad-hatter	n1fty	Status: ABANDONED	+2	0
159202,2	MB-47678: [BP] NetworkType:default for gocbcore AgentConfig	7.0.1	n1fty	Status: MERGED	+2	+1

Activity

Ascending order - Click to sort in descending order

Girish Benakappa created issue - 30/Jul/21 11:52 PM

Girish Benakappa made changes - 30/Jul/21 11:53 PM

Field	Original Value	New Value
Description	Build: 7.0.1 build 5960 Setup a Cluster through Operator. operator naturally uses alternate addresses Load travel -sample Create below index : {code} { "type": "fulltext-index", "name": "test1", "uuid": "6f5c202bb4135c09", "sourceType": "gocbcore", "sourceName": "travel-sample", "sourceUUID": "eaf803dd55f4441c00a0f90725278a91", "planParams": { "maxPartitionsPerPIndex": 1024, "indexPartitions": 1 }, "params": { "doc_config": { "docid_prefix_delim": "", "docid_regexp": "", "mode": "type_field", "type_field": "type" }, "mapping": { "analysis": {}, "default_analyzer": "keyword", "default_datetime_parser": "dateTimeOptional", "default_field": "_all", "default_mapping": { "dynamic": true, "enabled": true }, "default_type": "_default", "docvalues_dynamic": false, "index_dynamic": true, "store_dynamic": false, "type_field": "_type" }, "store": { "indexType": "scorch", "segmentVersion": 15 } }, "sourceParams": {} } {code} Below Flex query errors with "No index available on keyspace `default`:`travel-sample` that matches your query. Use CREATE PRIMARY INDEX ON `default`:`travel-sample` to create a primary index, or check that your expected index is online" {code} select meta().id from `travel-sample` USE INDEX(USING FTS) where country = "United States" {code} Seeing below errors in the logs: {code} _time=2021-07-31T02:50:33.720+00:00 _level=INFO _msg=(GOCBCORE) Found couchbase bucket and HTTP poller in use. Resetting pollers to start cccp. _time=2021-07-31T02:50:33.740+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861200 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.12:31947","last_dispatched_from":"10.128.0.17:49000","last_connection_id":"6fcbafcf18fae4e5/93aceaf0d4d433a9"} _time=2021-07-31T02:50:33.752+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861380 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.11:30976","last_dispatched_from":"10.128.0.17:46172","last_connection_id":"6fcbafcf18fae4e5/136dbe80ea76d007"} _time=2021-07-31T02:50:33.754+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861320 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"} _time=2021-07-31T02:50:33.781+00:00 _level=ERROR _msg= Error while refreshing FTS indexer - n1fty: - cause: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"} {code}	Build: 7.0.1 build 5960 Setup a Cluster through Operator. operator naturally uses alternate addresses Load travel -sample Create below index : {code} { "type": "fulltext-index", "name": "test1", "uuid": "6f5c202bb4135c09", "sourceType": "gocbcore", "sourceName": "travel-sample", "sourceUUID": "eaf803dd55f4441c00a0f90725278a91", "planParams": { "maxPartitionsPerPIndex": 1024, "indexPartitions": 1 }, "params": { "doc_config": { "docid_prefix_delim": "", "docid_regexp": "", "mode": "type_field", "type_field": "type" }, "mapping": { "analysis": {}, "default_analyzer": "keyword", "default_datetime_parser": "dateTimeOptional", "default_field": "_all", "default_mapping": { "dynamic": true, "enabled": true }, "default_type": "_default", "docvalues_dynamic": false, "index_dynamic": true, "store_dynamic": false, "type_field": "_type" }, "store": { "indexType": "scorch", "segmentVersion": 15 } }, "sourceParams": {} } {code} Below Flex query errors with "No index available on keyspace `default`:`travel-sample` that matches your query. Use CREATE PRIMARY INDEX ON `default`:`travel-sample` to create a primary index, or check that your expected index is online" {code} select meta().id from `travel-sample` USE INDEX(USING FTS) where country = "United States" {code} Seeing below errors in the logs: {code} _time=2021-07-31T02:50:33.720+00:00 _level=INFO _msg=(GOCBCORE) Found couchbase bucket and HTTP poller in use. Resetting pollers to start cccp. _time=2021-07-31T02:50:33.740+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861200 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.12:31947","last_dispatched_from":"10.128.0.17:49000","last_connection_id":"6fcbafcf18fae4e5/93aceaf0d4d433a9"} _time=2021-07-31T02:50:33.752+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861380 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.11:30976","last_dispatched_from":"10.128.0.17:46172","last_connection_id":"6fcbafcf18fae4e5/136dbe80ea76d007"} _time=2021-07-31T02:50:33.754+00:00 _level=WARN _msg=(GOCBCORE) Pipeline Client 0xc001861320 failed to bootstrap: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"} _time=2021-07-31T02:50:33.781+00:00 _level=ERROR _msg= Error while refreshing FTS indexer - n1fty: - cause: authentication failure \| {"status_code":36,"document_key":"travel-sample","bucket":"travel-sample","error_name":"EACCESS","error_description":"Not authorized for command","opaque":3,"context":"Not authenticated","last_dispatched_to":"192.168.0.13:30400","last_dispatched_from":"10.128.0.17:58094","last_connection_id":"6fcbafcf18fae4e5/187de3b268670394"} {code} Logs: https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0004.cb-example.default.svc.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0005.cb-example.default.svc.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/test2/collectinfo-2021-07-31T062350-ns_1%40cb-example-0006.cb-example.default.svc.zip

Abhinav Dangeti made changes - 31/Jul/21 9:11 AM

Assignee

Keshav Murthy [ keshav ]

Abhinav Dangeti [ abhinav ]

Abhinav Dangeti made changes - 02/Aug/21 8:16 AM

Fix Version/s

7.0.1 [ 17104 ]

Abhinav Dangeti made changes - 02/Aug/21 9:57 AM

Link

This issue relates to ~~MB-47457~~ [ ~~MB-47457~~ ]

Abhinav Dangeti added a comment - 02/Aug/21 10:02 AM

http://review.couchbase.org/c/n1fty/+/158590

Abhinav Dangeti added a comment - 02/Aug/21 10:02 AM http://review.couchbase.org/c/n1fty/+/158590

Sitaram Vemulapalli added a comment - 02/Aug/21 10:12 AM - edited

N1QL transactions ~~MB-45700~~ Handle SSL host, custom port, alternative addresses

Sitaram Vemulapalli added a comment - 02/Aug/21 10:12 AM - edited N1QL transactions MB-45700 Handle SSL host, custom port, alternative addresses

Abhinav Dangeti made changes - 02/Aug/21 10:14 AM

Resolution		Fixed [ 1 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Abhinav Dangeti made changes - 02/Aug/21 10:23 AM

Fix Version/s

Neo [ 17615 ]

Couchbase Build Team added a comment - 02/Aug/21 2:00 PM

Build couchbase-server-7.0.1-5979 contains n1fty commit cf96a9e with commit message:
~~MB-47678~~: NetworkType:default for gocbcore AgentConfig

Couchbase Build Team added a comment - 02/Aug/21 2:00 PM Build couchbase-server-7.0.1-5979 contains n1fty commit cf96a9e with commit message: MB-47678 : NetworkType:default for gocbcore AgentConfig

Couchbase Build Team added a comment - 02/Aug/21 5:49 PM

Build couchbase-server-7.1.0-1113 contains n1fty commit bdfd26f with commit message:
~~MB-47678~~: NetworkType:default for gocbcore AgentConfig

Couchbase Build Team added a comment - 02/Aug/21 5:49 PM Build couchbase-server-7.1.0-1113 contains n1fty commit bdfd26f with commit message: MB-47678 : NetworkType:default for gocbcore AgentConfig

Girish Benakappa added a comment - 02/Aug/21 11:31 PM

Do not see this issue with 7.0.1-5979.

Girish Benakappa added a comment - 02/Aug/21 11:31 PM Do not see this issue with 7.0.1-5979.

Lynn Straus made changes - 09/Aug/21 2:47 PM

Fix Version/s

7.0.2 [ 18012 ]

Lynn Straus made changes - 09/Aug/21 2:50 PM

Fix Version/s

7.0.1 [ 17104 ]

Wayne Siu made changes - 10/Aug/21 10:59 PM

Link

This issue is a backport of ~~MB-47457~~ [ ~~MB-47457~~ ]

Wayne Siu made changes - 10/Aug/21 10:59 PM

Link

This issue relates to ~~MB-47457~~ [ ~~MB-47457~~ ]

Wayne Siu made changes - 10/Aug/21 10:59 PM

Labels

approved-for-7.0.2

Wayne Siu made changes - 10/Aug/21 11:00 PM

Link

This issue blocks MB-46308 [ MB-46308 ]

Wayne Siu made changes - 10/Aug/21 11:01 PM

Assignee

Abhinav Dangeti [ abhinav ]

Girish Benakappa [ girish.benakappa ]

Abhinav Dangeti made changes - 11/Aug/21 9:42 AM

Fix Version/s

7.0.1 [ 17104 ]

Abhinav Dangeti made changes - 11/Aug/21 9:44 AM

Fix Version/s

7.0.1 [ 17104 ]

Abhinav Dangeti made changes - 11/Aug/21 4:53 PM

Affects Version/s

Cheshire-Cat [ 15915 ]

Wayne Siu made changes - 11/Aug/21 6:20 PM

Link

This issue blocks MB-47469 [ MB-47469 ]

Wayne Siu made changes - 11/Aug/21 6:20 PM

Labels

approved-for-7.0.2

approved-for-7.0.1 approved-for-7.0.2

Wayne Siu made changes - 11/Aug/21 6:20 PM

Fix Version/s

7.0.1 [ 17104 ]

Wayne Siu made changes - 11/Aug/21 6:21 PM

Assignee	Girish Benakappa [ girish.benakappa ]	Abhinav Dangeti [ abhinav ]
Resolution	Fixed [ 1 ]
Status	Resolved [ 5 ]	Reopened [ 4 ]

Abhinav Dangeti made changes - 12/Aug/21 10:10 AM

Resolution		Fixed [ 1 ]
Status	Reopened [ 4 ]	Resolved [ 5 ]

Couchbase Build Team added a comment - 12/Aug/21 1:26 PM

Build couchbase-server-7.0.1-6100 contains n1fty commit 53a544e with commit message:
~~MB-47678~~: [BP] NetworkType:default for gocbcore AgentConfig

Couchbase Build Team added a comment - 12/Aug/21 1:26 PM Build couchbase-server-7.0.1-6100 contains n1fty commit 53a544e with commit message: MB-47678 : [BP] NetworkType:default for gocbcore AgentConfig

Wayne Siu made changes - 13/Aug/21 8:34 AM

Assignee

Abhinav Dangeti [ abhinav ]

Girish Benakappa [ girish.benakappa ]

Girish Benakappa added a comment - 19/Aug/21 12:54 PM

Do not see this issue in 7.0.1 build 6102

Girish Benakappa added a comment - 19/Aug/21 12:54 PM Do not see this issue in 7.0.1 build 6102

Ritam Sharma made changes - 23/Aug/21 7:20 AM

Remote Link

This issue links to "Page (Couchbase, Inc. Wiki)" [ 23032 ]

Mihir Kamdar (Inactive) made changes - 13/Sep/21 12:33 PM

Assignee

Girish Benakappa [ girish.benakappa ]

Evgeny Makarenko [ evgeny.makarenko ]

Mihir Kamdar (Inactive) made changes - 13/Sep/21 12:40 PM

Labels

approved-for-7.0.1 approved-for-7.0.2

7.0.2-verified approved-for-7.0.1 approved-for-7.0.2

Mihir Kamdar (Inactive) made changes - 20/Sep/21 3:41 PM

Assignee

Evgeny Makarenko [ evgeny.makarenko ]

Girish Benakappa [ girish.benakappa ]

Girish Benakappa added a comment - 18/Jan/22 11:50 PM

Do not see this issue with 7.1.0-2021, hence closing this issue.

Girish Benakappa added a comment - 18/Jan/22 11:50 PM Do not see this issue with 7.1.0-2021, hence closing this issue.

Girish Benakappa made changes - 18/Jan/22 11:50 PM

Status

Resolved [ 5 ]

Closed [ 6 ]

People

Assignee:: Girish Benakappa

Reporter:: Girish Benakappa

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 30/Jul/21 11:52 PM

Updated:: 18/Jan/22 11:50 PM

Resolved:: 12/Aug/21 10:10 AM

Gerrit Reviews

There are no open Gerrit changes

Show There are 4 closed Gerrit changes

Hide There are 4 closed Gerrit changes

MB-47678: NetworkType:default for gocbcore AgentConfig: Gerrit Review:

MB-47678: NetworkType:default for gocbcore AgentConfig: Gerrit Review:

MB-47678: [BP] NetworkType:default for gocbcore AgentConfig: Gerrit Review:

MB-47678: [BP] NetworkType:default for gocbcore AgentConfig: Gerrit Review:

PagerDuty

Couchbase Server

Details

Description

Attachments

Issue Links

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty