Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.1.0
-
Enterprise Edition 7.1.0 build 1337
-
Untriaged
-
Centos 64-bit
-
-
1
-
Yes
Description
Cluster Configuration
| Nodes | Services |
|---|---|
| 10.112.190.101 | kv, query, index, eventing |
| 10.112.190.102 | eventing |
STEPS TO REPRODUCE
- Create 2 buckets namely src_bucket and metadata.
- Create and deploy 2 handlers test and t.
- Disable auto failover and enable n2n encryption.
- Enforce tls by changing encryption level to strict.
- Pause both handlers.
OBSERVATION
Handler t is stuck in pausing state.
curl -XGET -k https://Administrator:password@10.112.190.101:18096/api/v1/status |
{
|
"apps": [ |
{
|
"composite_status": "paused", |
"name": "test", |
"num_bootstrapping_nodes": 0, |
"num_deployed_nodes": 2, |
"deployment_status": true, |
"processing_status": false, |
"redeploy_required": false |
},
|
{
|
"composite_status": "pausing", |
"name": "t", |
"num_bootstrapping_nodes": 0, |
"num_deployed_nodes": 2, |
"deployment_status": true, |
"processing_status": false, |
"redeploy_required": false |
}
|
],
|
"num_eventing_nodes": 2 |
}
|
On 10.112.190.101
eventing.log
2021-09-28T10:32:36.241+05:30 [Error] Consumer::addOwnershipHistorySECallback [worker_test_0:/tmp/127.0.0.1:8091_0_1051417688.sock:28760] Key: eventing::1051417688::test::vb::10, subdoc operation failed while performing ownership entry app post STREAMEND, err: ambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"ambiguous timeout"}},"OperationID":"MutateIn","Opaque":"0x0","TimeObserved":2501424074,"RetryReasons":null,"RetryAttempts":0,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} |
2021-09-28T10:32:37.408+05:30 [Error] Consumer::getOpCallback [worker_test_0:/tmp/127.0.0.1:8091_0_1051417688.sock:28760] Bucket fetch failed for key: <ud>eventing::1051417688::test::vb::0</ud>, err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"Get","Opaque":"0x0","TimeObserved":2500864625,"RetryReasons":null,"RetryAttempts":0,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} |
2021-09-28T10:32:37.498+05:30 [Error] Producer::getOpCallback [test:1] Bucket get failed for key: <ud>eventing::1051417688::test::vb::0</ud> , err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"Get","Opaque":"0x0","TimeObserved":2501557336,"RetryReasons":null,"RetryAttempts":0,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} |
On 10.112.190.102
eventing.log
2021-09-28T10:17:18.798+05:30 [Warn] Got error while trying to get bucket sequence numbers: dial tcp 10.112.190.101:11207: connect: connection refused Retrying... |
2021-09-28T10:17:18.817+05:30 [Info] Connecting to KV on TLS port. |
2021-09-28T10:17:18.818+05:30 [Error] StartDcpFeedOver(): dial tcp 10.112.190.101:11207: connect: connection refused |
Attachments
Issue Links
- duplicates
-
-
- Closed
-