[BP 6.6.3 MB-44931] : Eventing function with feed boundary (from now) sometimes deploy from everything

Description

For the new 6.6.2 GA release I just saw an issue essentially identical to https://couchbasecloud.atlassian.net/browse/MB-44931#icft=MB-44931 which has been fixed in Chesire-Cat/7.0.0

I had an Eventing source bucket with 10M docs and was working with an Eventing function that is set/fixed to have a feed boundary "from now" yet occasionally when I resume that function "archive_all_keys_by_prefix" it processes all 10 Million docs when it should do nothing.

I had just two functions one deployed "purge_all_keys_by_prefix" and the other "archive_all_keys_by_prefix" I was pausing and resuming on resume it processed 10M docs.

I took a CB collect when this happened 

ls -ltr cbcollect_info_BAD_deployed_from_everything.zip -rw-r--r-- 1 root root 21573374 Apr 19 16:30 cbcollect_info_BAD_deployed_from_everything.zip

This has been uploaded via

curl --upload-file cbcollect_info_BAD_deployed_from_everything.zip https://s3.amazonaws.com/cb-engineering/

Components

Affects versions

Fix versions

Labels

Environment

None

Link to Log File, atop/blg, CBCollectInfo, Core dump

None

Release Notes Description

None

Attachments

1
  • 05 May 2021, 08:03 AM

Activity

Jon Strabala August 13, 2021 at 5:22 PM

Description for release notes:
Move https://couchbasecloud.atlassian.net/browse/MB-45785#icft=MB-45785 to Fixed Issues section.

CB robot July 3, 2021 at 2:49 PM

Build couchbase-server-6.6.3-9783 contains eventing commit b751018 with commit message:
https://couchbasecloud.atlassian.net/browse/MB-45785#icft=MB-45785: Move all settings/depcfg UI endpoints to /functions

CB robot July 3, 2021 at 2:49 PM

Build couchbase-server-6.6.3-9783 contains eventing commit dc46fb8 with commit message:
https://couchbasecloud.atlassian.net/browse/MB-45785#icft=MB-45785: Add /config endpoint to retrieve/update deployment config

Amarantha Kulkarni June 22, 2021 at 1:53 PM

Description for release notes:

Summary: A race condition exists where an Eventing Function with a Feed Boundary set to "From now" sometimes ignores it's checkpoint and resumes processing form Everything.
This issue only impacts the UI and can occur when a user rapidly invokes pause / edit / resume in succession.

Workaround: The issue can be avoided by using the REST APIs to pause and resume Eventing Functions in production.

Wayne Siu May 20, 2021 at 6:17 AM

Added to 6.6.3.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Story Points

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created April 19, 2021 at 11:42 PM
Updated August 13, 2021 at 5:22 PM
Resolved July 3, 2021 at 6:24 AM
Instabug