[MB-42474] Index aggregates pushdown wrongly - Couchbase database

XML

Word

Printable

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 6.5.0, Cheshire-Cat, 6.6.1
Fix Version/s: 6.6.1, 6.5.2, 7.0.0
Component/s: query
Labels:
- approved-for-6.6.1
- releasenote

Story Points:
1

Description

CREATE INDEX cx1 ON default(type, a1 );

UPSERT INTO default VALUES ("c001", {"type": "doc", "a1":[{"name":"a1"}, {"name":"a2"}]}),

                    VALUES ("c002", {"type": "doc", "a1":[{"name":"b1"}, {"name":"a2"}]}),

                    VALUES ("c003", {"type": "doc", "a1":[{"name":"b1"}, {"name":"a2"}]});

SELECT COUNT(1) FROM default AS d

WHERE d.type = "doc" AND (EVERY v IN a1 SATISFIES v.name != "b1" END OR d.a1 IS MISSING);

SELECT * FROM default AS d

WHERE d.type = "doc" AND (EVERY v IN a1 SATISFIES v.name != "b1" END OR d.a1 IS MISSING);

count query returns 3, non-count query returns 1

Index is not array Index. array field is Scalar value. count query can cover. But the EVERY predicate is not pushed to indexer. It should not push index aggregation.
Also note EVERY query can't push any index pushdowns.

Workaround:
SELECT COUNT(1) FROM default AS d WHERE d.type = "doc" AND (EVERY v IN IFMISSING(a1,[]) SATISFIES v.name != "b1" END);
EVERY is true for empty ARRAY.

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

For Gerrit Dashboard: MB-42474
#	Subject	Branch	Project	Status	CR	V
139496,4	MB-42474. Set exact to false if predicate depends on non-sargable index keys.	master	query	Status: ABANDONED	0	0
139700,2	MB-42474 Set exact spans properly in case of multiple spans for the same index	master	query	Status: MERGED	+2	+1
139745,2	MB-42474 Set exact spans properly in case of multiple spans for the same index	mad-hatter	query	Status: MERGED	+2	+1
140278,2	MB-42474 Set exact spans properly in case of multiple spans for the same index	6.5.1	query	Status: MERGED	+2	+1

Activity

Ascending order - Click to sort in descending order

Sitaram Vemulapalli created issue - 03/Nov/20 10:21 AM

Sitaram Vemulapalli made changes - 03/Nov/20 10:22 AM

Field	Original Value	New Value
Link		This issue is triggered by CBSE-9158 [ CBSE-9158 ]

Sitaram Vemulapalli made changes - 03/Nov/20 12:03 PM

Issue Type

Task [ 3 ]

Bug [ 1 ]

Kamini Jagtiani (Inactive) made changes - 04/Nov/20 11:10 AM

Assignee

Kamini Jagtiani [ kamini.jagtiani ]

Bingjie Miao [ bingjie.miao ]

Couchbase Build Team added a comment - 05/Nov/20 5:20 PM

Build couchbase-server-7.0.0-3646 contains query commit 5998cfd with commit message:
~~MB-42474~~ Set exact spans properly in case of multiple spans for the same index

Couchbase Build Team added a comment - 05/Nov/20 5:20 PM Build couchbase-server-7.0.0-3646 contains query commit 5998cfd with commit message: MB-42474 Set exact spans properly in case of multiple spans for the same index

Bingjie Miao made changes - 05/Nov/20 6:22 PM

Assignee	Bingjie Miao [ bingjie.miao ]	Mihir Kamdar [ mihir.kamdar ]
Resolution		Fixed [ 1 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Wayne Siu made changes - 05/Nov/20 11:12 PM

Link

This issue blocks MB-40528 [ MB-40528 ]

Wayne Siu added a comment - 05/Nov/20 11:13 PM

Re-opening it for 6.6.1

Wayne Siu added a comment - 05/Nov/20 11:13 PM Re-opening it for 6.6.1

Wayne Siu made changes - 05/Nov/20 11:13 PM

Assignee	Mihir Kamdar [ mihir.kamdar ]	Sitaram Vemulapalli [ sitaram.vemulapalli ]
Resolution	Fixed [ 1 ]
Status	Resolved [ 5 ]	Reopened [ 4 ]

Wayne Siu made changes - 05/Nov/20 11:13 PM

Labels

approved-for-6.6.1

Wayne Siu made changes - 05/Nov/20 11:13 PM

Fix Version/s

6.6.1 [ 17002 ]

Sitaram Vemulapalli made changes - 05/Nov/20 11:14 PM

Assignee

Sitaram Vemulapalli [ sitaram.vemulapalli ]

Bingjie Miao [ bingjie.miao ]

Bingjie Miao made changes - 06/Nov/20 10:31 AM

Affects Version/s

6.6.2 [ 17103 ]

Couchbase Build Team added a comment - 06/Nov/20 10:38 AM

Build couchbase-server-6.6.1-9176 contains query commit a5aa02a with commit message:
~~MB-42474~~ Set exact spans properly in case of multiple spans for the same index

Couchbase Build Team added a comment - 06/Nov/20 10:38 AM Build couchbase-server-6.6.1-9176 contains query commit a5aa02a with commit message: MB-42474 Set exact spans properly in case of multiple spans for the same index

Bingjie Miao made changes - 06/Nov/20 11:43 AM

Assignee	Bingjie Miao [ bingjie.miao ]	Mihir Kamdar [ mihir.kamdar ]
Resolution		Fixed [ 1 ]
Status	Reopened [ 4 ]	Resolved [ 5 ]

Ajay Bhullar added a comment - 06/Nov/20 1:21 PM

verified in 6.6.1-9176 using the repro in description

Ajay Bhullar added a comment - 06/Nov/20 1:21 PM verified in 6.6.1-9176 using the repro in description

Ajay Bhullar added a comment - 06/Nov/20 1:26 PM

verified in 7.0.0-3646 using the steps in the description count is now returning 1 as well as 1 doc being returned

Ajay Bhullar added a comment - 06/Nov/20 1:26 PM verified in 7.0.0-3646 using the steps in the description count is now returning 1 as well as 1 doc being returned

Wayne Siu made changes - 13/Nov/20 2:28 PM

Link

This issue blocks MB-42749 [ MB-42749 ]

Wayne Siu made changes - 13/Nov/20 3:54 PM

Link

This issue blocks MB-42583 [ MB-42583 ]

Bingjie Miao made changes - 13/Nov/20 4:17 PM

Fix Version/s

6.5.1 [ 16622 ]

Wayne Siu made changes - 13/Nov/20 4:25 PM

Fix Version/s		6.5.2 [ 17223 ]
Fix Version/s	6.5.1 [ 16622 ]

Couchbase Build Team added a comment - 13/Nov/20 4:31 PM

Build couchbase-server-6.5.1-6313 contains query commit 89d8869 with commit message:
~~MB-42474~~ Set exact spans properly in case of multiple spans for the same index

Couchbase Build Team added a comment - 13/Nov/20 4:31 PM Build couchbase-server-6.5.1-6313 contains query commit 89d8869 with commit message: MB-42474 Set exact spans properly in case of multiple spans for the same index

Ajay Bhullar added a comment - 13/Nov/20 5:32 PM

verified in 6.5.1-6313 with the steps in the description, count and query both return 1 document (count returns 1)

Ajay Bhullar added a comment - 13/Nov/20 5:32 PM verified in 6.5.1-6313 with the steps in the description, count and query both return 1 document (count returns 1)

Ajay Bhullar added a comment - 13/Nov/20 5:39 PM

verified in all versions the fix was pushed to

Ajay Bhullar added a comment - 13/Nov/20 5:39 PM verified in all versions the fix was pushed to

Ajay Bhullar made changes - 13/Nov/20 5:39 PM

Status

Resolved [ 5 ]

Closed [ 6 ]

Couchbase Build Team added a comment - 14/Nov/20 12:41 AM

Build couchbase-server-6.5.2-6601 contains query commit 89d8869 with commit message:
~~MB-42474~~ Set exact spans properly in case of multiple spans for the same index

Couchbase Build Team added a comment - 14/Nov/20 12:41 AM Build couchbase-server-6.5.2-6601 contains query commit 89d8869 with commit message: MB-42474 Set exact spans properly in case of multiple spans for the same index

Arunkumar Senthilnathan (Inactive) made changes - 17/Feb/21 12:24 PM

Labels

approved-for-6.6.1

approved-for-6.6.1 releasenote

Lynn Straus made changes - 17/Jun/21 3:26 PM

Fix Version/s

7.0.0 [ 17233 ]

Lynn Straus made changes - 17/Jun/21 3:29 PM

Fix Version/s

Cheshire-Cat [ 15915 ]

People

Assignee:: Mihir Kamdar (Inactive)

Reporter:: Sitaram Vemulapalli

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 03/Nov/20 10:21 AM

Updated:: 17/Jun/21 3:29 PM

Resolved:: 06/Nov/20 11:43 AM

Gerrit Reviews

There are no open Gerrit changes

Show There are 4 closed Gerrit changes

Hide There are 4 closed Gerrit changes

MB-42474. Set exact to false if predicate depends on non-sargable index keys.: Gerrit Review:

MB-42474 Set exact spans properly in case of multiple spans for the same index: Gerrit Review:

MB-42474 Set exact spans properly in case of multiple spans for the same index: Gerrit Review:

MB-42474 Set exact spans properly in case of multiple spans for the same index: Gerrit Review:

PagerDuty

Couchbase Server

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty