Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-21770

relax the mandatory array index-key, to create covering array-index

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.5.0, 4.6.0
    • 4.6.2, 5.0.0
    • query
    • None

    Description

      Creating covering array index requires the whole-array field itself as one of the index-keys to the CREATE INDEX. This restriction has following issues:

      1) index keys are limited to 4K in size. So, covering array indexes can't be created with larger arrays. This limits the size of the array or size of array elements.

      2) CREATE INDEX hits following error because of exceeding default max_array_seckey_size value. With large arrays (see user example below), this value reaches big numbers which may lead to unexplored territories (with no clear guidelines etc).
      — Encoded array key too long. Length of key = 33240, Limit = 30978

      Following lists few use cases hurt by the current limitation:
      1)https://forums.couchbase.com/t/encoded-array-key-too-long-30978-skipped/9596
      User quotes:
      Largest array is going to be 2000 entries max. I've done some work to shorten
      the length of array entries, so rather than:

      _"members": [
      "IDaaS_ESTAB-3924027_PL-6600",
      "IDaaS_ESTAB-3924027_PL-6601",
      "IDaaS_ESTAB-3924027_PL-6602",
      ...
      ]
      _
      2) Internal UNNEST testcase hits hard limit to test with larger arrays (with 1000 elements): https://issues.couchbase.com/browse/MB-21619

      3) https://forums.couchbase.com/t/different-result-set-when-using-the-use-index-hint/10273

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Build 5.0.0-2336 contains query commit b9c872eac66b17214820a8b79189d051b0a38b27 with commit message:
            MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates
            https://github.com/couchbase/query/commit/b9c872eac66b17214820a8b79189d051b0a38b27

            build-team Couchbase Build Team added a comment - Build 5.0.0-2336 contains query commit b9c872eac66b17214820a8b79189d051b0a38b27 with commit message: MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates https://github.com/couchbase/query/commit/b9c872eac66b17214820a8b79189d051b0a38b27

            Build 5.0.0-2337 contains query commit 7ad99b70de9aa363e26f9895716541f72b29c1b4 with commit message:
            MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates, take two
            https://github.com/couchbase/query/commit/7ad99b70de9aa363e26f9895716541f72b29c1b4

            build-team Couchbase Build Team added a comment - Build 5.0.0-2337 contains query commit 7ad99b70de9aa363e26f9895716541f72b29c1b4 with commit message: MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates, take two https://github.com/couchbase/query/commit/7ad99b70de9aa363e26f9895716541f72b29c1b4

            Build 4.6.2-3845 contains query commit a17dacac7c76d9cf8850925de0576d30dd246415 with commit message:
            MB-21770 MB-23372 Fix gap in covering array index
            https://github.com/couchbase/query/commit/a17dacac7c76d9cf8850925de0576d30dd246415

            build-team Couchbase Build Team added a comment - Build 4.6.2-3845 contains query commit a17dacac7c76d9cf8850925de0576d30dd246415 with commit message: MB-21770 MB-23372 Fix gap in covering array index https://github.com/couchbase/query/commit/a17dacac7c76d9cf8850925de0576d30dd246415

            Build 4.6.2-3845 contains query commit c031fa14ce06584500bbb129d54960dd876a2769 with commit message:
            MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates
            https://github.com/couchbase/query/commit/c031fa14ce06584500bbb129d54960dd876a2769

            build-team Couchbase Build Team added a comment - Build 4.6.2-3845 contains query commit c031fa14ce06584500bbb129d54960dd876a2769 with commit message: MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates https://github.com/couchbase/query/commit/c031fa14ce06584500bbb129d54960dd876a2769

            Build 4.6.2-3845 contains query commit efcfea63966ce55a4c1a9a9ce86f7cb354a65acb with commit message:
            MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates, take two
            https://github.com/couchbase/query/commit/efcfea63966ce55a4c1a9a9ce86f7cb354a65acb

            build-team Couchbase Build Team added a comment - Build 4.6.2-3845 contains query commit efcfea63966ce55a4c1a9a9ce86f7cb354a65acb with commit message: MB-21770 MB-23372 Fix gap in covering array indexes for LIKE predicates, take two https://github.com/couchbase/query/commit/efcfea63966ce55a4c1a9a9ce86f7cb354a65acb

            People

              Prerna.Manaktala Prerna Manaktala (Inactive)
              Prasad.Varakur Prasad Varakur
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty