Technical task

• [MB-2655] - Make a design for upgrade.
• [MB-3102] - Integrate existing 'library-only' javascript unit tests into continuous integration
• [MB-3103] - Implement basic functional tests for UI
• [MB-3104] - Cover UI error handling with automated tests
• [MB-7807] - aggregate all kinds of ops in ops/sec stat (was: Replica Reads don't show up in the UI)
• [MB-11655] - Stats: Getandlock doesn't show up in any operations
• [MB-25009] - Create test for registerCursorBySeqno

Bug

• [MB-1638] - tap.py doesn't exit gracefully
• [MB-1891] - Support for changing replica count on the fly
• [MB-2200] - Rebalance failed after remove node
• [MB-2245] - Upgrade Erlang to latest
• [MB-2262] - default data directory (/opt/membase/VER/data) appears fhs non-compliant
• [MB-2508] - disk persistence queue not draining
• [MB-19180] - Add event tracing support to forestdb using phosphor
• [MB-19969] - Log messages going to stderr, bypassing client log_callback
• [MB-20263] - [CX] Improved installation instructions
• [MB-20576] - [CX] SLF4J: Class path contains multiple SLF4J bindings.
• [MB-21008] - [CX] Need some ability to time out RPC responses
• [MB-21287] - [CX] Reingestion after restart of CBAS may result in data inconsistencies
• [MB-21357] - [CBAS] Roll-over logs daily and/or after reaching a configured size.
• [MB-21366] - [CX] Difference in result of select on escaped quote strings from n1ql
• [MB-21392] - [CX] Work on docs
• [MB-21469] - [CX] Errors and Exceptions seen in logs in simple scenario of starting,stopping cluster
• [MB-21473] - [CX] No message displayed for non json object in couchbase cluster
• [MB-21526] - [CX] Adress comments on SQL++ docs
• [MB-21530] - [CX] Finish keynote slides
• [MB-21553] - [CX] Work on demo
• [MB-21673] - [CX] Automatic generation of license files
• [MB-21894] - [CX] SQL++ summit
• [MB-21896] - [CX] Retain server logs for CBAS cluster for perf jenkins
• [MB-21897] - [CX] Decide on 'SHADOW' keyword
• [MB-21899] - [CX] Cleanup dependencies in asterixdb (as was done with hyracks, asterix-opt)
• [MB-22153] - [CX] Remove uses of tinyaccessor from production code
• [MB-22157] - [CX] Upgrade *DB SonarQube
• [MB-22165] - [CX] Reviews Sprint 35
• [MB-22359] - [CX] Review concurrent query/resource mgmt
• [MB-22360] - [CX] Review cluster/metadata lifecycle documents
• [MB-22361] - [CX] Reviews Sprint 36
• [MB-22392] - [CX] OSS Release Vetting
• [MB-22396] - [CX] Upgrade DCP client to 0.7.0
• [MB-22445] - [CX] Create release verification Jenkins job
• [MB-22590] - [CX] Audit Incorrect Uses Of SynchronizableWork
• [MB-22599] - [CX] Use error code for a new error message in CBDataset
• [MB-22745] - Semicolon is mandatory
• [MB-22746] - [CX] /query endpoint not available
• [MB-22788] - [CX] Automated signing of artifacts
• [MB-22888] - Create a test case which connects with wrong credentials then uses correct ones
• [MB-23042] - [CX] CBAS AWS performance test automation.
• [MB-23093] - [CX] Introduce ErrorCodes in CBAS
• [MB-23201] - [CX] remove pregelix hooks
• [MB-23216] - [CX] Need additional windows regression tests
• [MB-23292] - [CX] Restart backups of new Analytics Jenkins
• [MB-23307] - [CX] Update manifest to consume *DB from Apache git repo to eliminate dependency on GH mirroring
• [MB-23332] - [CX] Remove duplicate dependency declaration in cbas-connector pom
• [MB-23394] - [CX] Cleanup compiler error message
• [MB-23405] - [CX] Log version at process start (cc / nc)
• [MB-23922] - [CX] Cleanup storage level exceptions
• [MB-23923] - [CX] Enforce IFrameWriter protocol
• [MB-23924] - [CX] Remove the use of Static Node level singletons
• [MB-23958] - [CX] Migrate Build Server to CentOS 7
• [MB-24057] - [CX] Poster for NorCal DB day
• [MB-24080] - [CX] Add documentation for *DB's query/service API
• [MB-24171] - [CX] Slides for Connect NY
• [MB-24267] - S&T prep
• [MB-24385] - [CX] Add support for numeric literals in exponential notition
• [MB-24402] - [CX] Connect NY talk
• [MB-24936] - [CX] Investigate DCP flow control with slow consumer
• [MB-25472] - [CX] Recreate analytics-perf job for integrated build with Perf team
• [MB-25999] - [CX] Investigate perf difference for Docker Jenkins slaves
• [MB-27709] - last_modified can be incorrect due to CAS poisoning
• [MB-28250] - [CX] NullPointerException: null at org.apache.asterix.test.common.TestExecutor.cleanup
• [MB-32595] - [FTS] reuse/incorporate latest GSI memory-mgmt improvements into FTS
• [MB-33250] - [CX] Array-item access requires data copy in some cases
• [MB-41905] - FTS service does not provide statistic "items_count" for a given index (just doc_count which is different)
• [MB-42105] - [FTS-UI] Index defintion "preview" change detection

Epic

• [MB-2563] - Membase performance should not decrease over time (fragmentation)
• [MB-22022] - [CX] Performance/sizing
• [MB-24875] - Lower priority issues

Story

• [MB-2522] - As a user, I can rely on Membase not to overrun memory significantly even with small values so that I can use my memory efficiently.
• [MB-2542] - Identify where we need test frameworks
• [MB-2548] - Membase engineers can build the full product
• [MB-2550] - Convert full BAT to be run under automation
• [MB-2568] - Plan build approach
• [MB-2569] - Vbucket java client
• [MB-2570] - As a Membase user, I am notified when the data in my UI is stale so that I know whether I'm looking at current data.
• [MB-2577] - Enumerate environment/architecture/OS along with how deep we will test on each
• [MB-2585] - As a Membase developer, I can run automated unit tests of the JavaScript UI so that I can make sure things work without having to fire up the server and a browser to test.
• [MB-2592] - As a new-hire at membase, I'd like a standard, documented toolchain for development on OSX, so that I don't waste my first 2 months organically growing my dev box to the right state through trial & error.
• [MB-2603] - top-level-makefile needs a 'make install'
• [MB-2604] - As a web developer on OSX, I'd like an updated homebrew formula for membase, so that I can easily play with membase to decide whether to tell my boss that we should use membase
• [MB-2605] - integrate the new top-level makefile with voltron, so that developers and voltron are building the same exact thing
• [MB-2606] - build system to send email when a build breaks (BUT, (reopening) not too much email)
• [MB-2608] - As a membase open-source community user, I would like there to be regular builds for community membase
• [MB-2609] - As Dustin (or a unix guy), I wish there were separate packages for each component that do not fight the platform (o/s package managers), so that we can upgrade components in place, so that we can more quickly turn around support issues, so that we save $
• [MB-20766] - [CX] NC-to-NC Messaging networking parameters not configurable
• [MB-21484] - [CX] Eliminate dependency on Java Servlet API (javax.servlet:javax.servlet-api)

Task

• [MB-20269] - [CX] Prepare status
• [MB-20472] - [CX] Review/discussion memory management in hash-based operators
• [MB-20524] - [CX] Create Hyracks/*DB release
• [MB-20631] - [CX] Triage bugs
• [MB-20712] - [CX] CBAS integration tests should be self-contained, be able to manage docker lifecyle intrinsically
• [MB-20808] - [CX] Add tests that provide integer literals or boolean literals in the DDL
• [MB-20810] - [CX] Document the mapping of data/meta into CBAS
• [MB-20921] - [CX] Add tests for cbashelper
• [MB-21199] - [CX] Review SQL++ reference/function docs
• [MB-21306] - [CX] Code reviews
• [MB-21307] - [CX] Prepare for connect
• [MB-21394] - [CX] Review DP docs
• [MB-21478] - [CX] Reviews
• [MB-21494] - [CX] Cleanup class names (and stack traces)
• [MB-21518] - [CX] Clean up conventions for HTTP requests in tests
• [MB-21522] - [CX] Testing should be updated to be against 4.5.1
• [MB-21671] - [CX] Upgrade Gerrit
• [MB-22014] - MCBP documentation framework
• [MB-22026] - [CX] Automate setup of CB/loading of data for tests
• [MB-22027] - [CX] Lay out plan for long running tests
• [MB-22029] - [CX] Move long running ExceptionTest to integration tests
• [MB-22034] - [CX] Reviews Sprint 34
• [MB-22035] - [CX] specifying scalar functions that take arrays as input
• [MB-22080] - [CX] Discuss modularization of external data accessors in *DB
• [MB-22138] - [CX] Refactor exception handling in LSMInsertDeleteOperatorNodePushable
• [MB-22139] - [CX] Add test coverage for type cast failures in the ingestion pipeline
• [MB-22333] - [CX] Use CMake to run maven
• [MB-22338] - [CX] Avoid "Asterix" in class names of rewrite rules
• [MB-22339] - [CX] Replace "Asterix" in interface names with a more descriptive term
• [MB-22342] - [CX] Use more descriptive term instead of "Asterix" for class names in "common"
• [MB-22343] - [CX] Use more descriptive term instead of "Asterix" for class names in "runtime"
• [MB-22344] - [CX] Use more descriptive term instead of "Asterix" for class names in "om"
• [MB-22345] - [CX] Remove unused AsterixRuntimeComponentsProvider
• [MB-22346] - [CX] Use more descriptive term instead of "Asterix" for class names in "external data"
• [MB-22347] - [CX] Use more descriptive term instead of "Asterix" for class names in "app"
• [MB-22348] - [CX] Consider cleaning up class names in "experiments"
• [MB-22351] - Low level (Code level) EP-Engine Code Refactor tasks outlined
• [MB-22358] - [CX] Add licensing test cases
• [MB-22444] - [CX] Reviews Sprint 38
• [MB-23120] - [CX] Add regression tests for untested cluster state APIs
• [MB-23124] - [CX] add documentation for config framework (e.g. IConfigManager)
• [MB-23248] - [CX] Need test case for configurable execute queue length
• [MB-23249] - [CX] Need test case for configurable HTTP request queue length
• [MB-23309] - [CX] Split *DB Gerrit Verified job into parallel jobs
• [MB-23312] - [CX] Increase *DB slave capacity
• [MB-23331] - [CX] fix file encoding on cacofonix-*
• [MB-23333] - [CX] Add -v to docker rm commands to remove dangling volumes
• [MB-23334] - [CX] Split CBAS testing into parallel jobs
• [MB-23335] - [CX] Eliminate some needless stacktraces for expected exceptions in test output
• [MB-23336] - [CX] Add options to skip building asterix-installer, asterix-yarn, asterix-experiments
• [MB-23404] - [CX] Presentation for UCI
• [MB-23471] - [CX] Define rebalance docker hosts in CBAS docker-compose yml
• [MB-23472] - [CX] Refactor CBAS rebalance tests to also test DCP client only
• [MB-23539] - [CX] Add test for the retrieval of favicon.ico
• [MB-23931] - [FTS] Improve logging by using pkg/errors
• [MB-23955] - [CX] Prepare Meetup
• [MB-23956] - [CX] Prepare Meetup
• [MB-24005] - [CX] Open-source release (RC2) verification
• [MB-24064] - [CX] Prepare NorCal DB Day SQL++ Prezzo
• [MB-24153] - [CX] Test DCP Client NOOP handling
• [MB-24154] - [CX] Test dead connection detection in DCP client
• [MB-24266] - S&T prep
• [MB-24720] - [CX] Verify kill -9 on Analytics JVMs / 'cbas' executable
• [MB-24768] - [CX] 'asterix' nodes have wrong encoding
• [MB-24943] - [FTS] Do not log unwanted/less important stats into fts.log
• [MB-25492] - [CX] Review SQL++ Tutorial
• [MB-25747] - [CX] Add Jenkins job to validate re-versioned modules
• [MB-25810] - [CX] Add whitebox tests for rebalance servlet APIs
• [MB-25830] - [CX] Add rebalance stress tests
• [MB-26048] - [CX] New unhygienix docker slaves are over 2X slower than before
• [MB-26104] - [CX] Abort jobs started by CC on rebalance out
• [MB-26114] - [FTS] Cleanup the router initialization / code path
• [MB-26172] - [RocksDB] Build cbdeps for Windows
• [MB-26174] - [RocksDB] Implement Expiration for full-evicted documents
• [MB-26181] - [RocksDB] Implement Rollback
• [MB-26182] - [RocksDB] Implement efficient `getMulti`
• [MB-26238] - [CX] Perf: Mutation rates for perf testing
• [MB-26239] - [CX] Perf: Ratio of buckets to datasets
• [MB-26240] - [CX] Perf: Determine typical index definitions
• [MB-26241] - [CX] Perf: Determine typical filter conditions
• [MB-26242] - [CX] Perf: Determine query concurrency levels for performance testing
• [MB-26409] - [CX] Add licensing diff test to provide easy view of license changes since last release
• [MB-26659] - [CX] master.xml manifest changes should be verified by Jenkins
• [MB-26853] - [CX] Align coordinated changes with other development
• [MB-27746] - [CX] Add tests for resolving failures in storage side of ingestion
• [MB-28022] - [CX] unhygienix clock is ~3m slow
• [MB-28211] - [CX] add test for MB-27132
• [MB-28302] - [CX] Add test for shutdown log
• [MB-28543] - [CX] Add TopologyTests against vulcan
• [MB-28655] - [FTS] need to set up continuous integration for vellum project
• [MB-28697] - Fix ASTERIXDB-2317
• [MB-29534] - [CX] Remove code for external 4.x
• [MB-30059] - [CX] standalone manifest test job did not fail on Gerrit fetch failure
• [MB-30374] - Honour FTS Service Memory Quota
• [MB-30707] - [CX] Add test cases for purge handling
• [MB-30804] - [CX] Add dev tests for rebalance failure scenarios
• [MB-30932] - [CX] add test (framework) to scour logs for known bad patterns
• [MB-31200] - [CX] Configure Jenkins for basic verifications on 'vulcan-docs'
• [MB-31666] - [CX] Investigate handling of non-tree plans in rewrite rules
• [MB-31742] - [CX] Identify gaps between DCP clients
• [MB-32677] - [CX] Run open source integration tests with multiple JDKs (+= OpenJDK 11)
• [MB-32767] - [CX] Ensure analytics product & tests are independent of system locale
• [MB-33089] - [CX] Slides for Meetup
• [MB-33380] - [CX] Consider patch ability in analytics
• [MB-33695] - [CX] Define process for publishing maven plugins for *DB build consumption
• [MB-35635] - Manifest promotion on build-sanity test pass
• [MB-36058] - [CX] Add AWS scripts to cbas-perf-support git repository
• [MB-36725] - [CX] Investigate options for RQG for index creation and use
• [MB-37012] - [CX] Consider a more generic type computer for fixed output type computers
• [MB-37442] - [CX] Use toy builds for docker tests
• [MB-37803] - [CX] fix warnings in production build
• [MB-38026] - [CX] Add test for cbq's separation between batch and analytics mode
• [MB-38080] - [CX] Investigate multi-user performance scaling
• [MB-38225] - [CX] Wrong topic used in case of ssh error
• [MB-38355] - [CX] add test to ensure deauthorized nodes are unable to complete registration
• [MB-39295] - [CX] Investigate code related to Stream Readers and Delimited Data Parser
• [MB-40586] - [CX] Use Ceph instead of S3Mock for AWS S3 testing
• [MB-40799] - Consider using inferschema to generate Data Insights similar to Query Service
• [MB-44309] - [CX] Support for CLI aware docker container
• [MB-44465] - [CX] shift tests to ClusterSharedExecutionIT
• [MB-44593] - [CX] Add error code tests
• [MB-48254] - [CX] misc test suite refactoring
• [MB-58647] - Add promtimer dashboard(s) for analytics

Improvement

• [MB-1382] - should be able to grow and shrink memcache buckets
• [MB-2425] - Allow for dynamic setting of interval of purging of expired items
• [MB-2513] - Allow changing of node memory quota
• [MB-18968] - compaction continues even if flush
• [MB-19652] - Reduce memcpy overhead in forestdb
• [MB-20210] - [FTS] Improve Resource Containment
• [MB-20364] - Improve phosphor binary export support
• [MB-20481] - Allow forestdb_dump to print data in json
• [MB-20802] - [CX] Tests for scan after restart
• [MB-21058] - [CX] Redesign the record reader interface such as hasNext() should mean has next, and next should always return a value if hasNext() is true
• [MB-21171] - [CX] Suggest equivalent queries for SELECT * FROM system:<namespaces>,<indexes>,<keyspaces><datastore>
• [MB-21198] - [CX] Unify the messages for all type errors
• [MB-21523] - [CX] Perf test should deploy using Ansible Galaxy role
• [MB-22302] - [CX] Pick up dependency sets from binary assembly instead of duplicating them in license-automation-plugin configuration
• [MB-22304] - [CX] Consider ways to further de-duplicate in LICENSE file
• [MB-22383] - Use ProcessClock instead of hrtime_t, which cannot really wrap (and hence can remove the extra checks)
• [MB-22385] - Create VBucketBGFetchItem obj as a unique_ptr rather than as raw ptrs
• [MB-22386] - Investigate if it is necessary to pass engine or Taskable as a param while creating a task.
• [MB-22387] - Make (statically) return type of VBucket::addTempStoredValue to just NOMEM or BG_FETCH
• [MB-22420] - [CX] refactor buffer management in ingestion operator
• [MB-22513] - Check if Hash bucket is calculated multiple times (from the key) in the calls to hash table functions
• [MB-22521] - Move Hash Table memory accounting functions out of StoredValue class
• [MB-22690] - In SetWithMeta() calls consider folding cas param into itm param passed
• [MB-23184] - Traverse the Hashtable (hash bucket) only once to delete/release an item
• [MB-24465] - [CX] Test HTTP status codes
• [MB-24517] - [CX] Performance: avoid casting the whole record during index creation
• [MB-24621] - Warmup should see only the subclasses EPBucket and EPVBucket rather than their respective base classes
• [MB-25218] - Ephemeral: Handle DCP Backfill Dropping
• [MB-25499] - [CX] Avoid rebuilding docker image if there's an existing one
• [MB-25503] - [CX] Enable remote JVM debugging for docker containers started by test framework
• [MB-25544] - [CX] cbas-installer module should not create zip file for standalone distribution
• [MB-25601] - Split memcached_testapp into individual binaries per test suite
• [MB-27702] - [CX] [ASTERIXDB-2256] Auto-format *DB code to template
• [MB-28051] - [CX] Consider Alternatives For Waiting on Write Lock on Rebalance
• [MB-29073] - [FTS] Move stats dump to separate log file for cbcollect logs to reduce some clutter
• [MB-29434] - [CX] Add serialized constants for boolean TRUE/FALSE and MISSING values
• [MB-29497] - [CX] Remove trailing ".0" when printing float/double values
• [MB-29891] - [CX] Source locations follow up #2 - Make source locations final
• [MB-30086] - [CX] Replace byte-code generation
• [MB-33045] - Unify MockExecutorPool and SingleThreadedExecutorPool
• [MB-35241] - Add age histograms to eviction stats
• [MB-38448] - [Flex] Add support for CONTAINS
• [MB-53779] - Phosphor: Keep "important" spans for an increased period of time
• [MB-53781] - Phosphor: Mark the extent of available history

Edit/Copy Release Notes

The text area below allows the project release notes to be edited and copied to another document.