(DOCS-14769): Preparing changelog for 5.0.3

Author: jeff-allen-mongo

changelogs/generatechangelogs.py

@@ -63,7 +63,7 @@ def get_jira_issues(fixVersion):
     return issues
 
 
-def get_issue_structure(config, issues):
+def get_issue_structure(config, issues, version):
     """
     Group the JIRA issues by component. Structure headings and
     subheadings.
@@ -227,7 +227,7 @@ def main():
     config = get_config()
 
     # Generate issue headings based on component config
-    issue_headings = get_issue_structure(config, issues)
+    issue_headings = get_issue_structure(config, issues, fixVersion)
 
     # Convert the issue headings into rst
     changelog_rst = generate_changelog_rst(config, issue_headings, fixVersion)

config/changelog_conf.yaml

@@ -12,7 +12,9 @@ groups:
   "Query":
     - Querying
     - Query Execution
+    - Query Language
     - Indexing
+    - Index Maintenance
     - Geo
     - Text Search
   "Write Operations":
@@ -44,6 +46,7 @@ groups:
     - HTTP Console
   "Build and Packaging":
     - Build
+    - Build/compile
     - Packaging
     - Mobile
   "Internals":

source/includes/changelogs/releases/5.0.3.rst

@@ -0,0 +1,233 @@
+.. _5.0.3-changelog:
+
+5.0.3 Changelog
+---------------
+
+Security
+~~~~~~~~
+
+:issue:`SERVER-57716` Partial certificate chain in PEM causes validation failure in OCSP
+
+Sharding
+~~~~~~~~
+
+- :issue:`SERVER-27383` Require --replSet with --configsvr
+- :issue:`SERVER-50937` Make resharding coordinator support recovery
+- :issue:`SERVER-55824` Make ssl_get_more.js start shards as replicaset
+- :issue:`SERVER-57487` Update chunks during setFCV 4.4 «--» 5.0 must not block balancing for long periods
+- :issue:`SERVER-57953` _flushReshardingStateChange attempts to refresh shard version while another refresh already pending, leading to invariant failure
+- :issue:`SERVER-58081`  _flushReshardingStateChange from coordinator races with donor shard acquiring critical section, stalling the resharding operation
+- :issue:`SERVER-58315` Change jstests to not use standalone nodes as shards nor config server
+- :issue:`SERVER-58342` Allow specifying of reshardCollection zones to be empty
+- :issue:`SERVER-58603` ensureTempReshardingCollectionExistsWithIndexes may hit an invariant if collection was previously dropped
+- :issue:`SERVER-58702` Fix comment in ReshardingDataReplication and update its member declaration order
+- :issue:`SERVER-58720` DropDatabaseCoordinator must not re-execute destructive logic after removing CSRS metadata
+- :issue:`SERVER-58781` ReshardingCoordinatorObserver should not fulfill promises if the "donors" or "recipients" fields are empty
+- :issue:`SERVER-58868` Enable/Remove a commented moveChunk + AllowMigrations test
+- :issue:`SERVER-58917` Wait until donors/recipients are aware that coordinator has persisted decision before expecting successful collMod, createIndexes, and dropIndexes in resharding_prohibited_commands.js
+- :issue:`SERVER-58926` ReshardingDonor should not try to set the stop time of the critical section if it the critical section was already released
+- :issue:`SERVER-59114` ReshardingOplogFetcher stops fetching new oplog entries if remote donor shard responds with Interruption exception
+- :issue:`SERVER-59292` completion future can be set more than once because of WithAutomaticRetry
+
+Replication
+~~~~~~~~~~~
+
+- :issue:`SERVER-58133` Use split replication tasks because they are timing out because of "majority" implicit default write concern
+- :issue:`SERVER-58987` Fix read_only_test.js to avoid start point beyond end point during replication recovery.
+- :issue:`SERVER-59083` catchup_takeover_with_higher_config.js needs to be excluded from multiversion suite for last-continuous
+- :issue:`SERVER-59131` Wrap rawMongoProgramOutput search in an assert.soon in implicit_default_write_concern_upgrade_shards.js
+- :issue:`SERVER-59212` Make sure node stepped down before waiting for catchup takeover in catchup_takeover_with_higher_config.js
+- :issue:`SERVER-59478` Move serverStatus command before taking RSTL in catchup_takeover_with_higher_config.js
+
+Query
+~~~~~
+
+- :issue:`SERVER-54791` Excessive file descriptor usage during index build with external sort
+- :issue:`SERVER-57448` fix ExpressionParams::parseTwoDParams() to handle int values in key patterns that are out of bounds
+- :issue:`SERVER-57667` Improve processing speed for resharding's collection cloning pipeline
+
+Storage
+~~~~~~~
+
+:issue:`SERVER-58744` applyOps on capped collections can violate the multi-timestamp constraint
+
+Build and Packaging
+~~~~~~~~~~~~~~~~~~~
+
+:issue:`WT-7830` Migrate the python setup scripts to use cmake
+
+Internals
+~~~~~~~~~
+
+- :issue:`SERVER-52007` Create feature flag for Integration work to support new $search parameters
+- :issue:`SERVER-53001` Complete TODO listed in SERVER-47323
+- :issue:`SERVER-53437` Architecture Guide updates for Change the Default Write Concern to Majority
+- :issue:`SERVER-54735` Executor shutdown can cause AsyncTry-until to set its result with ErrorCodes::BrokenPromise
+- :issue:`SERVER-55589` replSetMaintenance command does not take the RSTL
+- :issue:`SERVER-55664` Support clustered _id indexes in ephemeralForTest
+- :issue:`SERVER-55760` Cancelation tests for AsyncTry are racy
+- :issue:`SERVER-55966` AsyncTry no longer handles exceptions from until() lambda, leading to process crash
+- :issue:`SERVER-56235` Evaluate index types that are dependent on a collection not being clustered, rather that it not being time-series
+- :issue:`SERVER-56492` Normalize time-series metadata with array type
+- :issue:`SERVER-56580` Promote build-tools=next to stable
+- :issue:`SERVER-56763` Validate collection epoch when not holding a DB lock for $merge
+- :issue:`SERVER-56800` Fail addShard if CWWC disagrees with existing CWWC on cluster
+- :issue:`SERVER-56844` Fassert shard server on startup if DWCF=w:1 and no CWWC set
+- :issue:`SERVER-56845` Fail addShard if DWCF=w:1 and no CWWC is set
+- :issue:`SERVER-56846` Fail reconfig for shard server if it would change DWCF and CWWC is not set
+- :issue:`SERVER-57086` Do not set inherited maxTimeMSOpOnly deadline on hello command in v4.4 
+- :issue:`SERVER-57140` Fix up perl relics from migrated shell scripts
+- :issue:`SERVER-57262` Allow nodes to vote for candidates with higher config
+- :issue:`SERVER-57279` Update the FCV constant in the logkeeper snapshot workload
+- :issue:`SERVER-57360` Log additional debug info for the "invariant (_requests.empty());" in ~LockerImpl
+- :issue:`SERVER-57387` create_view_does_not_take_database_X.js should check its insert
+- :issue:`SERVER-57435` Exclude views_coll_stats.js from causally_consistent test suites
+- :issue:`SERVER-57465` remove_newly_added_field_after_finishing_initial_sync.js does not wait until the new configuration has been replicated
+- :issue:`SERVER-57520` Make set_audit_config.js test start shard as replicaset
+- :issue:`SERVER-57575` Investigate create_view_does_not_take_database_X.js failures on Windows
+- :issue:`SERVER-57585` oplog_visibility.js prints null 'next' timestamp for missing oplog entry
+- :issue:`SERVER-57599` DocumentSourceBucketAuto returning eof when disposed
+- :issue:`SERVER-57615` Reset CWWC to w:majority for tests that don't create/stop the replica set
+- :issue:`SERVER-57616` Wait for secondary to load signing keys in disable_cluster_time_gossiping_in_unreadable_state.js
+- :issue:`SERVER-57617` Have the OplogFetcher in Tenant Migrations do an aggregation query instead of a find
+- :issue:`SERVER-57630` Enable SSL_OP_NO_RENEGOTIATION on Ubuntu 18.04 when running against OpenSSL 1.1.1
+- :issue:`SERVER-57651` Prevent integer overflow in Query Planner parsing of hint parameter
+- :issue:`SERVER-57657` disable_cluster_time_gossiping_in_unreadable_state.js shouldn't modify a response's $clusterTime
+- :issue:`SERVER-57700` Measure latency/throughput of resharding::data_copy::fillBatchForInsert in ReshardingCollectionCloner::doOneBatch
+- :issue:`SERVER-57737` The index builds code path can throw WCEs and invalidate an active cursor by calling abandonSnapshot without calling save/restore cursor.
+- :issue:`SERVER-57740` ShardingTest use X509 also with preferTLS mode
+- :issue:`SERVER-58051` Mongod.exe does not release file handles on rotated logs on windows 10
+- :issue:`SERVER-58060` Add new aggregation stage to downconvert RRFaM images to oplog entries
+- :issue:`SERVER-58068` Multi updates interrupted by a tenant migration should wait for the migration to complete
+- :issue:`SERVER-58119` single_node_set_new_hostname.js needs to call replSetReconfig with an assert.soonNoExcept
+- :issue:`SERVER-58152` Create Feature flag for Remove Faulty Mongos From Cluster Topology
+- :issue:`SERVER-58160` Increase egress timeout in cluster_x509_roate.js
+- :issue:`SERVER-58184` Checkpoint thread causes assertions when raced with recovering prepared transactions on startup
+- :issue:`SERVER-58264` Only run cron jobs in Evergreen on the master branch
+- :issue:`SERVER-58293` mongocryptd does not include server API fields in explain command response
+- :issue:`SERVER-58353` Fix disabled Replication tests failing in multiversion suites due to changing latest release to 5.1
+- :issue:`SERVER-58392` Unpin durable history on rollback to refetch
+- :issue:`SERVER-58399` Duplicate errInfo field in write errors when operation fails document validation
+- :issue:`SERVER-58402` Increase timeout of shutdown command in shutdown_primary.js
+- :issue:`SERVER-58420` Gracefully handle the demotion of data-types in umask
+- :issue:`SERVER-58432` Include dochub link in log line 5578800 when warning about deprecation/removal of old op codes
+- :issue:`SERVER-58438` Tenant migration retryable write prefetching pipeline could be very slow under load
+- :issue:`SERVER-58464` Invariant failure during time-series insert with concurrent shutdown
+- :issue:`SERVER-58565` Adjust timeout for replica_sets_jscore_passthrough
+- :issue:`SERVER-58581` Add SEARCH_META variable that populates from mongot
+- :issue:`SERVER-58582` Create $documents stage and implement collectionless unionWith
+- :issue:`SERVER-58588` Implement $searchMeta stage
+- :issue:`SERVER-58594` ReplicationCoordinatorImpl::handleHeartbeatResponse_forTest doesn't use _mutex when reading _rsConfig
+- :issue:`SERVER-58620` New recipient primary can complete migration before donor renames collection in tenant_migration_resume_collection_cloner_after_rename.js
+- :issue:`SERVER-58626` Mark capped_max1 as tenant_migration_incompatible.
+- :issue:`SERVER-58637` Temporarily disable null_query_semantics.js from multiversion passthroughs
+- :issue:`SERVER-58669` createIndexes, dropIndexes, and collMod may still fail with ReshardCollectionInProgress after resharding operation completes
+- :issue:`SERVER-58676` Ban pipelines that set SEARCH_META variable in sharded collections
+- :issue:`SERVER-58682` check_todos.py should be no-oping in the waterfall
+- :issue:`SERVER-58698` [Linux Repeated Execution builder] disable concurrency_replication_multi_stmt_txn
+- :issue:`SERVER-58740` Reserve multiple oplog slots when writing retryable findAndModify with storeFindAndModifyImagesInSideCollection=true
+- :issue:`SERVER-58806` Use replica_sets_jscore_passthrough_gen task on Enterprise MacOS
+- :issue:`SERVER-58812` tenant_migration_timeseries_retryable_write_oplog_cloning.js should get donorDoc before being garbage collected
+- :issue:`SERVER-58815` Have internal findAndModifyImageLookup set the synthetic oplog entry to timestamp of findAndModify - 1
+- :issue:`SERVER-58823` The refineShardKey command should mark its operation context as interruptible at step down/step up
+- :issue:`SERVER-58855` Improve/Fix the Race Condition in out_max_time_ms.js
+- :issue:`SERVER-58857` Change stream accidentally filters out rename event from reshardCollection [5.0 Only]
+- :issue:`SERVER-58886` Allow 'vars' result to be returned from a sharded search query but fail on SEARCH_META access
+- :issue:`SERVER-58898` Prevent writing to "local" db from waiting for writeConcern
+- :issue:`SERVER-58904` Escaped or single-quoted DESTDIR causes malformed .ninja and resmoke.ini
+- :issue:`SERVER-58919` sharding_jscore_passthrough_wire_ops_gen needs to be marked as a generated task.
+- :issue:`SERVER-58948` idl_tool: support generated idls
+- :issue:`SERVER-58973` Fix failure deprecated_wire_ops_mongos.js with v5.0 windows debug build
+- :issue:`SERVER-58984` awaitable_hello_fcv_change.js doesn't account for window between awaitable hello requests due to reconfig
+- :issue:`SERVER-59000` Enforce dependencies for generated tasks
+- :issue:`SERVER-59025` Increase storage log verbosity in oplog_slow_sampling_logging.js
+- :issue:`SERVER-59040` add operations_longer_than_stepdown_interval tag to background_unique_indexes.js
+- :issue:`SERVER-59044` Handle empty time series collection for $sample in the TrialStage
+- :issue:`SERVER-59056` [5.0] Fix primary check in timeseries_retryable_write_downgrade.js
+- :issue:`SERVER-59071` Using $sample can trigger invariant when connecting directly to shards
+- :issue:`SERVER-59091` Avoid fetching namespace from durable catalog for every key inserted in index build
+- :issue:`SERVER-59093` Temporarily disable the failing jstest suite for ephemeralForTest on evergreen
+- :issue:`SERVER-59101` remove unnecessary LIBDEPS edge from pipeline library
+- :issue:`SERVER-59117` xcode next builders hit dyld 512 library limit
+- :issue:`SERVER-59121` ssh connection failure during check_disk command in powercycle should cause ssh failure exit
+- :issue:`SERVER-59135` Make mongocryptd targets in MSIs depend on libsasl2
+- :issue:`SERVER-59158` Support running checkFCV() shell helper with mongos connection
+- :issue:`SERVER-59188` Coverity analysis defect 120391: Uninitialized scalar field
+- :issue:`SERVER-59197` Delete fam image entries when the corresponding session documents are deleted
+- :issue:`SERVER-59203` Don't rely on mocks to test generating tasks for build variants
+- :issue:`SERVER-59204` unowned filter BSONObj stored in PlanCache entry debugInfo
+- :issue:`SERVER-59217` convert spaces to tabs for package files
+- :issue:`SERVER-59236` Add function to legacy shell to recursively copy directories
+- :issue:`SERVER-59242` update to snmp 5.9.1
+- :issue:`SERVER-59291` Consider adding 'enableSearchMeta' query knob
+- :issue:`SERVER-59324` Remove feature flag performance variant from sys-perf on 5.0. 
+- :issue:`SERVER-59353` Have shell strip featureFlagRetryableFindAndModify when launching mongod version <= 4.4
+- :issue:`SERVER-59362` Setup Fault Manager State Machine
+- :issue:`SERVER-59404` Avoid powercycle_smoke_skip_compile reaching task timeout
+- :issue:`SERVER-59431` [v5.0] disable parallel task in EFT builder
+- :issue:`SERVER-59516` Create opCtx outside of lock in oplog fetcher
+- :issue:`SERVER-59573` Add setParameter which can be used to restore inactive cursor timeout in sessions
+- :issue:`SERVER-59640` [5.0] Add coverage for geoSearch command in views_all_commands.js test
+- :issue:`WT-6755` Documentation: populate developer glossary
+- :issue:`WT-6910` Write "history store" subpage for Architecture Guide
+- :issue:`WT-6911` Write "block manager" subpage for Architecture Guide
+- :issue:`WT-6915` Write "log files" subpage for Architecture Guide
+- :issue:`WT-7006` Write Connection subpage for Architecture Guide
+- :issue:`WT-7007` Backup architecture guide page
+- :issue:`WT-7198` Fix test_backup15 failure with backup mismatch
+- :issue:`WT-7352` Fix test_hs01 conflict between concurrent operations in cursor modify
+- :issue:`WT-7363` Add support for dumping history store output in hex format
+- :issue:`WT-7521` Remove excess ckplist invalidations
+- :issue:`WT-7592` Remove log_flush("sync=background") support
+- :issue:`WT-7599` Update the CONFIG file based on the release that is about to run for compatibility tests
+- :issue:`WT-7663` Change local store extension to allow only readonly FS operations
+- :issue:`WT-7673` Investigate and fix manydbs test failure on Windows
+- :issue:`WT-7718` Rename 'build_cmake'
+- :issue:`WT-7838` Ability for ordered timestamp assertion to do more than a log message
+- :issue:`WT-7842` Remove explicit ulimit -n call in many-collection-test
+- :issue:`WT-7860` Improve code coverage reporting
+- :issue:`WT-7866` Update cache_hs_insert limits in cppsuite-hs-cleanup-stress
+- :issue:`WT-7876` Update rollback to stable test to use correct boolean values and update statistic checking logic
+- :issue:`WT-7880` Fix history store record issue when the update following the prepared update is in history store
+- :issue:`WT-7891` Remove doc typos
+- :issue:`WT-7893` Remove ignored message from wiredtiger_open in test_encrypt08
+- :issue:`WT-7895` Fix arch-data-file.dox documentation build failure
+- :issue:`WT-7897` Enable verbose logging for test_backup15 to aid debugging
+- :issue:`WT-7900` Fix insertion of new records in test format for column-store
+- :issue:`WT-7901` test suite cleanup
+- :issue:`WT-7905` Fix incorrect builtin behaviour for builds in CMake
+- :issue:`WT-7907` Add dependencies to swig module definition in CMake build
+- :issue:`WT-7908` Make variable-length column store work again with the static tests
+- :issue:`WT-7909` Create a new method to check for running user transactions before starting rollback-to-stable operation
+- :issue:`WT-7918` Support setting a prepare timestamp at current read timestamp
+- :issue:`WT-7928` VLCS checkpoint and additional test suite improvements
+- :issue:`WT-7931` Evicting modifies using the evict cursor in test_multiple_older_readers_with_multiple_mixed_mode() to ensure that eviction happens.
+- :issue:`WT-7934` Upload perf results from many-collection test to Altas
+- :issue:`WT-7935` Add arm64 implementation of rdtsc equivalent instruction
+- :issue:`WT-7936` Update the format.sh script to run recovery tests
+- :issue:`WT-7937` Fix s_docs to use sh, not bash syntax
+- :issue:`WT-7938` Fix rollback-to-stable memory leak on error
+- :issue:`WT-7940` Update mongod path for many-coll test
+- :issue:`WT-7941` Add an Evergreen task to test abort/recovery using test/format 
+- :issue:`WT-7943` Do not assert timestamps when rolling back a prepared transactions
+- :issue:`WT-7945` Move rollback handling to the operation layer in the cppsuite.
+- :issue:`WT-7947` Allow CMake to take in a specific Python version
+- :issue:`WT-7952` Minor docs build fixes
+- :issue:`WT-7953` Teach s_string to not look inside getopt option lists.
+- :issue:`WT-7955` Copy format.sh and CONFIG.stress to the test/format build directory with CMake
+- :issue:`WT-7956` RTS to skip deleted or stable RLE cells
+- :issue:`WT-7961` Sometimes lag oldest timestamp in timestamp_abort.
+- :issue:`WT-7964` Fix rollback to stable incorrectly not rolling back updates at snap_max
+- :issue:`WT-7965` Update connection base write generation number at the end of recovery checkpoint
+- :issue:`WT-7968` In timestamp_abort skip setting timestamps when all_durable moves backwards
+- :issue:`WT-7970` Set the stable timestamp before starting the checkpointer and clock threads
+- :issue:`WT-7974` More column-store fixes and tests
+- :issue:`WT-7984` Fix a bug that could cause a checkpoint to omit a page of data
+- :issue:`WT-7994` Add docs compile task to PR testing
+- :issue:`WT-7995` Fix the global visibility that it cannot go beyond checkpoint visibility
+- :issue:`WT-7996` More column-store C testing
+- :issue:`WT-7998` Minor fixes on Cache subpage of Architecture Guide
+- :issue:`WT-7999` Fix the assert to handle an update in the middle with max stop timestamp
+- :issue:`WT-8005` Fix a prepare commit bug that could leave the history store entry unresolved
+- :issue:`WT-8006` sync/checkpoint cleanup code isn't appropriate for VLCS
+

source/release-notes/5.0-changelog.txt

@@ -10,6 +10,8 @@
    :depth: 1
    :class: singlecol
 
+.. include:: /includes/changelogs/releases/5.0.3.rst
+
 .. include:: /includes/changelogs/releases/5.0.2.rst
 
 .. include:: /includes/changelogs/releases/5.0.1.rst