What's new in the v2.13 latest release series
Included here are the release notes for all releases in the v2.13 release series. Content will be added as new notable features and changes are available in the patch releases of the v2.13 release series.
For an RSS feed of the release notes for all release series, point your feed reader to the RSS feed for releases.
v2.13.0.0 - March 7, 2022
Build: 2.13.0.0-b42
Downloads
Docker
docker pull yugabytedb/yugabyte:2.13.0.0-b42
New Features
Yugabyte Platform
-
[PLAT-1670] Oracle Enterprise Linux 7 Support
-
[PLAT-2365] [UI] Filters and sorting on alert configuration page
-
[PLAT-2405] Add and edit Gflags in universe creation
-
[PLAT-2515] [PLAT-2509] [PLAT-2507] New xCluster UI
-
[PLAT-2575] Support for Hashicorp Vault PKI for TLS certificates (EncryptionInTransit)
-
[PLAT-2591] YSQL_DUMP based backup-create and backup-restore
-
[PLAT-2615] UI Support for LDAP
-
[PLAT-2619] Azure provider to support multiple subscriptions
-
[PLAT-2627] Allow multi-keyspace backups in new backups API
-
[PLAT-2658] Integrate t3 instance type support
-
[PLAT-2743] [UI] Add alerts to the Universe page
-
[PLAT-2755] G-flag improvements, error handling and fixes
-
[PLAT-2766] Can now delete paused gcp instances
-
[PLAT-2799] [PLAT-2816] [PLAT-2987] UI implementation for OIDC configuration
-
[PLAT-2953] Add Service Account support for LDAP
-
[PLAT-2963] Filter Gflags in Add Gflag dropdown.
-
[PLAT-2964] Hashicorp Vault support is available by default.
-
[PLAT-2994] Support date range filtering for universe logs
-
[PLAT-3002] Equinix KMS is now deprecated
-
APIs:
- [PLAT-2383] New Delete Backup APIs
- [PLAT-2384] Get and List Backups API
- [PLAT-2385] Edit backup API changes
- [PLAT-2387] Create and List Schedule API
- [PLAT-2390] New Delete Schedule API
- [PLAT-2391] Edit the backup schedule API
- [PLAT-2670] New Delete Customer Configuration API
- [PLAT-2845] Added a new API endpoint to create self signed certificates
- [PLAT-2993] Add the "List Support Bundles" API
Database
- [1931] [CDC] Add command in yb-admin to support set WAL retention
- [2040] [YSQL] Framework for expression pushdown
- [4873] [YSQL] Support backup/restore for multi-tablet range-split relations
- [9019] Change Data Capture: Client API and Java Console Subscriber
- [9950] [YSQL] Add support for TRUNCATE table RESTART IDENTITY and CONTINUE IDENTITY
- [10330] [YSQL] Add cluster tag to Postgres logs
- [10331] [YSQL] Ability to suppress .cc logging in postgresql* files
- [10513] [DocDB] Adding file deletion option to universal compaction picker (TTL expiry)
- [10783] [Geo] Automatic creation of transaction status tables
- [11157] [xCluster] xcluster tablegroup replication
- [11294] [DocDB] Support use of MonoTime for understanding latencies better
- [11353] [Geo] Create transaction tables automatically with tablespace update
- [11383] [YSQL] Backup/Restore support for UDT/Enum types
- [11448] yb-admin: Add option to list all followers of tablets in list_tablets
Improvements
Yugabyte Platform
- [PLAT-131] Added custom cert validation for preflight checks
- [PLAT-134] Preflight checks for Azure backup configuration creation
- [PLAT-580] Allow multiple xcluster between same source/target pair
- [PLAT-580] Include lag metric data in xcluster GET response
- [PLAT-1865] add filtering provider by name to list endpoint
- [PLAT-1871] Add TTl/expiration for support bundle
- [PLAT-1926] GP: Backups handling
- [PLAT-2164] Make ReadOnlyClusterCreate retryable
- [PLAT-2366] [UI] Suspend alerts during maintenance window
- [PLAT-2379] [PLAT-2386] Rewrite the backup restore code
- [PLAT-2449] Enable smart instance resizing as part of "edit universe" action
- [PLAT-2530] Use DB transaction to lock Universe and any DB changes in the callback during the locking
- [PLAT-2553] Node Comparison Feature in Metrics Page (Backend)
- [PLAT-2588] Task Improvement - Make Backup task clean up processes on abort
- [PLAT-2593] Support change in ownership of the DB during restore operation
- [PLAT-2603] Migration - Support multiple backup types
- [PLAT-2608] UTs for RestoreManagerYb
- [PLAT-2611] Use rootCA expiry date when generating node certificates
- [PLAT-2613] Adding a runtime configuration flag to retain shellprocess cmdOutputLogs.
- [PLAT-2641] Task Improvement - CreateUniverse retry for on-prem nodes does not work due to precheck failure
- [PLAT-2673] Validating custom keypair with AWS
- [PLAT-2719] Allow path style access for non-standard endpoints in S3 backup configurations
- [PLAT-2736] Add feature flag for path style access in S3 backup configuration
- [PLAT-2769] [UI] Migrate User Listing from Profile Page to User Management Tab
- [PLAT-2772] Accept additional parameters in CreateUniverse API for custom AMI flow from Cloud
- [PLAT-2784] Add support for dev db-versions while listing Gflags
- [PLAT-2785] Add description to maintenance window
- [PLAT-2802] [UI] Banner to indicate the User page has moved under admin
- [PLAT-2805] Default OIDC runtime configuration to static conf
- [PLAT-2810] Simplifying adding instance types for AWS
- [PLAT-2856] Remove PostgreSQL metrics storage.
- [PLAT-2856] Use threads instead of processes for health checks parallelism
- [PLAT-2890] Add 2.12 major db version gflags metadata
- [PLAT-2905] [UI] Support for Creating Hashicorp Vault Cert in Encryption at Transit
- [PLAT-2906] [UI] Support for Edit Hashicorp Vault Cert in Encryption at Transit
- [PLAT-2935] Bump up timeouts for API calls which need master leader to be available.
- [PLAT-2978] Change Hashicorp Vault KEK to have name such that it can be used between multiple configurations as long as the configuration parameters matches.
- [PLAT-2985] [PLAT-2926] Adding delay and show warning message on non rolling selection
- [PLAT-3010] Update Azure images to support Azure time sync by default
- [PLAT-3014] UTs for Create Backup
- [PLAT-3019] Make alert configuration name filter match on name part and be case insensitive
- [PLAT-3036] Task Improvement - Improve task listing API performance
- [PLAT-3059] Add LDAPS and StartTls Support
- [PLAT-3075] [UI] Support for TLS/SSL
- [PLAT-3077] Populate backup entries with backup size
- [PLAT-3095] [LDAP] [UI] Label and Tooltip Changes
- [PLAT-3106] [PLAT-3096] HashicorpVaultConfigParams handling
- [PLAT-3107] Alert in case token in Hashicorp Vault configuration is close to expiry
- [PLAT-3144] Enable leader blacklisting by default
- [PLAT-3170] Filter backups on actionType field in listing API query
- [PLAT-3187] Exclude prometheusv2 directory from platform backup tar
- [PLAT-3199] [UI] Enable options to download CA and client cert for the Hashicorp (Backend support exists)
- [PLAT-3221] G-Flag metadata for 2.13 db version
- [PLAT-3272] Support Bundle json_alias and convert utilities to singleton
- [Platform] [Kubernetes] Use az.updateConfig for in-cluster credentials (#10928)
- [Platform] Updated the azcopy and node-exporter version (#11375)
Database
- [1805] [DocDB] Added metrics to track compaction tasks, files, and bytes split by active, paused, and queued.
- [3637] [DocDB] Updated Pause and Resume Logs to Include Compaction Job ID
- [6428] [DST] Ensure uniform distribution of tablets right at create table time
- [8023] [11142] [YQL] Enable DocDB to process lookups on a subset of the range key
- [8732] [YSQL] [Backups] [Geo] Storing Geo-Partitioned Backups to Regional Object Storage Buckets
- [8892] [11465] [11369] [DocDB] yb_backup performance improvements for large number of tablets
- [9387] [YBase] Add a tool to unsafely recover from loss of majority replicas
- [9468] [YSQL] Ensure clients don't see serialization errors in READ COMMITTED isolation (Part-3)
- [10243] Add gflag for tcmalloc gc release threshold. Auto-tune mem_tracker_tcmalloc_gc_release_bytes.
- [10536] [10828] [Geo] Consolidate TS txn status tablet cache update into one RPC
- [10709] [YBase] Add a background task to retire old metrics.
- [10730] [xCluster] Add force option to delete_CDC_streams CLI
- [10842] [DocDB] Use same drive for wal and data tablet files
- [10874] [xCluster] [DocDB] Support tablet splits on the producer
- [10900] [YBase] Allow the user to specify the UUID for master removal
- [10912] Send truncate colocated requests for the indexes associated with the table
- [10932] Various improvements for clusters with skewed clock
- [11149] [DocDB] sst_dump: show table properties
- [11185] [DocDB] added local server time to internal server UI footer
- [11266] [YSQL] Use session flag to set non transactional writes for index inserts
- [11274] [YSQL] Add connection metrics to SQL server Prometheus endpoint
- [11398] [YBase] Autotune server_tcmalloc_max_total_thread_cache_bytes better
- [11432] [YCQL] Move batch id generator as field of AuditLogger
- [11480] [YSQL] Import Fix memory leak in IndexScan node with reordering
- [11513] [YSQL] Parallelize read requests with remote filter
- [adhoc] [DST] Return PublicAddressAllowed directly from UsePublicIp.
- [DST] Change modify_placement_info of yb-admin to specify number of copies of each Cloud.Region.Zone (#11037)
- [YSQL] add extra metric for SingleShardTransaction metric
- [YSQL] add gflag log_ysql_catalog_versions
- [YSQL] Rename SingleShardTransaction metric name
Bug Fixes
Yugabyte Platform
- [PLAT-580] Fix sync API bug with previously-existing xcluster configs
- [PLAT-1770] Incorrect Status in UI for a failed task
- [PLAT-1786] Disabled releases should not appear while creating universe
- [PLAT-2224] Disable renaming of table during restore flow.
- [PLAT-2240] GP: Correct data replicas allocation when default region is defined
- [PLAT-2241] [Backups] Replace non-unicode symbols in a tool output decode
- [PLAT-2508] [xCluster] Missing graph view at Replication tab UI
- [PLAT-2518] Fixing ulimits for systemd universes
- [PLAT-2523] Onprem: Remove/Add node leaves the platform "node_instance" Postgres DB table in a corrupted state
- [PLAT-2537] Fix alert count for read-only user
- [PLAT-2547] Fix resize and pause for universes
- [PLAT-2558] [UI] Edit Read Replica Button failing
- [PLAT-2566] [UI] Unable to create Read Replica until reselect provider (no accessKeyCode in payload)
- [PLAT-2585] Fix the metrics inconsistency
- [PLAT-2617] Adding dbname additionally while connecting ysqlsh
- [PLAT-2622] Allow adding instance with trailing slash in address
- [PLAT-2625] [HA] [UI] Change the button to "paste" instead of "copy" in Key field of Standby Nodes
- [PLAT-2634] Fix xcluster APIs for HA-enabled platform deployments
- [PLAT-2643] [LDAP] [UI] Actions -> Edit Roles against a user should be disabled if that user is a LDAP user
- [PLAT-2643] Persistent local role for LDAP user
- [PLAT-2645] Make LDAP User Non-Primary
- [PLAT-2646] [LDAP] [UI] Hide password fields for LDAP Users
- [PLAT-2658] Validation for Hashicorp Vault address field not working
- [PLAT-2664] {"updateInProgress": " true"} fails to reset on task failure
- [PLAT-2672] Skip system_platform DB in 'All namespaces' YSQL backup
- [PLAT-2679] [PLAT-2686] [PLAT-2682] gflag feature and universe creation ui bugs
- [PLAT-2681] Hashicorp configuration - attempting to add a configuration fails when transit mount path specified does not have any keys
- [PLAT-2690] Run upgrade_ysql during universe upgrade
- [PLAT-2692] Platform LDAP Fixes
- [PLAT-2699] Hide Vault configurations on KMS Listing and Universe Manage Encryption at-Rest ( based on feature flag )
- [PLAT-2700] Fix OOM kills alert for cron universe + fix QueryAlerts execution
- [PLAT-2701] Instances getting added to incorrect provider in onprem multi-provider config
- [PLAT-2705] Platform restart can leave some tasks in incomplete stuck state
- [PLAT-2709] [PLAT-2722] Build error and gflag editor option ux improvement
- [PLAT-2720] Change default instance type to c5.4xlarge in universe creation
- [PLAT-2729] Move OIDC to runtime config
- [PLAT-2746] Use kubernetes java client instead of kubectl command line
- [PLAT-2747] Modify gflags override task during various action for shell mode
- [PLAT-2752] Increase running task beating time interval from 1sec to 10secs.
- [PLAT-2763] DestroyUniverse leaks instance in cloud provider if Platform exits before the node IP is updated.
- [PLAT-2765] Redact GCP creds in provider creation audit log
- [PLAT-2767] Exception is logged repetately for paused universe due to attempt to send universe keys to nodes.
- [PLAT-2779] [PLAT-2780] Gflag UI clean up and enhancemnts
- [PLAT-2790] RunYsqlUpgrade subtask should not be run on upgrades of universes with YSQL disabled
- [PLAT-2813] Local changes in Universe object in transaction in lockUniverse are overwritten by another fetch of the Universe from DB into a different object.
- [PLAT-2848] [PLAT-3072] Clean exit handler terminate pools on exit and shutdown logging
- [PLAT-2858] Restore fails as universe key cannot be decrypted using new universe.
- [PLAT-2896] Universe upgrade failed due to "Error running upgrade_[YSQL] Network
- [PLAT-2903] UI breaks if the value for a flag is a large string.
- [PLAT-2911] Remove the email check for LDAP users
- [PlAT-2916] Delete LDAP User when User does not exist on Windows AD server
- [PLAT-2920] [Alert] UI Issues in New Alert filter in Alert Policies tab
- [PLAT-2947] [Alerts] [UI] UI Issues in Alert Maintenance Screen
- [PLAT-2949] On-Exit we platform should fail pending tasks with Abort state
- [PLAT-2952] Refactored support bundle to extend to other files
- [PLAT-2972] [PLAT-2971] Gflag usability issues
- [PLAT-2975] Return Backup size from yb_backup script
- [PLAT-2982] Fix Most used master gflag response error.
- [PLAT-2983] issues with edit gflag modal
- [PLAT-2986] [PLAT-2997] LDAP toggle usability issues and UI support for Service Account
- [PLAT-2999] Unset the universeLocked flag in UniverseTaskBase when unlockUniverse is successful
- [PLAT-3005] [UI] xcluster Replication tab crash
- [PLAT-3007] Redirect to yb url for OIDC auth
- [PLAT-3037] [PLAT-3039] [PLAT-3046] UI invalidates a correct LDAP URL, tooltip and label change
- [PLAT-3041] Fix runtime configuration logging for LDAP and OIDC
- [PLAT-3050] [UI] Universe Metrics -> Replication graph is empty
- [PLAT-3072] [PLAT-2848] [PLAT-2832] Limit Shell process output to 2MB
- [PLAT-3080] Abort V2 backups using task framework
- [PLAT-3084] UI doesn't send the payload with "false" when we set ldap_enable_start_tls and enable_ldaps
- [PLAT-3090] Universe is in locked state after GFlagsUpgrade fails in ModifyBlackListTask subtask
- [PLAT-3097] Fix preflight check for manual provisioned nodes
- [PLAT-3101] [xCluster] Timezone mismatch in different tabs of xCluster(Replication Tab)
- [PLAT-3105] [PLAT-3101] [PLAT-3103] [PLAT-3102] [PLAT-3105] Fixed mutliple Xcluster UI issues
- [PLAT-3107] Merge issue fix
- [PLAT-3111] Replace exception with warning in yb_backup
- [PLAT-3112] Wrong Task Type on UI for add read replica retry after an abort
- [PLAT-3124] Smart resize doesn't check that current instance has ephemeral drives
- [PLAT-3128] Fix Support Origin URL default
- [PLAT-3133] Azure backups failure because of SSH commands bundling
- [PLAT-3146] Delete orphaned/unattached resources on Azure when the instance is not created due to failure
- [PLAT-3168] Instances are left behind if AddNodeToUniverse fails followed by delete node task.
- [PLAT-3169] [PLAT-3171] Use provider KUBECONFIG in NodeUniverseManager (#11550)
- [PLAT-3184] Invalid Credentials when saving AWS KMS config
- [PLAT-3188] client certificates are not updated in $HOME/.yugabytedb dir due to which Health check fails.
- [PLAT-3188] Fix health check failure after cert rotation
- [PLAT-3213] Fixed "PLAT-2994 broken universe creation"
- [PLAT-3215] Fix overload alerts
- [PLAT-3223] Make backup GC interval a static runtime config
- [PLAT-3228] Atomically set task state with error message for failed and aborted tasks in TaskExecutor.
- [PLAT-3231] Fix running YSQL upgrade on 2.9 release
- [PLAT-3232] UI doesn't allow to change the preferred AZ during Edit Universe of a multi-region universe
- [PLAT-3237] List backup minor fixes
- [PLAT-3242] Fix client certificate usage
- [PLAT-3254] Universe creation on GCP is failing if scratch SSD is used
Database
- [499] [DocDB] Fixed overflow bug when printing records in during a compaction.
- [4692] [YSQL] Stop scan before the client timeout
- [8206] [DST] Allow DeleteTable to succeed even if one of its tablets present on a DEAD tserver
- [8980] [DST] Fix AutomaticTabletSplittingMovesToNextPhase and WriteRows helper to write data transactionally
- [9421] [xCluster] Disallowing drop or truncate tables
- [9877] [DocDB] Fix xCluster Stream Deletion Race Condition
- [10162] [DST] Do not filter out ApplyTransactionState records during post split compaction.
- [10163] [DocDB] Regular DB special records could affect the correctness of a middle key calculation for split
- [10172] [DST] Allow CreateTable even if only majority of replicas can be created
- [10235] [YCQL] Only check bind vars on known table
- [10347] [DocDB] Only call ShouldSplitValidCandidate for automatic splits.
- [10438] [DocDB] Changing default values for rocksdb_compact_flush_rate_limit_ flags
- [10438] [DocDB] Make rocksdb_compact_flush_rate_limit_bytes_per_sec be shared across rocksdbs on a node
- [10605] [DocDB] Refactor Tablet Split Manager to rebuild its state of existing splits periodically.
- [10611] [xCluster] Slow SetupReplication requests when using too many tables
- [10816] [11150] [YSQL] Fix renaming of matviews to pg_temp_xxxx after non-concurrent refresh
- [10818] [DocDB] Fix max metrics aggregation metadata to match the entry with the max value
- [10864] [YSQL] Place tablegroups correctly at creation
- [10879] [Geo] Fix TS crash when accessing nonlocal data from a local transaction
- [10914] [Logs] de-duplicate fail tags
- [10995] Release the memtable mutex before going to sleep.
- [11010] [DocDB] Fixed CoarseBackoffWaiter busy loop on aarch64
- [11024] [DocDB] Enable -Wsign-compare, -Wdeprecated, and -Wshorten-64-to-32 flags
- [11038] [YSQL] Check return status for PG gate functions
- [11044] [DST] Drop outstanding_tablet_split_limit to 1
- [11047] [11072] [YSQL] Fix two issues with large OID
- [11054] [YCQL] Aggregate updates to JSONB column before inserting Subdoc
- [11066] Fix crash in case of read for share w/o transaction
- [11077] [YSQL] Fix tuple visibility when selecting from a temp table's unique indexed column
- [11090] [YSQL] Fix incorrect scan result due to scan key pushdown
- [11094] [YSQL] Fix Postgres exception handling
- [11095] [YCQL] Reduce conversion between rapidjson::Document and common::Jsonb
- [11118] [DocDB] Add empty path to sorted drive list when empty path reported by TS to avoid log spamming.
- [11162] [YSQL] Check the length parameter before calling memcpy
- [11167] [YSQL] Release resources on YbScanDesc freeing
- [11179] [DocDB] Fix selecting random free port
- [11181] Use majority_replicated_op_id when sending update consensus to followers
- [11189] [DocDB] In a cluster with custom tablespaces, load balancing gets skipped for tables in a colocated database that opt out of colocation
- [11195] [DST] [PITR] Disallow consecutive restores guarded by a flag
- [11198] [DocDB] Restores should not fail if tablet is moved/deleted off a tserver
- [11206] [YSQL] [Upgrade] Make YSQL upgrade do nothing when YSQL is not enabled
- [11230] [YSQL] Block planner peeking at YB indexes
- [11236] [YSQL] Apply non-zero offset after checking against NULL pointer
- [11238] [DocDB] Fixed TSAN issue relating to job_id in CompactionTask
- [11258] [YCQL] Add timeout for prepare child, change timeout for saturated workers
- [11262] [YSQL] Fix assertion failure on where clause with < any operator
- [11335] [DocDB] Restore should return an error if it hits max number of retries
- [11346] [YSQL] Fix bug in YBCIsSingleRowUpdateOrDelete
- [11347] [YSQL] Fix bug in ALTER TABLE ADD PRIMARY KEY
- [11393] [YSQL] Fixing the TServer crash caused by transaction abort returning error status
- [11402] [Geo] Use version number instead of hash for indicating updates to transaction tables
- [11409] [DocDB] Skip creating write batch while applying and removing intents, writing to rocksdb
- [11425] [YSQL] Fix foreign data wrapper (FDW) dangling reference bug
- [11429] Add missed retries in yb_backup script
- [11437] [DocDB] Verify parent tablet is not tracked by task before adding to compacting or scheduled splits.
- [11440] [YSQL] Drop temp table when session terminates
- [11468] Keep old timestamps in SSTables in the data-patcher tool
- [11484] [CQL] Use the same memory allocator for rapidjson::Document objects in Jsonb::FromJsonbInternal
- [11509] [Geo] Fix error when loading from an older version of sys catalog
- [11527] [YSQL] Correctly create range bound when IN list is empty
- [11633] Distinguish temp and foreign tables for batch COPY
Known Issues
Yugabyte Platform
N/A
Database
N/A