From c6c497adcc750147b63ccf22915a6e4323305cea Mon Sep 17 00:00:00 2001 From: Zach Musgrave Date: Thu, 24 Oct 2024 12:17:16 -0700 Subject: [PATCH 1/4] Roadmap update --- packages/dolt/content/other/roadmap.md | 115 +++++++++++++------------ 1 file changed, 58 insertions(+), 57 deletions(-) diff --git a/packages/dolt/content/other/roadmap.md b/packages/dolt/content/other/roadmap.md index 5f00f1b3..4f525b8b 100644 --- a/packages/dolt/content/other/roadmap.md +++ b/packages/dolt/content/other/roadmap.md @@ -13,66 +13,67 @@ see what you need on here? [Let us know!](https://github.com/dolthub/dolt/issues) Paying customers get their feature requests implemented first. -Roadmap last updated May 2024, next update July 2024. +Our next major goal is getting the Postgres version of Dolt, [Doltgres](https://www.doltgres.com/), +to a production quality Beta release. Doltgres Beta will ship in January 2025, with hosted +deployment available. + +Roadmap last updated Oct 2024, next update Jan 2025. ## Upcoming features -| Feature | Estimate | -|-----------------------------------------------------------------------------------|-------------| -| Postgres function support | Q2 2024 | -| Improved JSON performance | Q2 2024 | -| Zstd dictionary compression | Q2 2024 | -| Doltgres 90% correctness | Q2 2024 | -| [Dolt to MySQL binlog replication](https://github.com/dolthub/dolt/issues/7512) | Q2 2024 | -| Automatic table statistics | Q3 2024 | -| [Rebase conflict resolution support](https://github.com/dolthub/dolt/issues/7820) | Q3 2024 | -| Doltgres 99% correctness | Q3 2024 | -| [Customized merge rules](https://github.com/dolthub/dolt/issues/7680) | Q3 2024 | -| Update multiple branches in a transaction | 2024 | -| Row-level locking (`SELECT FOR UPDATE`) | 2024 | -| [Transaction isolation levels](https://github.com/dolthub/dolt/issues/2007) | 2024 | -| [Multiple DBs in one repo](https://github.com/dolthub/dolt/issues/3043) | 2024 | -| More function coverage | Ongoing | -| Images / video types | Unscheduled | -| [History compression](https://github.com/dolthub/dolt/issues/5355) | Unscheduled | -| Embedded Dolt | Unscheduled | -| [Signed commits](https://github.com/dolthub/dolt/issues/628) | Unscheduled | -| Lock / unlock tables | Unscheduled | -| Updateable views | Unscheduled | -| Encryption at rest | Unscheduled | -| Pipeline query processing | Unscheduled | -| [Automatic garbage collection](https://github.com/dolthub/dolt/issues/1987) | Unscheduled | -| [User-defined functions](https://github.com/dolthub/dolt/issues/6193) | Unscheduled | -| Better stored procedure support | Unscheduled | +| Feature | Estimate | +|------------------------------------------------------------------------------------------|-------------| +| Doltgres: user defined types | Q4 2024 | +| Doltgres: users and auth | Q4 2024 | +| Doltgres: user defined functions | Q4 2024 | +| Doltgres: 50% most common function coverage | Q4 2024 | +| Hosted Doltgres | Q4 2024 | +| Doltgres: 90% correctness | Q4 2024 | +| Vector support | Q4 2024 | +| Virtual private cloud for Google Cloud in hosted deployments | Q4 2024 | +| Doltgres: 99% correctness | Jan 2025 | +| Doltgres beta (production ready) | Jan 2025 | +| Update multiple branches in a transaction | 2025 | +| Row-level locking (`SELECT FOR UPDATE`) | 2025 | +| [Automatic garbage collection](https://github.com/dolthub/dolt/issues/1987) | 2025 | +| [Transaction isolation levels](https://github.com/dolthub/dolt/issues/2007) | 2025 | +| More function coverage | Ongoing | +| [Rebase schema conflict resolution support](https://github.com/dolthub/dolt/issues/7820) | Unscheduled | +| [Multiple DBs in one repo](https://github.com/dolthub/dolt/issues/3043) | Unscheduled | +| [Customized merge rules](https://github.com/dolthub/dolt/issues/7680) | Unscheduled | +| Images / video types | Unscheduled | +| [History compression](https://github.com/dolthub/dolt/issues/5355) | Unscheduled | +| Embedded Dolt | Unscheduled | +| Lock / unlock tables | Unscheduled | +| Updateable views | Unscheduled | +| Encryption at rest | Unscheduled | +| Pipeline query processing | Unscheduled | +| [User-defined functions](https://github.com/dolthub/dolt/issues/6193) | Unscheduled | +| Better stored procedure support | Unscheduled | +| Other database frontends (e.g. Mongo, SQL Server) | Unscheduled | ## Selection of recent feature launches -| Feature | Launch Date | -|--------------------------------------------------------------------------------------------------------------------------|---------------| -| [Doltgres to Postgres replication](https://www.dolthub.com/blog/2024-04-23-announcing-postgres-to-doltgres-replication/) | Apr 2024 | -| [Doltgres prepared statements](https://www.dolthub.com/blog/2024-04-01-prepared-statements-postgres/) | Apr 2024 | -| [Postgres type support](https://www.dolthub.com/blog/2024-02-14-adding-types-to-doltgresql/) | Feb 2024 | -| [Shallow clones](https://www.dolthub.com/blog/2024-02-21-shallow-clone/) | Feb 2024 | -| [Statistics in joins](https://www.dolthub.com/blog/2024-01-22-join-statistics/) | Jan 2024 | -| [Automatic JSON column merge](https://www.dolthub.com/blog/2024-01-16-announcing-json-merge/) | Jan 2024 | -| [Rebase](https://www.dolthub.com/blog/2024-01-03-announcing-dolt-rebase/) | Jan 2024 | -| [Push to running SQL server](https://www.dolthub.com/blog/2023-12-29-sql-server-push-support/) | Dec 2023 | -| [Reflog](https://www.dolthub.com/blog/2023-11-17-dolt-reflog/) | Nov 2023 | -| [Virtual columns and json indexing](https://www.dolthub.com/blog/2023-11-03-virtual-columns/) | Nov 2023 | -| Postgres alpha | Nov 2023 | -| Better table statistics support | Nov 2023 | -| 99.99% SQL correctness | Oct 2023 | -| Event execution | Oct 2023 | -| CLI profiles | Sep 2023 | -| Hosted replication failover | Sep 2023 | -| Full text indexes | Aug 2023 | -| Server / CLI compatibility | Jul 2023 | -| Cross-database joins with indexes | Jul 2023 | -| Hosted replication | Jun 2023 | -| dolt_schema_diff table | Jun 2023 | -| Better branch transaction support | Jun 2023 | -| Many new collations | Jun 2023 | -| Collation regex support | Jun 2023 | -| Better schema merging | May 2023 | -| dolt_ignore table | May 2023 | -| dolt show command | May 2023 | +| Feature | Launch Date | +|--------------------------------------------------------------------------------------------------------------------------|-------------| +| [dolt fsck](https://www.dolthub.com/blog/2024-10-09-fsck-announce/) | Oct 2024 | +| [Doltgres support for workbench](https://www.dolthub.com/blog/2024-10-17-dolt-workbench-supports-doltgres/) | Oct 2024 | +| [Data conflict resolution for dolt rebase](https://www.dolthub.com/blog/2024-09-05-rebase-conflict-resolution/) | Sep 2024 | +| [Doltgres: COPY support](https://www.dolthub.com/blog/2024-09-17-tabular-data-imports/) | Sep 2024 | +| [Signed commits](https://www.dolthub.com/blog/2024-09-16-signed-commits/) | Sep 2024 | +| [Improved JSON performance](https://www.dolthub.com/blog/2024-07-15-json-prolly-trees/) | Jul 2024 | +| [Postgres function support](https://www.dolthub.com/blog/2024-07-30-re-introducing-dolt-functions/) | Jul 2024 | +| [Dolt to MySQL binlog replication](https://www.dolthub.com/blog/2024-07-05-binlog-source-preview/) | Jul 2024 | +| [pg_catalog support](https://www.dolthub.com/blog/2024-07-02-pg-catalog-update/) | Jul 2024 | +| [Doltgres schema support](https://www.dolthub.com/blog/2024-05-07-understanding-postgres-schemas/) | May 2024 | +| [Storage archives](https://www.dolthub.com/blog/2024-04-29-dolt-storage-v2/) | Apr 2024 | +| [Zstd dictionary compression](https://www.dolthub.com/blog/2024-04-22-dolt-storage-dictionaries/) | Apr 2024 | +| [Postgres to Doltgres replication](https://www.dolthub.com/blog/2024-04-23-announcing-postgres-to-doltgres-replication/) | Apr 2024 | +| [Doltgres prepared statements](https://www.dolthub.com/blog/2024-04-01-prepared-statements-postgres/) | Apr 2024 | +| [Automatic table statistics](https://www.dolthub.com/blog/2024-02-16-stats-refresh/) | Mar 2024 | +| [Postgres type support](https://www.dolthub.com/blog/2024-02-14-adding-types-to-doltgresql/) | Feb 2024 | +| [100% sql correctness](https://www.dolthub.com/blog/2024-02-26-100-percent-correctness/) | Feb 2024 | +| [Shallow clones](https://www.dolthub.com/blog/2024-02-21-shallow-clone/) | Feb 2024 | +| [Statistics in joins](https://www.dolthub.com/blog/2024-01-22-join-statistics/) | Jan 2024 | +| [Automatic JSON column merge](https://www.dolthub.com/blog/2024-01-16-announcing-json-merge/) | Jan 2024 | +| [Rebase](https://www.dolthub.com/blog/2024-01-03-announcing-dolt-rebase/) | Jan 2024 | From cfd8d317d7df5c7dd8586345da9baeaa0d210b48 Mon Sep 17 00:00:00 2001 From: Zach Musgrave Date: Thu, 24 Oct 2024 13:34:08 -0700 Subject: [PATCH 2/4] Update packages/dolt/content/other/roadmap.md Co-authored-by: Tim Sehn --- packages/dolt/content/other/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/packages/dolt/content/other/roadmap.md b/packages/dolt/content/other/roadmap.md index 4f525b8b..4f83f771 100644 --- a/packages/dolt/content/other/roadmap.md +++ b/packages/dolt/content/other/roadmap.md @@ -14,7 +14,7 @@ know!](https://github.com/dolthub/dolt/issues) Paying customers get their feature requests implemented first. Our next major goal is getting the Postgres version of Dolt, [Doltgres](https://www.doltgres.com/), -to a production quality Beta release. Doltgres Beta will ship in January 2025, with hosted +to a [production quality Beta release](https://www.dolthub.com/blog/2024-08-06-doltgres-beta/). Doltgres Beta will ship in Q1 2025, with hosted deployment available. Roadmap last updated Oct 2024, next update Jan 2025. From 95c62474024912e13a354c61303f2418dcbc1e7b Mon Sep 17 00:00:00 2001 From: "dependabot[bot]" <49699333+dependabot[bot]@users.noreply.github.com> Date: Thu, 24 Oct 2024 22:31:46 +0000 Subject: [PATCH 3/4] Bump micromatch from 4.0.5 to 4.0.8 in /packages/dolt/integration Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8. - [Release notes](https://github.com/micromatch/micromatch/releases) - [Changelog](https://github.com/micromatch/micromatch/blob/master/CHANGELOG.md) - [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8) --- updated-dependencies: - dependency-name: micromatch dependency-type: indirect ... Signed-off-by: dependabot[bot] --- packages/dolt/integration/yarn.lock | 26 +++++++++++++------------- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/packages/dolt/integration/yarn.lock b/packages/dolt/integration/yarn.lock index 0a29ba81..1d1876e7 100644 --- a/packages/dolt/integration/yarn.lock +++ b/packages/dolt/integration/yarn.lock @@ -578,12 +578,12 @@ brace-expansion@^1.1.7: balanced-match "^1.0.0" concat-map "0.0.1" -braces@^3.0.2: - version "3.0.2" - resolved "https://registry.yarnpkg.com/braces/-/braces-3.0.2.tgz#3454e1a462ee8d599e236df336cd9ea4f8afe107" - integrity sha512-b8um+L1RzM3WDSzvhm6gIz1yfTbBt6YTlcEKAvsmqCZZFw46z626lVj9j1yEPW33H5H+lBQpZMP1k8l+78Ha0A== +braces@^3.0.3: + version "3.0.3" + resolved "https://registry.yarnpkg.com/braces/-/braces-3.0.3.tgz#490332f40919452272d55a8480adc0c441358789" + integrity sha512-yQbXgO/OSZVD2IsiLlro+7Hf6Q18EJrKSEsdoMzKePKXct3gvD8oLcOQdIzGupr5Fj+EDe8gO/lxc1BzfMpxvA== dependencies: - fill-range "^7.0.1" + fill-range "^7.1.1" buffer@^6.0.3: version "6.0.3" @@ -1170,10 +1170,10 @@ file-entry-cache@^6.0.1: dependencies: flat-cache "^3.0.4" -fill-range@^7.0.1: - version "7.0.1" - resolved "https://registry.yarnpkg.com/fill-range/-/fill-range-7.0.1.tgz#1919a6a7c75fe38b2c7c77e5198535da9acdda40" - integrity sha512-qOo9F+dMUmC2Lcb4BbVvnKJxTPjCm+RRpe4gDuGrzkL7mEVl/djYSu2OdQ2Pa302N4oqkSg9ir6jaLWJ2USVpQ== +fill-range@^7.1.1: + version "7.1.1" + resolved "https://registry.yarnpkg.com/fill-range/-/fill-range-7.1.1.tgz#44265d3cac07e3ea7dc247516380643754a05292" + integrity sha512-YsGpe3WHLK8ZYi4tWDg2Jy3ebRz2rXowDxnld4bkQB00cc/1Zw9AWnC0i9ztDJitivtQvaI9KaLyKrc+hBW0yg== dependencies: to-regex-range "^5.0.1" @@ -1684,11 +1684,11 @@ merge2@^1.3.0, merge2@^1.4.1: integrity sha512-8q7VEgMJW4J8tcfVPy8g09NcQwZdbwFEqhe/WZkoIzjn/3TGDwtOCYtXGxA3O8tPzpczCCDgv+P2P5y00ZJOOg== micromatch@^4.0.4: - version "4.0.5" - resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-4.0.5.tgz#bc8999a7cbbf77cdc89f132f6e467051b49090c6" - integrity sha512-DMy+ERcEW2q8Z2Po+WNXuw3c5YaUSFjAO5GsJqfEl7UjvtIuFKO6ZrKvcItdy98dwFI2N1tg3zNIdKaQT+aNdA== + version "4.0.8" + resolved "https://registry.yarnpkg.com/micromatch/-/micromatch-4.0.8.tgz#d66fa18f3a47076789320b9b1af32bd86d9fa202" + integrity sha512-PXwfBhYu0hBCPw8Dn0E+WDYb7af3dSLVWKi3HGv84IdF4TyFoC0ysxFd0Goxw7nSv4T/PzEJQxsYsEiFCKo2BA== dependencies: - braces "^3.0.2" + braces "^3.0.3" picomatch "^2.3.1" mimic-fn@^2.1.0: From a88046196ca4b99c698211e6984245f7ba041605 Mon Sep 17 00:00:00 2001 From: Zach Musgrave Date: Thu, 24 Oct 2024 15:46:54 -0700 Subject: [PATCH 4/4] Moved doltgres to its own section --- packages/dolt/content/other/roadmap.md | 33 ++++++++++++++++++-------- 1 file changed, 23 insertions(+), 10 deletions(-) diff --git a/packages/dolt/content/other/roadmap.md b/packages/dolt/content/other/roadmap.md index 4f83f771..619e21a1 100644 --- a/packages/dolt/content/other/roadmap.md +++ b/packages/dolt/content/other/roadmap.md @@ -14,25 +14,23 @@ know!](https://github.com/dolthub/dolt/issues) Paying customers get their feature requests implemented first. Our next major goal is getting the Postgres version of Dolt, [Doltgres](https://www.doltgres.com/), -to a [production quality Beta release](https://www.dolthub.com/blog/2024-08-06-doltgres-beta/). Doltgres Beta will ship in Q1 2025, with hosted -deployment available. +to a [production quality Beta +release](https://www.dolthub.com/blog/2024-08-06-doltgres-beta/). Doltgres Beta will ship in Q1 +2025, with hosted deployment available. Roadmap last updated Oct 2024, next update Jan 2025. ## Upcoming features +Work to improve the performance and availability of Dolt is a constant theme and not called out +explicitly unless it's a major separable effort. + +### Dolt + | Feature | Estimate | |------------------------------------------------------------------------------------------|-------------| -| Doltgres: user defined types | Q4 2024 | -| Doltgres: users and auth | Q4 2024 | -| Doltgres: user defined functions | Q4 2024 | -| Doltgres: 50% most common function coverage | Q4 2024 | -| Hosted Doltgres | Q4 2024 | -| Doltgres: 90% correctness | Q4 2024 | | Vector support | Q4 2024 | | Virtual private cloud for Google Cloud in hosted deployments | Q4 2024 | -| Doltgres: 99% correctness | Jan 2025 | -| Doltgres beta (production ready) | Jan 2025 | | Update multiple branches in a transaction | 2025 | | Row-level locking (`SELECT FOR UPDATE`) | 2025 | | [Automatic garbage collection](https://github.com/dolthub/dolt/issues/1987) | 2025 | @@ -52,6 +50,20 @@ Roadmap last updated Oct 2024, next update Jan 2025. | Better stored procedure support | Unscheduled | | Other database frontends (e.g. Mongo, SQL Server) | Unscheduled | +### Doltgres + +Dolt and Doltgres share an engine, so most features on the Dolt roadmap also apply to Doltgres. + +| Feature | Estimate | +|-----------------------------------|----------| +| User defined types | Q4 2024 | +| User defined functions | Q4 2024 | +| Users and auth | Q4 2024 | +| 50% most common function coverage | Q4 2024 | +| Hosted Doltgres | Q1 2025 | +| Doltges Beta release | Q1 2025 | +| Stored procedures | Q1 2025 | + ## Selection of recent feature launches | Feature | Launch Date | @@ -60,6 +72,7 @@ Roadmap last updated Oct 2024, next update Jan 2025. | [Doltgres support for workbench](https://www.dolthub.com/blog/2024-10-17-dolt-workbench-supports-doltgres/) | Oct 2024 | | [Data conflict resolution for dolt rebase](https://www.dolthub.com/blog/2024-09-05-rebase-conflict-resolution/) | Sep 2024 | | [Doltgres: COPY support](https://www.dolthub.com/blog/2024-09-17-tabular-data-imports/) | Sep 2024 | +| Doltgres: 90% correctness | Sep 2024 | | [Signed commits](https://www.dolthub.com/blog/2024-09-16-signed-commits/) | Sep 2024 | | [Improved JSON performance](https://www.dolthub.com/blog/2024-07-15-json-prolly-trees/) | Jul 2024 | | [Postgres function support](https://www.dolthub.com/blog/2024-07-30-re-introducing-dolt-functions/) | Jul 2024 |