2.5.0

What's Changed

• Update Github issue templates with get version instruction by @lewijacn in #1718
• Update the loading page from latest round of ux reviews by @peternied in #1722
• Bump urllib3 from 2.4.0 to 2.5.0 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/integ_test by @dependabot[bot] in #1727
• Improve downloads from S3 using Snapshot File Finder by @jugal-chauhan in #1708
• Metadata output format support for json by @peternied in #1719
• Fix sonarqube issues on recent merge by @peternied in #1731
• Update documentation announcing version support for ES 1 and 2 by @jugal-chauhan in #1680
• Fix Scheduler Unavailable during finalization workflow by @AndreKurait in #1734
• Add automatic flattened to flat_object transformation by @AndreKurait in #1729
• Remove problematic console --version python test by @lewijacn in #1738
• Add support to automatically detect target cluster compression support based on cluster settings by @AndreKurait in #1694
• Update VERSION to 2.5.0 by @gregschohn in #1739

Full Changelog: 2.4.8...2.5.0

2.4.8

What's Changed

• Set Maven autopublish to True by @jugal-chauhan in #1707
• Get our repo to zero sonar issues by @peternied in #1701
• Shared GitHub Action setup for all workflows by @peternied in #1709
• Print Migration Assistant version on Migration Console by @lewijacn in #1712
• Add CloudWatch logging to Solutions Pipeline SSM commands by @lewijacn in #1714
• Default es metadata javascript transforms by @AndreKurait in #1710
• [Restore] Loading page with generated backend api client #1667 by @peternied in #1711
• Create session and backend session apis by @peternied in #1681
• Add stacktrace to Jenkins gradle build command by @lewijacn in #1716
• Update VERSION to 2.4.8 by @lewijacn in #1724

Full Changelog: 2.4.7...2.4.8

2.4.7

What's Changed

• Reduce clock skew by increasing allowed difference by @AndreKurait in #1691
• Loading page with generated backend api client by @peternied in #1667
• [Bug] Provide earlier cleanup of additional git files by @lewijacn in #1693
• Bump the gradle-all group with 21 updates by @dependabot[bot] in #1673
• [Bug] Remove sudo commands that are not part of cleanup in Jenkins pipelines by @lewijacn in #1695
• Bump starlette from 0.47.1 to 0.47.2 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot[bot] in #1677
• Bump jenkins lib version to accommodate maven changes by @gaiksaya in #1696
• Bump requests from 2.32.3 to 2.32.4 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/cluster_tools by @dependabot[bot] in #1699
• Extended support for minor versions of ES 1 and ES 2 by @jugal-chauhan in #1676
• Add support for completion codec available in ES 2/5/6/7/8 by @jugal-chauhan in #1698
• Update VERSION to 2.4.7 by @jugal-chauhan in #1702
• Revert "Loading page with generated backend api client" by @sumobrian in #1705

Full Changelog: 2.4.6...2.4.7

2.4.6

What's Changed

• Add RFS support for ES 2.4 as a source using Shadow Lucene 5 by @jugal-chauhan in #1653
• Metadata cleaner clusters and items by @peternied in #1649
• Add API Backend for Migration Console by @peternied in #1656
• Add transformation for ES8 vector to knn metadata transformation by @AndreKurait in #1623
• Bump requests from 2.32.3 to 2.32.4 in /TrafficCapture/dockerSolution/src/main/docker/k8sConfigMapUtilScripts by @dependabot[bot] in #1663
• Bump commons-lang3 to 3.18.0 to resolve CVE by @AndreKurait in #1664
• Add logging to debug flaky backfill E2E Test by @jugal-chauhan in #1666
• Setup lifecycle for S3 bucket in K8s by @lewijacn in #1645
• Support Metadata migration and Backfill from ES 1.7 snapshots as source by @jugal-chauhan in #1665
• Reduce redundant information and include easier to read details in test logs by @peternied in #1662
• Add back in target cluster property to backfill dashboard, this was m… by @AndreKurait in #1671
• Bump form-data from 4.0.2 to 4.0.4 in /frontend by @dependabot[bot] in #1679
• Add docker ignore for migration console Dockerfile by @lewijacn in #1683
• Add metrics-elastic_agent prefix to default list of excluded templates by @AndreKurait in #1675
• Bump the opensearch-cdk-npm group in /deployment/cdk/opensearch-service-migration with 8 updates by @dependabot[bot] in #1672
• Add support for ES 8 ZSTD Compression by @AndreKurait in #1682
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 4 updates by @dependabot[bot] in #1674
• Fix pace-assignment syntax deprecation for gradle by @peternied in #1688
• Enhance FluentBit logs for K8s by @lewijacn in #1670
• Add support for specifying javascript transforms on the resource path by @AndreKurait in #1678
• [Bug] Add git clean for jenkins pipelines by @lewijacn in #1690
• Update VERSION to 2.4.6 by @jugal-chauhan in #1689

Full Changelog: 2.4.5...2.4.6

2.4.5

What's Changed

• Update cdk.context.json with default vpcAZCount by @AndreKurait in #1640
• Add support for metadata migration from ES 2.4 snapshot by @jugal-chauhan in #1636
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 4 updates by @dependabot[bot] in #1648
• Bump aiohttp from 3.11.18 to 3.12.14 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot[bot] in #1651
• Align source cluster disabling logic and messages in CDK by @lewijacn in #1650
• Bump the gradle-all group with 19 updates by @dependabot[bot] in #1646
• Bump the gradle-all group with 12 updates by @dependabot[bot] in #1659
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 3 updates by @dependabot[bot] in #1657
• Bump the opensearch-cdk-npm group across 1 directory with 10 updates by @dependabot[bot] in #1658
• Align help text with documentation by @AndreKurait in #1655
• Update VERSION to 2.4.5 by @AndreKurait in #1660

Full Changelog: 2.4.4...2.4.5

2.4.4

What's Changed

• Follow up reduce the scope of exception catch blocks to only exception by @peternied in #1631
• Add ignore support for ES8 KnnVectorsFormat by @AndreKurait in #1637
• Fix auto-publishing to maven central by @gaiksaya in #1635
• Update VERSION to 2.4.4 by @AndreKurait in #1638
• Fix typo in ES814HnswScalarQuantizedVectorsFormat by @AndreKurait in #1641
• Synchronize Secret Format and Usage by @lewijacn in #1620
• Set maven auto-publish to false by @gaiksaya in #1643

Breaking Changes

Warning

This includes a breaking change to basic auth secret format

Basic Auth Secret Format Change

Previously:
We expected an AWS secret to contain only the password value as plaintext with no structure and would expect the username through a separate plaintext argument

myStrongPassword123!

Now:
We follow the standard AWS secret format of containing both the username and password as Key-Value pairs within the secret

{"username":"admin","password":"myStrongPassword123!"}

The console library will produce errors like below when using an improperly structured secret:

migration-console (~) -> console clusters cat-indices 

SOURCE CLUSTER
health status index                           uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   test_e2e_0001_integ_full_jul9_2 U--CcY4FQVGQx30DY7q7LA   3   0          3            0     13.3kb         13.3kb

TARGET CLUSTER
Error: Unable to perform cat-indices command with message: Expected secret arn:aws:secretsmanager:us-east-1:123456789012:secret:test-jul2-secret-Y8JbPm to be a JSON object with username and password fields

Full Changelog: 2.4.3...2.4.4

2.4.3

What's Changed

• Bump the gradle-all group with 15 updates by @dependabot[bot] in #1593
• Update Github Readme for ES 8.x support by @jugal-chauhan in #1608
• Created initial onboarding issue template for GitHub. by @sumobrian in #1598
• Remove instructions from the proxy README about how to do a manual install of the proxy on an ES coordinator node. by @gregschohn in #1601
• Correct documentation around support for OpenSearch 3 as a source by @AndreKurait in #1612
• Bump the opensearch-cdk-npm group in /deployment/cdk/opensearch-service-migration with 9 updates by @dependabot[bot] in #1613
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 8 updates by @dependabot[bot] in #1615
• Bump the gradle-all group with 21 updates by @dependabot[bot] in #1614
• Bump urllib3 from 2.4.0 to 2.5.0 in /TrafficCapture/dockerSolution/src/main/docker/k8sConfigMapUtilScripts by @dependabot[bot] in #1618
• Extended support for older ES 5.x minor versions by @jugal-chauhan in #1602
• Remove experimential OSI pipeline use case by @peternied in #1617
• Bump urllib3 from 2.4.0 to 2.5.0 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot[bot] in #1621
• Bump next from 15.3.0 to 15.3.3 in /frontend by @dependabot[bot] in #1625
• Upload aggregated code coverage data by @peternied in #1616
• Bump urllib3 from 2.4.0 to 2.5.0 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/cluster_tools by @dependabot[bot] in #1626
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 10 updates by @dependabot[bot] in #1627
• Bump the opensearch-cdk-npm group in /deployment/cdk/opensearch-service-migration with 11 updates by @dependabot[bot] in #1628
• Bump the gradle-all group with 12 updates by @dependabot[bot] in #1630
• Update maven publishing workflow to accommodate nexus EOL by @gaiksaya in #1622
• Bump anchore/sbom-action from 0.20.1 to 0.20.2 in the github-actions-all group by @dependabot[bot] in #1629
• Setup path for EKS deployments with Migration Assistant chart by @lewijacn in #1607
• Update Workflow Design Doc by @gregschohn in #1619
• Remove the extra log messages around metadata tool and include a logpath by @peternied in #1624
• Update VERSION to 2.4.3 by @peternied in #1632

New Contributors

• @gaiksaya made their first contribution in #1622

Full Changelog: 2.4.2...2.4.3

2.4.2

What's Changed

• Move standardJavascriptTransforms to compileOnly dependency for POM resolution by @AndreKurait in #1605
• Propagate the allow_insecure flag from the cluster definition in the cdk.context.json file into the console's migration_services.yaml file. by @gregschohn in #1603
• Update VERSION to 2.4.2 by @gregschohn in #1609

Full Changelog: 2.4.1...2.4.2

2.4.1

What's Changed

• Extend support for ES 6.0, 6.1, 6.2, 6.3, 6.6 as a source by @jugal-chauhan in #1571
• Add minikube delete before start in jenkins by @AndreKurait in #1580
• Bump anchore/sbom-action from 0.20.0 to 0.20.1 in the github-actions-all group by @dependabot in #1585
• Bump requests from 2.32.3 to 2.32.4 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot in #1577
• Extended support for ES 5.5.x as a source cluster by @jugal-chauhan in #1589
• Bump the migration-assistant-npm group across 1 directory with 11 updates by @dependabot in #1587
• Extended support for all remaining ES 7.x by @jugal-chauhan in #1590
• Bump the opensearch-cdk-npm group across 1 directory with 13 updates by @dependabot in #1584
• Bump the gradle-all group with 12 updates by @dependabot in #1586
• Containerize and deploy the website by @peternied in #1588
• Fix few minor sonarqube issues by @jugal-chauhan in #1591
• Extend Migration Assistant iam permissions to allow access to cross account/region domain/collection/pipeline by @AndreKurait in #1596
• Bump urllib3 from 2.2.3 to 2.5.0 in /test/cleanupDeployment by @dependabot in #1592
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 6 updates by @dependabot in #1594
• Bump the opensearch-cdk-npm group in /deployment/cdk/opensearch-service-migration with 7 updates by @dependabot in #1595
• Bump urllib3 from 2.4.0 to 2.5.0 in /libraries/testAutomation by @dependabot in #1599
• Add ability to set initial capture proxy and target proxy desired count in cdk context by @AndreKurait in #1499
• symlink vi to vim int the migration console image by @gregschohn in #1600
• Allow installing Migration Assistant chart in EKS by @lewijacn in #1578
• Update VERSION to 2.4.1 by @gregschohn in #1604

Full Changelog: 2.4.0...2.4.1

2.4.0

What's Changed

• Add qualifier as default dimension for cloudwatch metrics retrieval by @AndreKurait in #1562
• Remove Capture Proxy ES Service by @AndreKurait in #1564
• Bump the opensearch-cdk-npm group in /deployment/cdk/opensearch-service-migration with 7 updates by @dependabot in #1567
• Bump the migration-assistant-npm group in /deployment/migration-assistant-solution with 5 updates by @dependabot in #1568
• Bump django from 5.2.1 to 5.2.2 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1565
• [Transformations] Add a 'template' for metadata updater function by @peternied in #1550
• Fix TrafficReplayer behavior with HEAD and CONNECT method requests. by @AndreKurait in #1566
• Add ES 6.5, 6.7 7.7, 7.8, 7.9 as extended supported sources by @jugal-chauhan in #1563
• Bump the gradle-all group across 1 directory with 43 updates by @dependabot in #1569
• Bump requests from 2.32.3 to 2.32.4 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot in #1570
• Revert and fix foojay version to support jdk 11 by @AndreKurait in #1573
• Bump requests from 2.32.3 to 2.32.4 in /libraries/testAutomation by @dependabot in #1572
• Allow building images to any Docker registry and image builds in containers by @lewijacn in #1545
• Bump the gradle-all group with 10 updates by @dependabot in #1576
• Add exclusion list for known default/plugin ES index templates and indices by @AndreKurait in #1579
• Update VERSION to 2.4.0 by @jugal-chauhan in #1582

Full Changelog: 2.3.11...2.4.0