v6.2.0

Notice:

• This release adds the ability to control which tests will run based on the configuration option infrastructure with possible values kubernetes or vms (default).

Note that CATS is still under construction for Kubernetes environment and we are working towards a running version of CATs in cf-for-k8s

Updated Tests

• See this PR 429 for list of tests that were updated. Note

v6.1.0

Notice:

• With this release, we have officially deprecated the windows2012 stack in CATs after having completed deprecation in cf-deployment and the cf cli for some time now.

Updated Tests

• apps/loggregator.go
  • Update go loggregator library version for grpc cve fix
• internet_dependent/git_buildpack.go
  • Update nodejs-buildpack to latest version
• volume_services/volume_services.go
  • Update volume services tests for cf cli v7

Helpers updates

• helpers/config/config_struct.go
  • Remove support for the windows2012 stack.
• helpers/config/config_test.go
  • Remove extra unit testing for windows stack config

Other Updates

• /assets/*
  • Add go.mod to go apps for paketo buildpack compatibility
  • Update bundler and gem versions for ruby apps for paketo buildpack compatibility

v6.0.0

Notice

💥💥 Cloud Foundry acceptance tests (CATS) now works with cf CLI v7💥💥

This major release of CATS now works with cf CLI v7. As you may be aware, the cf CLI team recently release the much awaited v7 CLI that unlocks new app developer workflows for users who require granular control of their apps and other advanced deployment strategies. You can check out more @ https://docs.cloudfoundry.org/cf-cli/v7.html.

With this release, CATS NO longer supports running with cf CLI v6. Going forward, we will only support running with cf CLI v7. If you're running CATS in your pipelines, we recommend you update your cf CLI to v7 or pin to an older version of CATS < v6.0.0.

It would have not been possible without the hard work of folks on the cf CLI team, V3 Acceleration Team, and Release Integration to come together and make this happen.

New Tests

• apps/piecemeal_app_creation_flow.go
  • c760f93

  cover more granular app commands introduced in the v7 CLI/v3 API

• apps/rolling_deploy.go
  • 311fb61

  cf push --strategy=rolling is a new feature in the V7 CF CLI

Updated Tests

Instead of pointing at each file with a change, we will record the general updates we had to make across multiple suites for the migration to cf CLI v7

• cf push no longer uses the -d flag
• cf buildpack uses 1-indexed references instead of 0-indexed
• use the -space flag instead of a positional arg for cf security groups
• use the -command flag for cf run-task
• healthcheck no longer supports the none type, so we updated to process type
• cf add-network-policy now uses a positional arg instead of the -destination-app flag

Deleted Tests

• windows/set_start_command.go
  • e022acf

  remove windows/set_start_command.go as it tests code that's handled in windows/worker.go

• backend_compatibility/backend_compatibility.go
  • 2e0bdc8

  this test was specifically testing if DEA droplets can be staged onto
  Diego, and moving forward Cloudfoundry will be abandoning DEAs all together.

Helpers updates

• helpers/logs/logs_helper.go
  • f22c809

  v7 no longer hits traffic controller; it uses log cache for all logging. This removes the config setting and switches to cf logs instead of cftail.

Other Updates

• v3/buildpacks.go
  • We discovered capi no-bridge tests are no longer present in CATs, but the configuration and branching logic were not cleaned up.
• backend_compatibility/backend_compatibility.go
  • With the deletion of the only tests in its suite, we also deleted the backend_compatibility flag from the cats configuration interface.
• helpers/config/config.go
  • f22c809

  v7 no longer hits the traffic controller; it uses log cache for all logging. This removes the config setting.

v5.11.0

Updated Tests

-volume_services/volume_services.go

• Simplify setup for volume services test suite by enabling diego_docker feature flag. Skip the volume services test suite if the docker suite is enabled.

Other Updates

-assets/nora/README.md

• Replace defunct ./make_a_nora with cf push nora.

v5.10.0

Other Updates

-helpers/app_helpers/app_helpers.go

• Make the AppReporter more resilient. Print out app logs only when a test fails. If getting logs fails, continue so cleanup proceeds. This fixes a resource leak when getting logs failed.

-Update golang crypto library

• Specify the correct hash for the golang.org/x/crypto library

v5.9.0

Updated Tests

-apps/loggregator.go - Fixed flaky loggregator test.

Other Updates

• Update golang crypto library.

v5.8.0

Updates

• Remove flaky loggregator v1 metrics tests
  • Tests removed from windows/metrics.go, apps/loggregator.go
• Improve readability in apps/default_environment_variables.go

v5.7.0

Asset updates

• /assets/python - The python app asset has been updated to use Python 3.

v5.6.0

Other Updates

• example-cats-config.json
  • Removed the duplicate entry include_tcp_routing from the example config.
• Updated rack version to 2.0.8

v5.5.0

Helpers updates

-cf-test-helpers

• When not using an existing space, but using an existing user, we need to add the user to the space.