v7.4.0

New Tests

• Add tests for user-provided services by @andy-paine in #484
• Add a test for C2C over TLS by @mariash in #500

Updated Tests

• Fix: support HTTP2 status code by @syslxg in #482
• Update: assets/service_broker no longer accepts an env parameter and does not use -d flag when pushing by @will-gant in #496
• Fix: service bindings test flake by @peterhaochen47 in #505
• Fix: skip the memory resources test on K8s by @davewalter in #522

Other Updates

• 2 minor spelling errors by @metskem in #490
• Replace assets/go_calls_ruby.zip with a later version of the go_calls_ruby app by @ctlong in #495
• Fix json struct tags and export pagination href by @ctlong in #497
• Bump google.golang.org/grpc from 1.39.0 to 1.45.0 in /assets/grpc by @dependabot in #506
• Bump github.com/onsi/gomega from 1.2.0 to 1.18.1 in /assets/catnip by @dependabot in #507
• Bump github.com/gorilla/mux from 1.4.0 to 1.8.0 in /assets/catnip by @dependabot in #508
• Bump github.com/onsi/ginkgo from 1.4.0 to 1.16.5 in /assets/catnip by @dependabot in #509
• Bump github.com/satori/go.uuid from 1.1.0 to 1.2.0 in /assets/credhub-service-broker by @dependabot in #510
• Bump github.com/gorilla/mux from 1.4.0 to 1.8.0 in /assets/credhub-service-broker by @dependabot in #511
• Bump code.cloudfoundry.org/go-loggregator/v8 from 8.0.2 to 8.0.5 by @dependabot in #512
• Bump google.golang.org/grpc from 1.39.0 to 1.45.0 by @dependabot in #513
• Bump github.com/onsi/ginkgo from 1.9.0 to 1.16.5 by @dependabot in #514
• Bump github.com/onsi/gomega from 1.6.0 to 1.18.1 by @dependabot in #515
• Bump github.com/mholt/archiver from 2.0.0+incompatible to 3.1.1+incompatible by @dependabot in #516
• Fix: double imports by @ctlong in #499
• Remove unnecessary fmt.Sprintf usage by @ctlong in #498
• Bump google.golang.org/protobuf from 1.27.1 to 1.28.0 by @dependabot in #517
• Bump google.golang.org/protobuf from 1.27.1 to 1.28.0 in /assets/grpc by @dependabot in #518
• Fix: cf-test-helpers reference by @ctlong in #519
• Bump github.com/onsi/gomega from 1.18.1 to 1.19.0 by @dependabot in #520
• Bump github.com/onsi/gomega from 1.18.1 to 1.19.0 in /assets/catnip by @dependabot in #521

New Contributors

• @syslxg made their first contribution in #482
• @andy-paine made their first contribution in #484
• @metskem made their first contribution in #490
• @ctlong made their first contribution in #495
• @will-gant made their first contribution in #496
• @dependabot made their first contribution in #506
• @peterhaochen47 made their first contribution in #505

Full Changelog: v7.3.0...v7.4.0

v7.3.0

New Tests

-HTTP/2 and gRPC routing compatibility #473 and #479
-Isolated TCP routing compatibility #478

Updated Tests

-apps/loggregator.go

• reduce the polling interval to avoid overloading log-cache which prevented the CF CLI from streaming logs
• poll cf logs --recent repeatedly to properly wait for the expected log line to be seen

-windows/lifecycle.go

• Poll cf apps repeatedly to properly wait for the second instance of the app to start

Other Updates

• Update golang net package

v7.2.0

Notice:

• Make logging-route-service compatible with Go 1.16

Updated Tests

-apps/lifecycle.go

• Make app summary memory and disk units optional #458

-services/service_instance_sharing.go

• Update result for v8 service output #459

-services/service_broker_lifecycle.go
-services/service_instance_lifecycle.go

• Replaced all v2 API calls with v3 calls #462
• Fix catalog schema response test #463

Helpers updates

-helpers/services/broker.go

• Replaced all v2 API calls with v3 calls #462

v7.1.0

Updated Tests

• Fixed a couple tests that started failing with UAA v75.0.0 release
  • slack thread with additional context
  • #455 and #456
  • There were some nil checks that weren't testing anything and misleading users when they should have failed.
  • The regex in helpers/services/sso.go was expecting the UAA authorization code to only contain letters and numbers, which was a incorrect expectation. For example, as of today, the code can contain dashes "-".
• services/service_instance_lifecycle.go and credhub/service_keys.go
  • Removed skipOnK8s from create-service-key tests now that that functionality has been fixed for cf-for-k8s
• routing/multiple_app_ports.go
  • As part of the zero downtime feature work in CAPI, making changes to an app's ports now requires a restart for the changes to take effect. This commit reflects that change by adding a cf restart to the "Multiple App Ports" test. #454

Other Updates

• added a required property credhub_secret to example config #451
• test changes to develop branch not only against cf-deployment but also against cf-for-k8s (in the CATS pipeline)

v7.0.0

Notice:

• This is a major release because we removed the internetless suite. The internetless functionality is not core to open-source CF.

Updated Tests

-services/service_instance_lifecycle.go

• Relaxed test expectations

Moved Tests

-apps/syslog_drain.go → app_syslog_tcp/syslog_drain.go

• Split the syslog drain test into a separate suite to allow it to be skipped while still running the apps suite.

Deleted Tests

-internetless/app_external_traffic_denied.go

• This functionality is not core to open source CF

Other Updates

• Use vendir to vendor the logging-route-service sample app - this will make sure to actually include the asset files in the released tarball.

v6.7.0

Updated Tests

-services/service_instance_lifecycle.go

• Relaxes the test expectations to support cli v8.

Other Updates

-dora app

• Now accepts connections from all addresses.

v6.6.0

Updated Tests

-apps/syslog_drain.go

• better reflect original intention of the test

-isolation_segments/isolation_segments.go

• Stop hardcoding the protocol

-apps/loggregator.go

• increase the timeout to reduce flakiness of test on cf-for-k8s where logging can be slower

-route_services/route_services.go

• remove obsolete -f flag

-windows/lifecycle.go

• Use the configured timeout, rather than the hardcoded one

Other updates

• add uptime endpoint to dora
• improve sticky session documentation

v6.5.0

Updated Tests

-apps/crashing.go

• Updated crash event tests to work with Eirini 1.9.0.
  -apps/routing_transparency.go
• Updated routing transparency tests to work with Istio.

Helpers updates

• Helpers added for route tests.

-helpers/download/download.go

• Send curl output to file to avoid droplet binary dump in terminal.

Other Updates

• Convert calls leveraging v2 Cloud Controller API endpoints to use the v3 CAPI endpoints, as part of VAT's work to deprecate v2 CAPI.
• Additional tests skipped when running against cf-for-k8s, due to incompatibilities with the platform.

v6.4.0

Updated Tests

-apps/crashing.go

• There are two fixes to test app crashes:

1. The id checking for recovery was giving false positives because the post-crash ID was returning an error message which happened to differ from the pre-crash app's ID. It turns out that that IDs are reused on cf-for-k8s but change for cf-deployment.
2. The two different infrastructure's IDs match different specific regular expressions, so a more general one handles both cases.

• cf-for-k8s is waiting for a new release of eirini that will handle app.crash events, so that test is skipped for cf-for-k8s but the recovery tests can be run.

v6.3.0

Notice:

• Cloud Foundry acceptance tests (CATS) now works with CF for Kubernetes

Updated Tests and Helpers

The following general changes affected multiple files, which we won't list here individually:

• 598ff1d : Always explicitly target the test space

• Multiple commits for refactoring and adding conditional skips to support cf-for-k8s:

  • a1dfe43
  • 440ede1
  • ede3fab
  • c5202cd
  • c8c5e9c
  • 4666bdf
  • 70f85c2
  • 38e9d1f
  • 0b321ae
  • 574d01e
  • c40d715
  • d356dc0
  • 36deda9
  • 90c8dbf
  • 909cb52
  • 0dd10a8
  • bf335f9
  • 4e2128c
  • 8fbb5d5

Some of the assertions have also been changed, with the addition of an informative string to be rendered and emitted when an assertion fails.

Other Updates

-docs/run-on-k8s.md
0d796dd : Covers needed changes for running CATs on CF for Kubernetes.