v0.29.0

BREAKING CHANGES

• Updated to latest azureblob, which had some non-backward-compatible changes (again).

all

• Defaulting to go version 1.2.
• aws: Added support for custom endpoints for AWS SDK v2.
• gcp: Updated imports for credentialspb.

blob

• azureblob: Updated to latest (breaking change).

pubsub

• kafkapub: Fixed nil Options pointer dereference.

v0.28.0

BREAKING CHANGES:

• secrets/azurekeyvault: Updated to latest Azure SDK.
• blob/azureblob: Updated to match recent breaking changes in the Azure packages (yes, again).
• pubsub/awssnssqs: Fixed BeforeSend to take a pointer to the SendMessageBatchRequestEntry struct, so that it can be modified.

blob

• memblob: Fixed bug where use of BeforeCopy callback would drop the actual copying.
• azureblob: Updated to match recent breaking changes in the Azure packages.

pubsub

• all: Simplified and improved batch sizing, should resolve issues with too-frequent polling in some situations.
• azurepubsub: Made ListenerTimeout configurable.
• gcppubsub and awssnssqs: Support lazy mode for Nack (where no explicit Nack is sent).
• awssnssqs: Fixed BeforeSend to take a pointer to the SendMessageBatchRequestEntry struct, so that it can be modified.

secrets

• secrets/azurekeyvault: Updated to latest Azure SDK. Use azidentity.NewDefaultAzureCredential.

sql

• gcp/cloudsql: Fixed IAM login.

v0.27.0

ANNOUNCEMENT: In the next release we plan to switch over from using OpenCensus to using OpenTelemetry; see #2877 for discussion. Please comment on that issue if this is a concern for you.

BREAKING CHANGES:
blob/azureblob, pubsub/azuresb: Switched over to using the new Azure beta release. Constructors and As types have changed.

pubsub:
all: Added support for overriding batching for AWS, GCP, Azure.

blob:
fileblob: Fixed file permissions on temporary files.

runtimevar:
etcdvar: Brought back this package now that the upstream issues have been resolved.

secrets:
awskms: Added support for EncryptionContext parameters.

v0.26.0

all

• Updated to Go 1.19 (with compatibility for Go 1.18).

blob

• all: Made blob.Reader implement io.ReadSeekCloser.
• all: Added WriterOption.MaxConcurrency.
• azureblob: Fixed a capture bug in As for List.

pubsub

• gcppubsub: Exposed ReceivedMessage in As (for AckId)
• rabbitpubsub: Switch to using github.com/rabbitmq/amqp091-go.

runtimevar

• awsparamstore: Drop the DescribeParameters call, it's not needed.

sql

• gcp/cloudsql: Enable IAM login.

v0.25.0

blob:

• Added support for SingleKeyBucket via key URL parameter.
• s3blob: Added support for using AWS SDK V2.
• azblob: Allowed for providing client id in MSI authentication via AZURE_CLIENT_ID.
• fileblob: Stopped overwriting URLOpener.Metadata if there's no URL param.
• fileblob: Fixed pagination for dirs that end in characters smaller than the delimiter.

pubsub:

• gcppubsub: Added retries on DeadlineExceeded for subscriptions.
• awssnssqs: Added support for using AWS SDK V2.

runtimevar:

• all: Added support for setting wait/timeout Option in URL params.
• httpdvar: Added support for using basic authentication on the HTTP requests.

v0.24.0

all

• Updated to use go 1.17 (tests still run with `go 1.16 as well).

blob

• s3blob: Enable choosing an AWS session profile via the URLOpener.
• s3blob: Don't set ContentType in the S3 input for signing if it is an empty string and EnforcedAbsentContentType is false.

pubsub

• gcppubsub: Allow configuration of batch sizes.
• gcppubsub: Consider publish request body size limitation when batching.
• kafkapubsub: Enable configuration of initial offset in URLOpener.
• mempubsub: Log if message sent to subscriber-less topic.

runtimevar

• awsparamstore: Added support for using AWS SDK V2.
• awssecretsmanager: Added support for using AWS SDK V2.

secrets

• awskms: Added support for using AWS SDK V2.

docstore

• gcpfirestore: Add support for Firestore emulator.

v0.23.0

blob:

• azblob: Add support for CDN domains.
• fileblob: Minor fixes and performance improvements; new option to skip writing sidecar/metadata files.
• azblob: Fixed bug where Copy could fail with permission denied when using SAS tokens.

pubsub:

• Added a Message.LoggableID field for logging.
• Added an As hook for AfterSend.
• rabbitpubsub: Made the default URL opener reconnect if needed.

docstore:

• memdocstore: Fixed a bug in OrderBy when using Limit.

secrets:

• hashivault: Added support for VAULT_ADDR and VAULT_TOKEN as aliases for existing environment variables.
• azurekeyvault: Added support for private clouds.

server:

• Logger is now passed the full Request (sans Body).

v0.22.0

• blob

  • azblob: Fixed a bug where a SAS token was not being used during Open.

• pubsub

  • gcppubsub: Tell gRPC to allow messages up to 10MB.
  • azurepubsub: Fixed a bug when the number of messages returned is empty.
  • azurepubsub: Now using a new SendBatchDisposition function to simplify sending of acks/nacks.
  • awssnssqs: Fixed Message.As when used with multiple concurrent workers.
  • kafka: Fixed to use default partitioning when no KeyName is set.

• runtimevar

  • Added a new driver for GCP Secret Manager.

• mysql

  • Fixed parsing of URL hostnames in the form of protocol(addr).

• docstore

  • all: Improved handling of byte arrays and non-pointer protocol buffers.
  • dynamodocstore: Added support for a consistent_read option to the URLOpener.

All commits:

• v0.21.0...v0.22.0

v0.21.0

• blob

  • all: added a ListPage function for listing blobs in pages.
  • all: added bucket.IsAccessible.
  • all: added CreateTime and ETag to blob.Attributes.
  • all: added BeforeSign support to SignedURL.
  • azureblob: added support for local emulators via http.
  • azureblob: added support for setting the storage domain in URL opener.
  • azureblob: added MSI based authentication for Azure buckets, including signing.
  • s3blob: added access to s3manager.Uploader via As in WriterOptions.
  • fileblob: fixed List() when the bucket is rooted at /.
  • fileblob: added an Option to create the base fileblob directory if it does not already exist.
  • fileblob: added support for various As functions.

• runtimevar

  • NEW DRIVER for AWS Secrets Manager!
  • etcdvar: dropped support (hopefully temporarily, until they can fix their dependency issues).
  • httpvar: fixed to respect context when watching values.

• pubsub

  • all: now allowing batch size to decay when there aren't any messages.
  • awssnssqs: exposed the WaitTime parameter to AWS ReceiveMessage via a SubscriberOption.
  • awssnssqs: requesting Attributes be returned in messages (accessible via As).
  • azurepubsub: fixed bugs in error handling from ReceiveOne.

• docstore:

  • mongodocstore: no longer include revision field projection twice.

• secrets

  • localsecrets: now using separate key decoders for URL and Std base64.

• sql

  • awsmysql: add parsing of DSN options from the URL.

v0.20.0

• all

  • Dropped explicit support for go 1.11 and go 1.12 and added go 1.14.
  • Updated dependencies.

• blob

  • all: Reduced allocations in bucket.Read() and bucket.Write().
  • gcsblob: Set defaults for SignURL from any credentials file, and fall back to using IAM for signing.
  • s3blob: Fixed bug with ListObject.As returning the wrong object reference.
  • fileblob: Support relative paths in URL openers via a . Host.

• pubsub

  • all: * Improved support for writing external drivers by moving batcher out of internal.
  • gcppubsub: Dial emulator with insecure options by default.
  • natspubsub: Added support for opening Queue subscriptions via SubscriptionOptions.

• runtimevar

  • awsparamstore: Use WithDecryption=true to decrypt encrypted parameters.

• secrets

  • azurekeyvault Added support for other Azure keyvault regions.
  • ** awskms**: Support ARNs in URLs by using an empty Host.

• sql

  • gcpmysql: Parse Options in DSN.

• server

  • Added ListenAndServeTLS.