Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 Event Notifications - Configuration is ambiguously defined #59

Open
kai-ten opened this issue Jan 18, 2023 · 1 comment
Open

S3 Event Notifications - Configuration is ambiguously defined #59

kai-ten opened this issue Jan 18, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@kai-ten
Copy link
Contributor

kai-ten commented Jan 18, 2023

The Problem

When creating Matano with byob, I was unable to deploy DPMainStack with the error "Configuration is ambiguously defined"

Ultimately this was because my existing dev bucket already had an SNS Event Notification on it for an existing workflow.

Side effects of this problem include:

  • Must remove the existing S3 Event Notification + deploy Matano (this causes an outage)
  • Repoint any existing SQS queue(s) to the new Matano SNS topic
    • If a user was using any Event trigger types other than Object Creation, they would then have to go and add their Event triggers again, causing stack drift / manual point of failure

Discussed solutions at the time of writing

  • Allow users to bring their own SNS Topics if there is already an S3 Event Notification
  • In the Transformer, skip events that don't match an acceptable Struct for ingest
@kai-ten kai-ten changed the title S3 Event Notifications - Configuration is ambiguously defined [Bug] S3 Event Notifications - Configuration is ambiguously defined Jan 18, 2023
@timoguin timoguin added the bug Something isn't working label Jan 30, 2023
@kai-ten kai-ten changed the title [Bug] S3 Event Notifications - Configuration is ambiguously defined S3 Event Notifications - Configuration is ambiguously defined Feb 1, 2023
@Samrose-Ahmed
Copy link
Contributor

I took a look at this, we need to modify the custom resource that adds event notifications to not create an ambiguous configuration. Will work on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants