New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Avro data #54

Open

prakharmathur82 opened this issue Aug 13, 2021 · 1 comment

Labels

Member

prakharmathur82 commented Aug 13, 2021

Currently, Dagger only supports SerDe for Protobuf encoded messages.

Avro SerDe is already supported in Flink. Add support for enabling it.
Apart from SerDe, postprocessors, preprocessors, some functions like ElementAt, HashTransformer also rely on Dynamic Message APIs. Need to ensure they work for Avro data as well.

prakharmathur82 added the enhancement label

Member

ravisuhag commented Aug 13, 2021

Stencil also soon plans to add support for AVRO schemas. So, we would also need to consider how to integrate with schema registry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment