Replies: 1 comment
-
There is an experimental feature for Asset versioning and caching |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi all! I was hoping to get a bit of input from the community - my team has been working on our custom S3 IO manager for the past week, and we were wondering - What's the best approach for versioning asset materializations in Dagster?
We want to:
Should we implement a custom IO manager, use partitioning, or is there another built-in solution? Are partitions suitable for this use case (an entire version of an asset), or would they add unnecessary complexity?
Beta Was this translation helpful? Give feedback.
All reactions