Releases: edanalytics/edu_edfi_airflow
Releases · edanalytics/edu_edfi_airflow
v0.4.10
What's Changed
- feature/log_map_index by @alchenist in #109
- fix/optional_key_changes_filter by @jayckaiser in #112
New Contributors
- @alchenist made their first contribution in #109
Full Changelog: v0.4.9...v0.4.10
v0.4.9
What's Changed
- Feature/run total counts taskgroup earlier by @sleblanc23 in #105
- Bugfix/delete handling by @sleblanc23 in #104
Full Changelog: v0.4.8...v0.4.9
v0.4.8
What's Changed
- capture earthmover failures in structured logging table by @rlittle08 in #99
- Feature/match rate downstream handling redux by @jayckaiser in #96
Full Changelog: v0.4.7...v0.4.8
v0.4.7
What's Changed
- Fix/pull all deletes default by @ejoranlienea in #103
Full Changelog: v0.4.6...v0.4.7
v0.4.6
What's Changed
- Add edfi and source column names to match rates order by statement by @jalvord1 in #94
- Feature/store ODS resource counts by @sleblanc23 in #89
New Contributors
Full Changelog: v0.4.5...v0.4.6
edu_edfi_airflow v0.4.5
What's Changed
- Update Resources DAG UI for compatibility with Airflow 2.9.x (backwards compatibility with prior versions is retained) by @johncmerfeld in #87
Full Changelog: v0.4.4...v0.4.5
edu_edfi_airflow v0.4.4
What's Changed
- Allow CSV files to optionally enclose fields in quotes when copying in
EarthbeamDAGby @rlittle08 in #88 - Wrap filepath in quotes in
EarthbeamDAGto copy paths with spaces and escape characters by @jayckaiser in #91
Full Changelog: v0.4.3...v0.4.4
edu_edfi_airflow v0.4.3
What's Changed
- Make dependency between EM-to-S3 and file-removal mandatory in Earthb… by @jayckaiser in #85
- Feature/optimized bulk copy by @jayckaiser in #84
Full Changelog: v0.4.2...v0.4.3
edu_edfi_airflow v0.4.2
New features
- Add boolean
pull_all_deletesargument toEdFiResourceDAGto re-pull all deletes for a resource when any are added (resolves deletes-skipping bug). - Allow
SNOWFLAKE_TENANT_CODEto be overridden inearthmover_kwargsinEarthbeamDAG.
Under the hood
- Simplify taskgroup declaration in
EarthbeamDAG.
Fixes
- Fix bug where singleton filepaths in
EarthbeamDAGwere not converted to lists upon initialization. - Add dependency between Lightbeam and file-deletion in
EarthbeamDAG.
Full Changelog: v0.4.1...v0.4.2
edu_edfi_airflow v0.4.1
Under the hood
- Wrap Snowflake stage with single quotes to support filepaths with special characters
Fixes
- Fix bugs where files written to S3 could be overwritten in
EarthbeamDAG - Fix bug where optional files fail upload to S3
Full Changelog: v0.4.0...v0.4.1