π¨βπ» Compute and display detailed carbon emission and energy consumption data for dry-runs.
π Report on data pipeline carbon footprint
β»οΈ Analyze and identify carbon and energy intensive workloads
We have integrated the enRichMyData greenR tool Carbontracker into SIM-PIPE by containerizing Carbontracker and exposing it as an API service in the local Kubernetes cluster that SIM-PIPE utilizes. SIM-PIPE calls this service to compute detailed carbon emissions and energy consumption of the individual steps of a data pipeline dry-run.
What's Changed
- Chart version update by @goranbs in #184
- Carbontracker by @goranbs in #187
- Carbontracker by @goranbs in #188
Full Changelog: 0.4.8...0.5.0