Skip to content

[IN DEVELOPMENT] A small Python package to ease the conversion of processed climate data from CSV to Parquet.

License

Notifications You must be signed in to change notification settings

vimc/clim2parquet

Repository files navigation

clim2parquet: Convert climate data CSVs to Parquet

License: MIT PyPI - Version PyPI - Python Version codecov Project Status: WIP – Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

clim2parquet is a small Python package for internal use at RESIDE-IC to convert prepared climate time-series data into Parquet files in support of climate-informed infectious disease modelling for VIMC.

Installation

clim2parquet can be installed from GitHub using a Python package manager.

pip install clim2parquet@git+https://github.com/vimc/clim2parquet

Quick start

clim2parquet is intended to be used internally with access to climate data generated at Imperial College. With access to this data, you can convert country-specific climate data time-series by GADM admin level into Parquet files.

import clim2parquet

# get available data sources
clim2parquet.get_data_names()

# with `dir_from` as your country-specific climate data source
# for GADM admin level 1 (largest sub-national unit)
clim2parquet.clim_to_parquet(
    data_source="CHIRPS", dir_from=dir_from, dir_to=".", admin_level=1
)

# converting multiple data sources and admin levels at once
clim2parquet.clim_to_parquet(
    data_source=["CHIRPS", "PERSIANN"], dir_from=dir_from,
    dir_to=".", admin_level=[0, 1]
)

We currently support finding and converting the following climate data sources:

  • CHIRPS
  • ERA5 mean temperature
  • ERA5 maximum temperature
  • ERA5 minimum temperature
  • ERA5 relative humidity
  • ERA5 specific humidity
  • PERSIANN

Help

To report a bug please open an issue or get in touch with RESIDE-IC.

Contribute

Contribute via a pull request.

About

[IN DEVELOPMENT] A small Python package to ease the conversion of processed climate data from CSV to Parquet.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages