Skip to content

Commit

Permalink
build(datasets): update list of extras for Ibis 10 (#1003)
Browse files Browse the repository at this point in the history
* build(datasets): update list of extras for Ibis 10

Signed-off-by: Deepyaman Datta <[email protected]>

* Update RELEASE.md

Signed-off-by: Deepyaman Datta <[email protected]>

---------

Signed-off-by: Deepyaman Datta <[email protected]>
  • Loading branch information
deepyaman authored Feb 10, 2025
1 parent 0779298 commit 0b0cd00
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 4 deletions.
4 changes: 3 additions & 1 deletion kedro-datasets/RELEASE.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,14 @@
# Upcoming Release

## Major features and improvements

- Added a parameter to enable/disable lazy saving for `PartitionedDataset`.
- Replaced `trufflehog` with `detect-secrets` for detecting secrets within a code base.
- Added `ibis-athena` and `ibis-databricks` extras for the backends added in Ibis 10.0.

## Bug fixes and other changes

- Fix polars.CSVDataset `save` method on Windows using `utf-8` as default encoding.
- Fixed `polars.CSVDataset` `save` method on Windows using `utf-8` as default encoding.
- Made `table_name` a keyword argument in the `ibis.FileDataset` implementation to be compatible with Ibis 10.0.

## Breaking Changes
Expand Down
8 changes: 5 additions & 3 deletions kedro-datasets/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ dask = ["kedro-datasets[dask-parquetdataset, dask-csvdataset]"]
databricks-managedtabledataset = ["kedro-datasets[hdfs-base,s3fs-base]"]
databricks = ["kedro-datasets[databricks-managedtabledataset]"]

geopandas-genericdataset = ["geopandas>=0.8.0, <2.0", "fiona >=1.8, <2.0"]
geopandas-genericdataset = ["geopandas>=0.8.0, <2.0", "fiona>=1.8, <2.0"]
geopandas = ["kedro-datasets[geopandas-genericdataset]"]

holoviews-holoviewswriter = ["holoviews>=1.13.0"]
Expand All @@ -50,9 +50,11 @@ huggingface-hfdataset = ["datasets", "huggingface_hub"]
huggingface-hftransformerpipelinedataset = ["transformers"]
huggingface = ["kedro-datasets[huggingface-hfdataset,huggingface-hftransformerpipelinedataset]"]

ibis-athena = ["ibis-framework[athena]"]
ibis-bigquery = ["ibis-framework[bigquery]"]
ibis-clickhouse = ["ibis-framework[clickhouse]"]
ibis-dask = ["ibis-framework[dask]"]
ibis-dask = ["ibis-framework[dask]<10.0"]
ibis-databricks = ["ibis-framework[databricks]"]
ibis-datafusion = ["ibis-framework[datafusion]"]
ibis-druid = ["ibis-framework[druid]"]
ibis-duckdb = ["ibis-framework[duckdb]"]
Expand All @@ -62,7 +64,7 @@ ibis-impala = ["ibis-framework[impala]"]
ibis-mssql = ["ibis-framework[mssql]"]
ibis-mysql = ["ibis-framework[mysql]"]
ibis-oracle = ["ibis-framework[oracle]"]
ibis-pandas = ["ibis-framework[pandas]"]
ibis-pandas = ["ibis-framework[pandas]<10.0"]
ibis-polars = ["ibis-framework[polars]"]
ibis-postgres = ["ibis-framework[postgres]"]
ibis-pyspark = ["ibis-framework[pyspark]"]
Expand Down

0 comments on commit 0b0cd00

Please sign in to comment.