@@ -40,22 +40,23 @@ pip install "pyiceberg[s3fs,hive]"
40
40
41
41
You can mix and match optional dependencies depending on your needs:
42
42
43
- | Key | Description: |
44
- | ------------ | -------------------------------------------------------------------- |
45
- | hive | Support for the Hive metastore |
46
- | glue | Support for AWS Glue |
47
- | dynamodb | Support for AWS DynamoDB |
48
- | sql-postgres | Support for SQL Catalog backed by Postgresql |
49
- | sql-sqlite | Support for SQL Catalog backed by SQLite |
50
- | pyarrow | PyArrow as a FileIO implementation to interact with the object store |
51
- | pandas | Installs both PyArrow and Pandas |
52
- | duckdb | Installs both PyArrow and DuckDB |
53
- | ray | Installs PyArrow, Pandas, and Ray |
54
- | daft | Installs Daft |
55
- | s3fs | S3FS as a FileIO implementation to interact with the object store |
56
- | adlfs | ADLFS as a FileIO implementation to interact with the object store |
57
- | snappy | Support for snappy Avro compression |
58
- | gcsfs | GCSFS as a FileIO implementation to interact with the object store |
43
+ | Key | Description: |
44
+ | ------------ | ------------------------------------------------------------------------- |
45
+ | hive | Support for the Hive metastore |
46
+ | glue | Support for AWS Glue |
47
+ | dynamodb | Support for AWS DynamoDB |
48
+ | sql-postgres | Support for SQL Catalog backed by Postgresql |
49
+ | sql-sqlite | Support for SQL Catalog backed by SQLite |
50
+ | pyarrow | PyArrow as a FileIO implementation to interact with the object store |
51
+ | pandas | Installs both PyArrow and Pandas |
52
+ | duckdb | Installs both PyArrow and DuckDB |
53
+ | ray | Installs PyArrow, Pandas, and Ray |
54
+ | daft | Installs Daft |
55
+ | s3fs | S3FS as a FileIO implementation to interact with the object store |
56
+ | adlfs | ADLFS as a FileIO implementation to interact with the object store |
57
+ | snappy | Support for snappy Avro compression |
58
+ | gcsfs | GCSFS as a FileIO implementation to interact with the object store |
59
+ | rest-sigv4 | Support for generating AWS SIGv4 authentication headers for REST Catalogs |
59
60
60
61
You either need to install ` s3fs ` , ` adlfs ` , ` gcsfs ` , or ` pyarrow ` to be able to fetch files from an object store.
61
62
0 commit comments