Release/0.9 - final version bump and docs (#132)

- Final version bump
- Documentation update
- Ran ruff (2 files changed)

---------

Co-authored-by: Danny Meijer <[email protected]>

README.md

@@ -198,6 +198,14 @@ the `pyproject.toml` entry mentioned above or installing through pip.
     - SE Provides Data Quality checks for Spark DataFrames.
     - For more information, refer to the [Spark Expectations docs](https://engineering.nike.com/spark-expectations).
 
+- __Spark Connect and Delta:__
+    Koheesio is ready to be used with Spark Connect. In case you are using Delta package in combination with a remote/connect session, you are getting full support in Databricks and partial support for Delta package in Apache Spark. Full support for Delta in Apache Spark is coming with the release of PySpark 4.0.
+    - The spark extra can be installed by adding `koheesio[spark]` to the `pyproject.toml` entry mentioned above.
+    - The spark module is available through the `koheesio.spark` module.
+    - The delta module is available through the `koheesio.spark.writers.delta` module.
+    - For more information, refer to the [Databricks documentation](https://docs.databricks.com/).
+    - For more information on Apache Spark, refer to the [Apache Spark documentation](https://spark.apache.org/docs/latest/).
+
 [//]: # (- **Brickflow:** Available through the `koheesio.integrations.workflow` module; installable through the `bf` extra.)
 [//]: # (    - Brickflow is a workflow orchestration tool that allows you to define and execute workflows in a declarative way.)
 [//]: # (    - For more information, refer to the [Brickflow docs](https://engineering.nike.com/brickflow))

src/koheesio/__about__.py

@@ -12,7 +12,7 @@
 
 LICENSE_INFO = "Licensed as Apache 2.0"
 SOURCE = "https://github.com/Nike-Inc/koheesio"
-__version__ = "0.9.0rc6"
+__version__ = "0.9.0"
 __logo__ = (
     75,
     (

src/koheesio/integrations/box.py

@@ -10,7 +10,7 @@
 * Application is authorized for the enterprise (Developer Portal - MyApp - Authorization)
 """
 
-from typing import Any, Dict, Optional, Union, IO
+from typing import IO, Any, Dict, Optional, Union
 from abc import ABC
 from io import BytesIO, StringIO
 from pathlib import PurePath

src/koheesio/spark/delta.py

@@ -20,7 +20,7 @@ class DeltaTableStep(SparkStep):
 
     DeltaTable aims to provide a simple interface to create and manage Delta tables.
     It is a wrapper around the Spark SQL API for Delta tables.
-    
+
 
     <!--- TODO: handle errors like this one:
     #     AnalysisException: You are trying to read a Delta table ... that does not have any columns.