This is a package of useful functions developed by the Cru Data Sciences & Engineering team. The package includes the following files:
general.py
: Contains general data extraction related functions.auth.py
: Contains functions for fetching credentials.bigquery.py
: Contains functions for bigquery operations.gcs.py
: Contains functions for Google Cloud Storage operations.dbt.py
: Contains functions for dbt operations.
To install the package, run the following command:
pip install cru-dse-utils
To use the package, import the desired functions from the appropriate subfolder. For example:
from cru_dse_utils import get_request
Refer to the function docstring for instructions how to use the functions
If you would like to contribute to the package, please follow these steps:
- Fork the repository.
- Create a new branch for your changes.
- Make your changes and commit them with descriptive commit messages.
- Push your changes to your fork.
- Submit a pull request to the main repository.
This package is licensed under the MIT License. See the LICENSE file for more information.