Skip to content

CruGlobal/dse-python-utils

Repository files navigation

cru-dse-utils

This is a package of useful functions developed by the Cru Data Sciences & Engineering team. The package includes the following files:

  • general.py: Contains general data extraction related functions.
  • auth.py: Contains functions for fetching credentials.
  • bigquery.py: Contains functions for bigquery operations.
  • gcs.py: Contains functions for Google Cloud Storage operations.
  • dbt.py: Contains functions for dbt operations.

Installation

To install the package, run the following command: pip install cru-dse-utils

Usage

To use the package, import the desired functions from the appropriate subfolder. For example: from cru_dse_utils import get_request

Refer to the function docstring for instructions how to use the functions

Contributing

If you would like to contribute to the package, please follow these steps:

  1. Fork the repository.
  2. Create a new branch for your changes.
  3. Make your changes and commit them with descriptive commit messages.
  4. Push your changes to your fork.
  5. Submit a pull request to the main repository.

License

This package is licensed under the MIT License. See the LICENSE file for more information.