A Rule-Based discount calculating engine for a retail store. The engine reads transaction data, applies various discount rules based on the product, date, and other criteria, and writes the results back to a database.
-
Updated
May 13, 2024 - Scala
A Rule-Based discount calculating engine for a retail store. The engine reads transaction data, applies various discount rules based on the product, date, and other criteria, and writes the results back to a database.
♻️Pipeline for Extract, Transform and Load articles from news websites into an SQLite database.
This Repo shows how to build a CI/CD process with Azure Pipelines. A python script places in an Azure Repo which extracts data from an API and exports the data to a blob on Azure cloud is utilized for this process.
ETL en lenguaje de programación R, para visualizar el conteo de casos de COVID 19 en Colombia
ETL Pipelines and Dashboard visualizatons
This project demonstrates an ETL pipeline using Microsoft Azure for IMDb Movie Rating Dataset analysis. It covers data extraction from Azure Blob Storage, transformation with Azure Databricks, and loading into Azure SQL using Azure Data Factory. The pipeline automates insights generation and is a practical example of cloud-based data engineering.
Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse
Repository of a Data Science Project
An ETL templating system that takes the busywork out of your data migrations.
Scheduled jobs to load the database with student login data.
A comprehensive ETL pipeline and sales analysis project leveraging Microsoft Azure and PySpark, designed to optimize e-commerce sales by providing actionable insights through detailed data analysis.
Sync service for seamless synchronization and transformation of data from AMRS to ETL flat tables
A gui that calls a script to scrape meta critic, create a playlist and store metadata.
Power BI sales project. Creating an automated Power BI dashboard.
Codes for data flow between models, data post-process, and visualization
GitHub repository for Toronto Transit Commission Data warehousing project
Regtab is a Java library for data extraction from arbitrary tables represented in machine-readable formats
Universal Luigi ETL pipeline. Validates data received from external sources. Extracts, transforms them and lands.
ETL and database Super-project for Antikytheria dataset
Stream data directly from an API using Apache Beam to BigQuery.
Add a description, image, and links to the etl-automation topic page so that developers can more easily learn about it.
To associate your repository with the etl-automation topic, visit your repo's landing page and select "manage topics."