Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
-
Updated
May 31, 2024 - Python
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
This pipeline can be used to collect statistical information about all games, distributed through the Steam platform.
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
Luigi.xml
Pycon 2017- Creating ETL tasks with Luigi package
An NLP framework for clinical phenotyping. Docker | Python | Solr | OMOP. http://claritynlp.readthedocs.io/en/latest/
Материалы для курса Введение в Data Engineering: дата пайплайны
Common Data Usage is a tool for graph analysis of Open Government Data Usage in open-source projects
This is a backend development attempt to recreate the 1985 Level 1 of Super Mario Bros (Version 1) !!!
This is a learning repository about DVC Data Version Control and Luigi Pipelines
Data extraction, transformation and loading pipeline for the Princess Maxima Center
Run Luigi tasks as Jobs on K8s - An updated Kubernetes contrib
A simple project to analyse Malaysian airports - an opportunity to play with tools like Luigi, Docker, and Metabase as part of an end-to-end analytics framework.
Replication package for the paper "Systematically Covering Input Structure" published at ASE 2019
Add a description, image, and links to the luigi topic page so that developers can more easily learn about it.
To associate your repository with the luigi topic, visit your repo's landing page and select "manage topics."