Releases: ddeutils/ddeapp-flask
Releases · ddeutils/ddeapp-flask
0.3.0
✨ Features
- 🎯 feat: migrate pipeline objects to service. (2024-05-11)
- 🎯 feat: migrate legacy node to service without diff check. (2024-05-11)
- 🎯 feat: migrate backup process to NodeMigrate. (2024-05-11)
- 🎯 feat: migrate old node initial and rename execute func. (2024-05-10)
- 🎯 feat: add validate table on target database after do any process. (2024-05-10)
- 🎯 feat: add auto create table on node init process. (2024-05-10)
- 🎯 feat: migrate legacy out on ingestion task. (2024-05-10)
- 🎯 feat: add add external parameters on MapParameterService. (2024-05-10)
- 🎯 feat: migrate ingest method from legacy and add convertor to core. (2024-05-10)
- 🎯 feat: migrate Control from legacy successful. (2024-05-09)
- 🎯 feat: add push and create control data. (2024-05-09)
- 🎯 feat: add pull control data. (2024-05-09)
- 🎯 feat: add enter and exit override method to Task. (2024-05-08)
- 🎯 feat: add test task for create custome task logging to table. (2024-05-08)
- 🎯 feat: add control statement that will use instead LegacyControl. (2024-05-08)
- 🎯 feat: add NodeLocal for loading csv file to target database. (2024-05-07)
✒️ Code Changes
- 🚧 refactored: remove legacy code from main. (2024-05-11)
- 🚧 refactored: migrated code from legacy Node to core. (2024-05-10)
- 🚧 refactored: remove Action and Function from legacy. (2024-05-10)
- 🚧 refactored: refactore code and rewrite return list to iterator. (2024-05-09)
- 🚧 refactored: remove html code that not uses. (2024-05-07)
🐛 Fix Bugs
- ⚙️ fixed: auto create from control setup. (2024-05-11)
- ⚙️ fixed: remove condition that filter out column to ingest. (2024-05-10)
- ⚙️ fixed: default passed from serial does not valid value. (2024-05-10)
- ⚙️ fixed: remove merge_dicts from core. (2024-05-09)
- ⚙️ fixed: fix testcase that change statement. (2024-05-07)
📮 Dependencies
- 📌 deps: remove strenum package and use inherite from str. (2024-05-08)
0.2.2
✨ Features
- 🎯 feat: add node legacy for initial ingest. (2024-05-07)
- 🎯 feat: add create statement on modern node service. (2024-05-07)
- 🎯 feat: add ActionQuery to use instead legacy Action for pushdown query. (2024-05-07)
- 🎯 feat: add schema setup for target database for the first setup. (2024-05-06)
✒️ Code Changes
- 🎨 style: change code style that exceed limi length. (2024-05-07)
- 🚧 refactored: add method on services file that will implement. (2024-05-07)
- 🎨 style: add debug text for table control does not exists. (2024-05-06)
- 🚧 refactored: edit char length in code. (2024-05-06)
🐛 Fix Bugs
- ⚙️ fixed: fix path of logging utils that does not change from old ver. (2024-05-07)
- ⚙️ fixed: uncomment control tables for frontend. (2024-05-06)
- ⚙️ fixed: fix legacy path that does not match with real path. (2024-05-06)
0.2.1
✨ Features
- 🎯 feat: add middleware wrapper (2024-01-13)
- 🎯 feat: add pg_stat_statements to postgres docker compose file (2024-01-04)
✒️ Code Changes
- 🧪 tests: move testcase on any dir to main test dir. (2024-05-06)
- 🚧 refactored: run pre-commit for all files. (2024-05-06)
- 🚧 refactored: refactored main app code that raise when start-up. (2024-05-06)
- 🎨 styled: change comment license length line (2024-01-14)
- 🧪 test: add app test case (2024-01-14)
- 🚧 refactored: change components to blueprints (2024-01-14)
- 🚧 refactored: change format code with pre-commit (2024-01-14)
- 🧪 test: add test workflow (2024-01-14)
- 🚧 refactored: change application to app (2024-01-14)
- 🧪 tests: update validators test cases (2024-01-13)
- 🚧 refactored: upgrade import module that use inside package (2024-01-13)
- 🧪 test: prepare test case (2024-01-13)
- 🚧 refactored: change infomation of .{demo}.env file (2023-12-17)
- 💡 v0.2.0: delete base from legacy and move objects to legacy (#6) (2023-06-05)
🗃️ Documents
- 📄 docs: update README.md file (2023-12-17)
🐛 Fix Bugs
- ⚙️ fixed: edit docker compose file for postgres db. (2024-05-06)
- ⚙️ fixed: remove comma on test workflow. (2024-05-05)
- ⚙️ fixed: prepare for run on local (2023-12-17)
📦 Build & Workflow
- 🧰 build: add env to publish workflow. (2024-05-06)
- 🧰 build: upgrade pip installation with uv on test workflow. (2024-05-06)
- 🧰 build: fixed docker compose raise permission denied. (2024-05-06)
- 🧰 build: add docker provisioning on test workflow. (2024-05-06)
- 🧰 build: update version on init file. (2024-05-05)
- 🧰 build: add deps installation on test workflow. (2024-05-05)
- 🧰 build: change cache type on tests workflow (2024-01-14)
📮 Dependencies
- 📌 deps: change analytic packages deps on requirement file. (2024-05-06)
- 📌 deps: update dependencies on pystan. (2024-05-06)
- 📌 deps: update dependencies and split requirement files for analytic. (2024-05-05)
- 📌 deps: update flask dependencies that support flask 3.0 (2024-01-14)
v0.2.0
Version 0.2.0
- Adding and Fixing #? Ingestion
- Add updatable merge from payload
- Add updatable common from payload
- Change level of
utils
directory to insidecore
directory - Adding unittests for
core
directory- Add
validators
test - Add
statements
test
- Add
- Documents rename from
DAF
toDFA
v0.1.0
Version 0.1.0
- Adding unittests
- Add to
core
directory
- Add to
- Fixing #? bug of re-create function when start this application at the first time
- Compare
Dataclasses
vsAttrs
vsPydantic
- Change the
base
file from legacy slot classes to Pydantic models- Change base file to validators and statements files
- Add load object for loading
yaml
file
- Add status Enum object
- Change the
v0.0.1
Version 0.0.1
-
Adding Migrate table properties process
-
Adding Load file from local to target table
-
Change app framework from function to class instance framework code
-
Add frontend for monitoring and operation data pipelines
- Add Home page
- Adding Flask-Login for login and register process
- Add Login and Register page
-
Adding Web catalogs for initialize authentication process
- Add User registration
- Add Role assignment
- Add Group assignment
- Add Policy assignment
- Mapping all relation together
Note: Version 0.*.*
still support requirement from pre-version 1.*.*
and pre-Version 2.*.*
*
Pre Version 2.1.0
- Add foreign key feature in table configuration
- Adding initial data with Json files with key
file
orfiles
Pre-v2.1.0
Pre Version 2.0.4
- Add new table (
ai_report_forecast_brand
) for sync data to forecast adjust dashboard - Add new table (
ai_report_article_listing_master
) for channel value mapping to platform - Fixing #? condition for rounding
max_qty
value to integer type - Change adjustment logic for product class and min/max value
- Adding
ctr_task_schedule
for control trigger for the data pipeline running- Add schedule,
trigger
, for run data pipeline from updated S3 files trigger - Add schedule,
cron job
, for run data pipeline with manual value
- Add schedule,
- Adding ingest action mode,
update
, for update data to target table - Adding
ctr_s3_logging
for keep log from AWS Batch Job which ingest data from S3 to Database
withsrc_
prefix tables - Fixing #? logic of calculation rolling data for product class
- Fixing #? logic of filter condition data for min max
- Adding
ai_article_vendor_master
- Adding filter
cat_mch3_code
from source file to article master table - Adding refresh table (
vacuum
) process in retention module
Pre Version 2.0.3
- Add new source file from AWS S3 (
sales_order
) - Re-structure of
actual_sales_transaction
- Add new field for keep frequency for
product_class_freq
- Change logic for get default
product_class
withproduct_class_freq
only - Change logic of min/max value with custom Month Of Supply (MOS) such as
{A: 2, B: 2, C: 1}
receive withimp_min_max_mos_adjust_fc/rdc/dc
tables - Change
table_type
of replenishment tables fromtransaction
toreport
Pre Version 2.0.2
- Adding Flask-APSchedule for re-create tables, which solving table storage
- Adding Ingestion Module for put data from platform in merge case
- Adding Analytic a table dependency from catalog config
- Change data type from
double precision
tonumeric
Pre Version 2.0.1
- Adding Flask-APSchedule for control retention module and task checker
- Adding Ingestion Module for put data from platform in common case
- Adding
GET
request for check background task heartbeat after ingest data
- Adding
- Adding RDC hierarchy level between DC and Franchise
- Change catalog config format from create statement to mapping features
- Fixing #? adjustment and article replacement logic
- Fixing #? allocate, proportion, and accumulate logic
Pre Version 2.0.0
- Adding
GET
request for check background task heartbeat after run data pipeline - Fixing #? the normal flow was changed to foreground task function
- Adding support background task
- Adding support task monitoring with logging/process table in database
- Adding component which keep framework and analytic routes
Note: pre-version from 1.x.x
to 2.x.x
was change application file skeleton
Pre Version 1.1.1
- Adding
close_running
function for server down scenario - Adding
GET
request for shutdown framework application - Fixing #?
GET
request for health check without and include headers - Adding logging handler
- Fixing #? config
*.yaml
file can keep more than one table process - Fixing #? order quantity report logic
Pre Version 1.1.0
- Adding support filter process name in node function
- Adding support pipeline function for run data with multi-table processes
Pre Version 1.0.0
- Initial release
- Original creation,
2021-10-01