v0.1.0
Initial release of the Atum service
Server
- has two endpoints
/api/v1/createPartitioning
to register or retrieve a partitioning and optionally establish a a relation with another partitioning/api/v1/createCheckpoint
to record measurement data
- connects to Postgres DB that stores the data
- newly created partitioning automatically contains the count function to measure
Agent
- spawn context based on key provided (partitioning)
- add measuring functions; supported now are:
- count
- distinctCount
- aggregatedTotal - sum of values in the column
- absAggregatedTotal
- hashCrc32
- provides interfaces to measure data completeness on DataFrames (create checkpoints)
Database
- created, including DB Roles and an ownership model of the database objects for the Roles
- stores and processes data related to:
- Partitioning
- Additional Data
- Measurement
- Measure Definition
- Checkpoint
- Flow a concept how to describe the data as they go through the systems and how different partitionings relate.