Skip to content

Releases: DataKitchen/dataops-testgen

4.16.3

29 Jul 01:51
Compare
Choose a tag to compare

Features

  • Add Run Tests button to Test Definitions page (bc24c5c)
  • add test_name filtering to test definitions page (fba3247)
  • table groups: enforce verification before saving (4976bf6)
  • data-catalog: add table create script dialog (1028580)
  • table group: add checkbox for including in project dashboard (0bedec1)
  • table group: allow explicit table list to be split by newlines (3c58b85)

Bug Fixes

  • miscellaneous bug fixes and style improvements (1768565)
  • hygiene issue: update criteria for Unexpected US States (1ebd004)
  • issue report: prevent infinite loop (3aee19e)
  • analytics: username missing in background processes (8208112)
  • wizards: disable checkbox on last step (285691b)
  • copy test: typo in query (ebca49d)
  • table group: strip whitespace from explicit table list for preview (dfd9c2f)
  • hygiene issues: remove icons in action filter before query (0a7354d)
  • data catalog: error in table create script (e1ee311)
  • connections: decode private key when previewing table group (e91e414)
  • connections: url not saving as entered (e0da82e)

Refactors

  • remove unused files (18b8e04)
  • connections: have individual forms for each flavor (fee6e6d)

Docker Image

datakitchen/dataops-testgen:v4.16.3

PyPI Package

dataops-testgen==4.16.3

4.12.6

16 Jul 18:17
Compare
Choose a tag to compare

Features

  • add help menu, support mailto, and upgrade notification (325569b)
  • project-dashboard: redesign cards layout (5aabcbd)
  • Adding duplicated rows test and hygiene issues; Tuning test selection (4e206cf)
  • version: get latest release versions from s3 (e4d3d14)
  • telemetry: Capturing failed logins; Persistent instance ID (99c1b83)
  • test-definitions: align matching attributes for aggregate tests (f502fdf)
  • tests: add aggregate balance percent and range tests (91d7121)
  • test suites: warn users before unlocking a test definition (009d3fb)
  • tests: Support moving and copying test definition to same suite with different columns TG-899 (d064811)
  • data-catalog: add test count and dropdown options for export (fa3c125)
  • export: add dropdown options to test definitions and result pages (e68f67d)
  • schedules: add schedule dialogs to table groups and test suites pages (bc9a54e)
  • allow deleting profiling runs (2aba7f0)
  • allow filtering by partial column name (c770e15)

Bug Fixes

  • test runs: sample the source data lookup DataFrame (5aff0e0)
  • source-data: bug when sampling dataframe (aff987a)
  • logo: prevent logo resize (3f48615)
  • source-data: preserve sort order when sampling (72f8692)
  • snowflake: upgrade python connector to fix certificate error (b6d5741)
  • docker: missing arg for support email (87c0692)
  • table-groups: handle connections with no flavor code (b44fb46)
  • test runs: hide score if no tests were run (cb5cda4)
  • upgrade: drop views before altering table (9c846e1)
  • Inserting the Test Run record earlier in the process (8a72804)
  • Allowing literal underscores in the table group pattern fields (a43194e)
  • data-catalog: add commas when displaying numbers (e72b2b4)
  • data-catalog: column tags not updated when table fully selected (c98b12e)
  • sort: close popover on apply (4beff73)
  • misc styling improvements (5fcf9d3)
  • tests: flag invalid tests and display Error details in test results (56d2d0d)
  • Do not generate Required Entity tests for empty tables (773e771)
  • grid: change to current selection not reflected (633c64f)
  • issue-report: error status in test history breaks export (add3610)
  • Allowing literal underscores in the table group pattern fields (3d1d469)
  • profiling: don't apply sample ratio to date_days_present (a089c96)
  • table-groups: sampling incorrectly displayed (cfe80a1)
  • select: handle none values in run dialogs (8a41d6c)
  • connections: stop connection form from re-rendering needlessly (c914376)
  • Fixing hygiene issues lookup queries (3d3191b)
  • grid: dialogs on grids close abruptly (4d0b330)
  • misc styling improvements (aa6007e)

Refactors

  • table groups: implement page as vanjs components (58159e4)
  • table groups: lock the schema field when profiling or tests exist (d3e37cd)
  • flavor-service: update connect args and templated variables (aef8d1a)
  • test runs: allow deleting multiple test runs (d878004)
  • test definitions: display profiling and generation date (435aa22)
  • test results: style and arrangement of elements in result details (ea88bbb)

Miscellaneous

  • test runs: limit result history in issue PDF report (d406e7b)
  • apply limit to hygiene issue report (2d2dc39)
  • set limit to source data lookups in ui dialog (c48bd3a)
  • Fixing the test result page for the Dupe_Rows test (84711e7)
  • analytics: add usage counts to login event (af3d648)
  • Addressing code review feedback (99513b6)
  • Addressing code review feedback (9d37db6)
  • upgrade Streamlit from 1.44.1 to 1.46.1 (c481d0d)

Docker Image

datakitchen/dataops-testgen:v4.12.6

PyPI Package

dataops-testgen==4.12.6

testgen-1.0.1

16 Jul 18:01
59b4a93
Compare
Choose a tag to compare

A Helm chart for Kubernetes

4.1.3

24 Jun 04:11
Compare
Choose a tag to compare

Features

  • enable ui plugin support (97cf28d)

Bug Fixes

  • update label and help text in connection and table group forms (73542c5)
  • ui: add light mode colors to warning alert (fd2c3e9)
  • connections: glitches and inconsistencies with the edit form (c1776f9)
  • connections: pre-populate connection url in js component (23e182b)

Refactors

  • connections: migrate page ui from streamlit to javascript (ef8e2ba)
  • rename stylesheet loading tag (b504ec3)

Miscellaneous

Docker Image

datakitchen/dataops-testgen:v4.1.3

PyPI Package

dataops-testgen==4.1.3

4.1.2

17 Jun 17:22
Compare
Choose a tag to compare

Features

  • scoring: enable per-column filtering for score cards (24f0668)
  • issue-report: add column tags to pdf reports (6b6437f)
  • data-catalog: add export to excel (e044caf)
  • data-column: add column history dialog (813898b)
  • data-catalog: add duplicates bar (1c800d1)
  • data-catalog: add search options and make case insensitive (2213662)
  • data-catalog: add related test suites card (f98d48d)
  • data-catalog: display as-of date for table size (d623951)
  • data-catalog: support removing dropped tables (0288325)
  • data-catalog: indicate empty tables on tree icon (a721d86)
  • data-catalog: highlight zero record/value counts (a1de489)
  • data-catalog: indicate null and other values in frequency bars (95c7ef4)
  • data-preview: use select distinct (467ef02)
  • data-catalog: highlight columns with no values (fdcde39)

Bug Fixes

  • scoring: add missing label for data product category (f0a97c0)
  • scoring: replace grid with wrap-enabled columns in scorecard categories (7d10838)
  • data-catalog: update drop date only once (c9826f2)
  • improve text and tooltip in data catalog and test suites (2a5fe7f)
  • data-catalog: remove description field from multi-edit mode (2882b52)
  • run-dialog: cli command error in run tests (b8602e2)
  • users: password required when editing user (f0aba17)
  • test-definitions: test results should not prevent manual deletion of tests (ebf4a78)
  • export: round error when value is null (00ba4f1)
  • use spinner to prevent grid intermittently refreshing (1125db6)
  • use unnest array for better update performance (8d14b65)
  • update null value representation in source data displays (e3c6ca5)

Refactors

  • scoring: display loading message for long wait periods (684f1c9)
  • scoring: use scorecard category as default breakdown grouping (60ede57)
  • data-catalog: move filter and empty states to vanjs (b3ae976)
  • download excel dialogs (0f206f3)

Miscellaneous

  • scoring: display info alert when no filters are applied (1157d07)
  • security: upgrading tornado and xz (6f8c16b)

Docker Image

datakitchen/dataops-testgen:v4.1.2

PyPI Package

dataops-testgen==4.1.2

testgen-1.0.0

28 May 21:56
9550f69
Compare
Choose a tag to compare

A Helm chart for Kubernetes

4.0.12

23 May 01:09
Compare
Choose a tag to compare

Bug Fixes

  • scoring: flush empty list of results and breakdown items (adf2f1f)
  • scoring: remove deleted entries when refreshing history (40b1e6c)
  • scoring: default to datetime.min when comparing datetimes (4d4c819)
  • test-schedules: incorrect project parameter passed to cli (f33ee4c)
  • scheduler: cannot cancel scheduled runs (0d1ec36)

Miscellaneous

  • rotate log files at midnight (8aa4236)

Docker Image

datakitchen/dataops-testgen:v4.0.12

PyPI Package

dataops-testgen==4.0.12

4.0.9

21 May 20:21
Compare
Choose a tag to compare

⚠ BREAKING CHANGES

  • auth: The JWT signing key has to be set through env (c893444)

Features

  • scheduler: Adding scheduling capabilities (a9d8ac2)
  • scoring: add all categories for breakdown grouping (d4219af)
  • auth: The JWT signing token is now configurable (c893444)

Bug Fixes

  • scheduler: Preventing the scheduler to crash on recoverable failures (c2c7143)
  • navigation: upgrade libraries and prevent events handled twice (6b1d34d)
  • cli: make test result statuses consistent with ui (40b2383)
  • analytics: simplify source datapoint - address review feedback (9582fa5)
  • jwt: display jwt env variable error to user (cce9a8a)
  • navigation: missing project_code in links (069f4a7)
  • test-definitions: broken add/edit form (03b0eec)
  • sql: grant permissions for new job_schedules table (fb630b6)
  • score-breakdown: display line for NULL grouping value (e04ca59)
  • router: cookies are detected late on deployed instances (656b7a6)
  • connection: bug in snowflake connection form (8cefbce)
  • sidebar: logout cookies and case insensitive usernames (2832d09)
  • avoid cross-site scripting when rendering html (290b2d2)
  • scoring: force history date into utc timezone (b836299)
  • cli: print run id even if score refresh fails (7416dc4)
  • test-results: handle non-existent test definitions (77cd255)
  • tests: skip column validation for aggregate tests (92d4456)
  • test-schedules: incorrect parameters passed to cli (c950481)
  • data-preview: use top for sql server (852ed17)

Refactors

  • routing: improve session management and navigation (6aac326)
  • remove dead code (4cd2c6c)

Miscellaneous

  • scheduler: Removing the test generation scheduling (bfca74f)
  • scheduler: Addressing code review feedback (8baea14)
  • scheduler: Addressing code review feedback (01ab812)
  • scheduler: Fixing how we clean up the timezone selectbox (d08e066)
  • ui: add testid to elements for ease of locatability (82ac7fc)
  • scheduler: Improving how loaded jobs are logged (52c0925)
  • scheduler: Changing how we clean the expr field (3b01cf2)
  • analytics: add events for nav, execution, and dialogs (df630cd)

Docker Image

datakitchen/dataops-testgen:v4.0.9

PyPI Package

dataops-testgen==4.0.9

3.7.9

14 May 19:31
Compare
Choose a tag to compare

Bug Fixes

  • connection: bug in snowflake connection form (2195837)

Docker Image

datakitchen/dataops-testgen:v3.7.9

PyPI Package

dataops-testgen==3.7.9

3.7.8

01 May 21:57
Compare
Choose a tag to compare

Bug Fixes

  • charts: Fixing a variety of small issues with the app charts (18af230)
  • handle none data type in profiling ddf (c16cb92)
  • data-catalog: joining profiling results did not include table_name (e9cd3be)

Miscellaneous

  • cli: add run id to profiling and test execution outputs (656d541)

Docker Image

datakitchen/dataops-testgen:v3.7.8

PyPI Package

dataops-testgen==3.7.8