8000 Releases · sparkdq-community/sparkdq · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Releases: sparkdq-community/sparkdq

8000

v0.10.0

01 Jun 10:43
Compare
Choose a tag to compare

v0.10.0 (2025-06-01)

Features

  • engine: Add support for reference-based integrity checks (#51, f33565b)

Detailed Changes: v0.9.0...v0.10.0

v0.9.0

28 May 16:38
Compare
Choose a tag to compare

v0.9.0 (2025-05-28)

Features

  • Add ColumnGreaterThanCheck with validation logic and configuration (#48, e46734e)

Detailed Changes: v0.8.1...v0.9.0

v0.8.1

27 May 18:40
Compare
Choose a tag to compare

v0.8.1 (2025-05-27)

Bug Fixes

  • deps: Set minimum required Pydantic version to 2.8.0 (#47, 8fe75ab)

Detailed Changes: v0.8.0...v0.8.1

v0.8.0

27 May 15:05
Compare
Choose a tag to compare

v0.8.0 (2025-05-27)

Features

  • Update ColumnLessThanCheck to use a limit expression (#45, 06df3b3)

Detailed Changes: v0.7.1...v0.8.0

v0.7.1

25 May 15:37
Compare
Choose a tag to compare

v0.7.1 (2025-05-25)

Continuous Integration

  • dependabot: Add ecosystem for actions (#39, 15e0782)

Refactoring

  • checks: Dynamically register CheckConfig classes in init.py (#43, 33023a8)

Detailed Changes: v0.7.0...v0.7.1

v0.7.0

21 May 16:19
Compare
Choose a tag to compare

v0.7.0 (2025-05-21)

Features


Detailed Changes: v0.6.1...v0.7.0

v0.6.1

19 May 17:22
Compare
Choose a tag to compare

v0.6.1 (2025-05-19)

Bug Fixes

  • engine: Ensure aggregate checks run on original input DataFrame (#35, 4dbd7a5)

Detailed Changes: v0.6.0...v0.6.1

v0.6.0

17 May 16:10
Compare
Choose a tag to compare

v0.6.0 (2025-05-17)

Documentation

  • README: Add spark installation guideline link (7c1049c)

  • sphinx: Add example link (c256caf)

Features

  • Add property to validation summary to indicate if all checks passed (b9c6e5b)

  • check: Add aggregate-level check to ensure completeness of specified columns (7ed6a3a)

  • check: Add CompletenessRatioCheck to validate non-null ratio of a column (5e32627)

  • check: Add DistinctRatioCheck to validate column cardinality ( 8000 4c0c936)

  • check: Add UniqueRatioCheck to validate minimum uniqueness ratio in a column (7a82ab3)

  • check: Add UniqueRowsCheck to detect duplicate rows based on full or partial column sets (71a7f1d)


Detailed Changes: v0.5.2...v0.6.0

v0.5.2

13 May 16:12
Compare
Choose a tag to compare

v0.5.2 (2025-05-13)

Bug Fixes

  • Replace reduce with aggregate (a04d586)

Documentation


Detailed Changes: v0.5.1...v0.5.2

v0.5.1

12 May 16:27
Compare
Choose a tag to compare

v0.5.1 (2025-05-12)

Bug Fixes

  • check-definition: Enforce kebab-case for check definition (4bd8ada)

  • check-runner: _dq_errors contains only validation failures (db80414)

  • validation-summary: Add string representation of validation summary (42657ac)

Documentation

  • sphinx: Add correct import to example (f877df9)

  • sphinx: Add image to section Integration Patterns (0ce8424)

  • sphinx: Renamed filename of regex-match-check (1395b09)

  • sphinx: Restructured documentation (2c9e670)


Detailed Changes: v0.5.0...v0.5.1

0