Releases: sparkdq-community/sparkdq
v0.10.0
v0.9.0
v0.8.1
v0.8.0
v0.7.1
v0.7.0
v0.6.1
v0.6.0
v0.6.0 (2025-05-17)
Documentation
Features
-
Add property to validation summary to indicate if all checks passed (
b9c6e5b
) -
check: Add aggregate-level check to ensure completeness of specified columns (
7ed6a3a
) -
check: Add CompletenessRatioCheck to validate non-null ratio of a column (
5e32627
) -
check: Add DistinctRatioCheck to validate column cardinality ( 8000
4c0c936
) -
check: Add UniqueRatioCheck to validate minimum uniqueness ratio in a column (
7a82ab3
) -
check: Add UniqueRowsCheck to detect duplicate rows based on full or partial column sets (
71a7f1d
)
Detailed Changes: v0.5.2...v0.6.0
v0.5.2
v0.5.2 (2025-05-13)
Bug Fixes
- Replace reduce with aggregate (
a04d586
)
Documentation
Detailed Changes: v0.5.1...v0.5.2
v0.5.1
v0.5.1 (2025-05-12)
Bug Fixes
-
check-definition: Enforce kebab-case for check definition (
4bd8ada
) -
check-runner: _dq_errors contains only validation failures (
db80414
) -
validation-summary: Add string representation of validation summary (
42657ac
)
Documentation
-
sphinx: Add correct import to example (
f877df9
) -
sphinx: Add image to section Integration Patterns (
0ce8424
) -
sphinx: Renamed filename of regex-match-check (
1395b09
) -
sphinx: Restructured documentation (
2c9e670
)
Detailed Changes: v0.5.0...v0.5.1