Skip to content

Not Null Check

The Not Null Check rule verifies that specified columns contain the required number of non-null values.
This rule is commonly used to:

  • Ensure mandatory fields like customer names or product prices are populated
  • Validate data completeness in critical reporting fields
  • Detect missing values in essential business columns

Example Usage:

  • Confirm that all customer records have Email addresses
  • Check that at least 95% of ProductCode entries are not null

Configuration Fields


Success Criteria Configuration

This section defines how the rule’s outcome is measured against expected thresholds.

Field NameDescriptionRequiredOptions / Format
OperatorComparison operation for non-null value countYesGreaterThan, LessThan, EqualTo, Between
Threshold ValueValue for comparison (single value for most operators)ConditionalNumber
Threshold MinMinimum value (for Between operator)ConditionalNumber
Threshold MaxMaximum value (for Between operator)ConditionalNumber
Is PercentageWhether the threshold represents a percentage of total rowsNotrue / false (default: false)

Sample Input Data

IDNameAgeEmail
1Alice25alice@example.com
2Bob30bob@example.com
3CharlieNULLcharlie@example.com
4DavidNULLNULL
5NULLNULLerin@example.com

Sample Configurations

Example 1: Absolute Count Check

Configuration FieldValue
ColumnName
OperatorEqualTo
Threshold Value4
Is Percentagefalse

Explanation:
Validates that exactly 4 Name values are non-null.


Example 2: Percentage Range Check

Configuration FieldValue
ColumnEmail
OperatorBetween
Threshold Min70
Threshold Max100
Is Percentagetrue

Explanation:
Validates that between 70% and 100% of Email values are non-null.


Sample Output

Column NameRule NameSuccess CountFailure CountWithin Threshold
NameNot Null Check41Yes
AgeNot Null Check23No
EmailNot Null Check32No