Skip to content

Not Null Check Rule

Description

The Not Null Check rule ensures that a specific column does not contain null values. This rule runs on a single column and verifies whether the values meet the configured success criteria.

Configuration Fields

  • Operator Options

    • Greater than
    • Less than
    • Equal to
    • Between (requires specifying a start and end range)
  • Operator Defines the comparison operation (Greater Than, Less Than, Equal To, or Between).

  • Value The threshold value used for success criteria. Required for Greater than, Less than, and Equal to operators.

  • Value Range Required only when the Between operator is selected, specifying the start and end range.

  • Threshold Type Indicates whether the Value or Value Range to be considered as percentage or an absolute count.

  • Allow Null Values Determines if null values are permitted.

Success Criteria

The success criteria are evaluated based on the number of non-null values in the column:

  • If the column has N rows, the number of non-null values is counted.
  • The success condition is met if this count satisfies the given operator and value.
  • For example, if operator is Greater than and value is 5, then the column must have more than 5 non-null values to be within the threshold.

Sample Input

IDNameAge
1Alice25
2Bob30
3CharlieNULL
4DavidNULL
5NULLNULL

Sample Configuration

  • Operator Between
  • Value Range Start = 3, End = 5
  • Threshold Type Absolute Count
  • Allow Null Values Not Applicable

alt text

Sample Output

Column NameRule NameSuccess CountFailure CountWithin ThresholdNull Count
NameName Age Not Null Check41Yes0
AgeName Age Not Null Check21No3