Configuring Result Criteria

Overview

Result Configuration refers to setting specific criteria that determine the outcome of data comparisons in Validatar. This includes selecting the data type to evaluate, handling missing keys, setting value and overall success criteria, and managing test results.

Value Data Type

The Value Data Type setting lets you choose the data type you wish to evaluate. This can be important in tests where the data type affects the result. Choices include:

• String
• Numeric
• Date
• Date/Time
• Date/Time with Time Zone
• Automatic (default)

Missing Key Settings

The Missing Key Settings regulate how to handle records that don't show a matching key in both the test and control data set. You can choose to pass or fail the row or override it with another value.

Value Success Criteria

The Value Success Criteria setting helps determine when a comparison should pass or fail. This depends on whether you want the test data set values to match those in the control data set or not.

• For Strings Value/Pattern Comparison: How the string data from the test data set matches the control data set. You can enable case sensitivity here.
• For Numeric Value Comparison: How to compare the numeric values.
  • Absolute Numeric Difference
  • Percent of Test Value
  • Percent of Control Value
  • Custom Calculation
• For Date Value Comparison: How to compare the date values.
  • Exact Match Only
  • Within
  • Custom Calculation

These options are not available for Numeric and Date ranges.

Overall Success Criteria

The Overall Success Criteria setting is based on the individual results for every record in the test result. These help determine if the overall test passes or fails. Options include:

• All Rows Must Pass
• Up to X Rows Can Fail
• Up to X Percent of Rows Can Fail
• Custom Calculation

Custom Calculation

Only Keep Failures

The Only Keep Failures setting allows you to decide whether to keep only the failed results. This is typically useful for limiting the storage space that test results occupy in your database.

Abort Processing After Failures

With Abort Processing After Failures, you can set a limit on how many failures the test should return before being aborted. This is useful for managing database space and eliminating unessential results.

Abort Processing After Rows

The Abort Processing After Rows setting allows you to limit how many rows should be processed before aborting the test. This helps manage database space and prioritize essential results.

Scripts Include Order By

The Scripts Include Order By setting lets Validatar know if your script includes an 'Order By' clause, which optimizes data processing. The best practice is to always include an 'Order By' in your script and set this mode to 'Yes'.

Purge Results After Days

The Purge Results After Days setting allows you to determine how long to retain the test results in Validatar before they are purged from the database. This is another option for managing database space.

In conclusion, proper configuration of 'Result Criteria' is essential to ensure your data validation tests are appropriately set up, optimized for database space, and aligned with your specific needs.