Documentation Index

Fetch the complete documentation index at: https://docs.validatar.com/llms.txt

Use this file to discover all available pages before exploring further.

VW_DATASET_TEST_EXECUTIONS

Prev Next

Overview

VW_DATASET_TEST_EXECUTIONS is the most detailed view for analyzing test execution history. Each row represents one test execution and includes the result, timing, row-level counts, error messages, metadata links, and windowed index columns that make it easy to retrieve the latest or earliest execution for any test.

This view is the primary bridge between test definitions (REPOSITORY views) and detailed result data (RESULTS tables). Use it for trend analysis, SLA monitoring, and drilling into specific failures.

Schema

Execution Identity

Column Type Description
TEST_EXECUTION_ID NUMBER Unique execution identifier — use this to join to RESULTS tables
JOB_STEP_EXECUTION_ID NUMBER ID of the job step that triggered this execution (NULL if run standalone)
BATCH_ID NUMBER ID of the batch this execution belongs to
TEST_ID NUMBER ID of the test
TEST_VERSION_ID NUMBER ID of the specific test version that was executed
TEST_VERSION_NUMBER NUMBER Version number at time of execution
IS_ACTIVE_VERSION BOOLEAN Whether the executed version is still the current active version

Result

Column Type Description
CODE_TEST_EVALUATION_RESULT_ID NUMBER Numeric result code (24=Passed, 25=Failed, 26=Error)
RESULT VARCHAR "Passed", "Failed", or "Error"

Timing

Column Type Description
DATE_STARTED TIMESTAMP When execution began
DATE_COMPLETED TIMESTAMP When execution finished
DURATION NUMBER Duration in seconds

Row Counts

Column Type Description
PASSED_COUNT NUMBER Number of passed evaluations
FAILED_COUNT NUMBER Number of failed evaluations
ERROR_COUNT NUMBER Number of errored evaluations
TEST_ROW_COUNT NUMBER Rows returned by the test dataset
CONTROL_ROW_COUNT NUMBER Rows returned by the control dataset
MATCHED_ROW_COUNT NUMBER Rows that matched between test and control
MATCHED_PASSED_COUNT NUMBER Matched rows that passed
MATCHED_FAILED_COUNT NUMBER Matched rows that failed
MATCHED_ERROR_COUNT NUMBER Matched rows that errored
UNMATCHED_TEST_PASSED_COUNT NUMBER Unmatched test-only rows that passed
UNMATCHED_TEST_FAILED_COUNT NUMBER Unmatched test-only rows that failed
UNMATCHED_TEST_ERROR_COUNT NUMBER Unmatched test-only rows that errored
UNMATCHED_CONTROL_PASSED_COUNT NUMBER Unmatched control-only rows that passed
UNMATCHED_CONTROL_FAILED_COUNT NUMBER Unmatched control-only rows that failed
UNMATCHED_CONTROL_ERROR_COUNT NUMBER Unmatched control-only rows that errored

Test Context

Column Type Description
PROJECT_NAME VARCHAR Project name
PROJECT_ID NUMBER Project ID
TEST_NAME VARCHAR Test name
TEST_DESCRIPTION VARCHAR Test description
TEST_FOLDER_ID NUMBER Folder ID
TEST_FOLDER_NAME VARCHAR Folder name
FOLDER_PATH VARCHAR Full folder path hierarchy
TEST_IS_ACTIVE BOOLEAN Whether the test is still active
TEST_CREATED_BY VARCHAR Full name of test creator
TEST_MODIFIED_BY VARCHAR Full name of last modifier
TEST_CREATED_ON TIMESTAMP Test creation date
TEST_MODIFIED_ON TIMESTAMP Test modification date
VERSION_URL VARCHAR Relative URL to the test version

Data Source Information

Column Type Description
TEST_DATA_SOURCE VARCHAR Name of the test-side data source
TEST_DATA_SOURCE_ID NUMBER ID of the test data source
TEST_DATASET_TYPE VARCHAR Dataset type name for the test side
IS_TEST_DATASET_SCRIPT BOOLEAN Whether the test dataset uses a SQL script
IS_TEST_DATASET_PROFILE BOOLEAN Whether the test dataset uses profile data
TEST_DATASET_ERROR VARCHAR Error message if the test dataset failed
CONTROL_DATA_SOURCE VARCHAR Name of the control-side data source
CONTROL_DATA_SOURCE_ID NUMBER ID of the control data source
CONTROL_DATASET_TYPE VARCHAR Dataset type name for the control side
IS_CONTROL_DATASET_SCRIPT BOOLEAN Whether the control dataset uses a SQL script
IS_CONTROL_DATASET_PROFILE BOOLEAN Whether the control dataset uses profile data
CONTROL_DATASET_ERROR VARCHAR Error message if the control dataset failed

Metadata Links

Column Type Description
TEST_PRIMARY_METADATA_LINK_OBJECT VARCHAR Full path of the test-side linked metadata object
TEST_PRIMARY_METADATA_LINK_OBJECT_KEY VARCHAR Join key (e.g., "t.123" or "c.456")
TEST_PRIMARY_METADATA_LINK_URL VARCHAR Relative URL to the test-side metadata object
CONTROL_PRIMARY_METADATA_LINK_OBJECT VARCHAR Control-side linked object path
CONTROL_PRIMARY_METADATA_LINK_OBJECT_KEY VARCHAR Control-side join key
CONTROL_PRIMARY_METADATA_LINK_URL VARCHAR Relative URL to the control-side object

Job/Batch Context

Column Type Description
TRIGGERED_BY VARCHAR Who/what triggered the execution ("Scheduler" or user name)
URL VARCHAR Relative URL to view results in Validatar UI
BATCH_ERROR VARCHAR Error message if the batch failed
BATCH_STATUS_ID NUMBER Batch status code
BATCH_STATUS VARCHAR Batch status name
PARENT_JOB_STEP_EXECUTION_ID NUMBER ID of the parent job step (for nested jobs)
RUNTIME_PARENT VARCHAR Full path of the job hierarchy that triggered this execution
RUNTIME_PARENT_ID NUMBER ID of the top-level job

Quality Classification

Column Type Description
OVERALL_RESULT_STATUS_ID NUMBER Current overall status code for the test
OVERALL_RESULT_STATUS VARCHAR Current overall status: "Passed", "Failed", or "Error"
QUALITY_DIMENSION VARCHAR Quality dimension of the test
SEVERITY_LEVEL VARCHAR Severity level of the test
TEST_DATA_SET_COLUMN_TYPE_ID NUMBER Column type ID
TEST_DATA_SET_COLUMN_TYPE VARCHAR Column type name (e.g., "All Columns", "Key and Value")
TEST_DATA_SET_COLUMN_SELECTION_ID NUMBER Column selection ID
TEST_DATA_SET_COLUMN_SELECTION VARCHAR Column selection name

Windowed Index Columns

Column Type Description
LATEST_TEST_EXECUTION_INDEX NUMBER 1 = most recent execution for this TEST_ID; 2 = second most recent, etc.
EARLIEST_TEST_EXECUTION_INDEX NUMBER 1 = first-ever execution for this TEST_ID
LATEST_TEST_VERSION_EXECUTION_INDEX NUMBER 1 = most recent execution for this TEST_VERSION_ID
EARLIEST_TEST_VERSION_EXECUTION_INDEX NUMBER 1 = first-ever execution for this TEST_VERSION_ID

These index columns are pre-calculated ROW_NUMBER() partitions ordered by DATE_STARTED. They eliminate the need for window functions in your queries.

Relationships

VW_DATASET_TEST_EXECUTIONS
    │
    ├── TEST_EXECUTION_ID → RESULTS.TEST_EXECUTION_RESULTS.TEST_EXECUTION_ID
    ├── TEST_EXECUTION_ID → RESULTS.TEST_EXECUTION_TABLE_RESULTS.TEST_EXECUTION_ID
    ├── TEST_EXECUTION_ID → RESULTS.TEST_EXECUTION_TABLE_RESULT_KEYS.TEST_EXECUTION_ID
    ├── TEST_EXECUTION_ID → RESULTS.TEST_EXECUTION_TABLE_RESULT_VALUES.TEST_EXECUTION_ID
    ├── TEST_ID → VW_DATASET_TESTS.TEST_ID
    ├── PROJECT_ID → VW_DATASET_JOBS.PROJECT_ID
    ├── BATCH_ID → VW_DATASET_JOB_EXECUTIONS.BATCH_ID
    └── TEST_PRIMARY_METADATA_LINK_OBJECT_KEY → VW_DATASET_TABLES.TABLE_KEY

Example Queries

Latest Execution Per Test

SELECT
    TEST_NAME,
    RESULT,
    DATE_COMPLETED,
    DURATION,
    PASSED_COUNT,
    FAILED_COUNT,
    ERROR_COUNT,
    TRIGGERED_BY
FROM REPOSITORY.VW_DATASET_TEST_EXECUTIONS
WHERE LATEST_TEST_EXECUTION_INDEX = 1
ORDER BY DATE_COMPLETED DESC;

Test Execution Duration Trends

SELECT
    TEST_NAME,
    DATE_STARTED::DATE AS EXECUTION_DATE,
    DURATION,
    RESULT
FROM REPOSITORY.VW_DATASET_TEST_EXECUTIONS
WHERE TEST_NAME = 'Row Count - DIM_CUSTOMER'
    AND DATE_STARTED >= DATEADD(day, -30, CURRENT_DATE)
ORDER BY DATE_STARTED;

Failed Executions with Error Details

SELECT
    TEST_NAME,
    PROJECT_NAME,
    DATE_COMPLETED,
    RESULT,
    TEST_DATASET_ERROR,
    CONTROL_DATASET_ERROR,
    BATCH_ERROR,
    URL
FROM REPOSITORY.VW_DATASET_TEST_EXECUTIONS
WHERE RESULT = 'Error'
    AND DATE_COMPLETED >= DATEADD(day, -7, CURRENT_DATE)
ORDER BY DATE_COMPLETED DESC;

Join to Results for Row-Level Drill-Down

SELECT
    te.TEST_NAME,
    te.RESULT,
    r.NUMERIC_SOURCE_VALUE,
    r.NUMERIC_TARGET_VALUE,
    r.PERCENT_DIFFERENCE,
    r.EVALUATION_RESULT_NAME
FROM REPOSITORY.VW_DATASET_TEST_EXECUTIONS te
JOIN RESULTS.TEST_EXECUTION_RESULTS r
    ON r.TEST_EXECUTION_ID = te.TEST_EXECUTION_ID
WHERE te.LATEST_TEST_EXECUTION_INDEX = 1
    AND te.RESULT = 'Failed'
LIMIT 100;

Execution Summary by Job

SELECT
    RUNTIME_PARENT,
    DATE_STARTED::DATE AS RUN_DATE,
    COUNT(*) AS TOTAL_TESTS,
    SUM(CASE WHEN RESULT = 'Passed' THEN 1 ELSE 0 END) AS PASSED,
    SUM(CASE WHEN RESULT = 'Failed' THEN 1 ELSE 0 END) AS FAILED,
    SUM(CASE WHEN RESULT = 'Error' THEN 1 ELSE 0 END) AS ERRORED,
    AVG(DURATION) AS AVG_DURATION_SEC
FROM REPOSITORY.VW_DATASET_TEST_EXECUTIONS
WHERE DATE_STARTED >= DATEADD(day, -7, CURRENT_DATE)
GROUP BY RUNTIME_PARENT, DATE_STARTED::DATE
ORDER BY RUN_DATE DESC, RUNTIME_PARENT;

Databricks Notes

  • Replace DATEADD(day, -30, CURRENT_DATE) with DATE_ADD(CURRENT_DATE(), -30)
  • Replace DATE_STARTED::DATE with CAST(DATE_STARTED AS DATE) or DATE(DATE_STARTED)
  • TIMESTAMPDIFF is not available — use UNIX_TIMESTAMP(end) - UNIX_TIMESTAMP(start) for duration if recalculating