Installing the Data Agent - Kubernetes

Overview

The Validatar Data Agent can be launched within a Kubernetes cluster by following these steps:

1. In Validatar, navigate to the Settings > Configuration > Data Agents page, then click the New Data Agent button
2. Enter a name for the data agent. The data agent name should identify the environment where the data agent is installed (i.e. the cluster name).
3. Choose an existing group for the data agent or create a new group if needed. The group name should identify the environment where the data agent is installed (i.e. the cluster name). Multiple data agents can be assigned to the same group.
4. Click the Save button. It will take a few seconds for Validatar to generate the message queue for the data agent group.
5. Once the data agent is saved, click the Download YAML button to generate a YAML template that contains a deployment and a service for the data agent. Open the downloaded YAML file and adjust as needed for your environment.
6. Import the YAML into your Kubernetes cluster.

Data Agent Image

The data agent image published to Validatar's public repository contains the following libraries:

• Python 3.9 and pip, along with the following Python libraries:
  • pandas
  • numpy
  • pyarrow
  • fastavro
  • openpyxl
  • requests
  • urllib3
• PostgreSQL ODBC driver
• SQL Server ODBC driver (msodbcsql18)
• Snowflake ODBC driver (version 3.3.1)
• Tesseract OCR library