Overview
The Google BigQuery data source template provides metadata ingestion, data type mappings, and profiling definitions for BigQuery connections.
Platform: Google BigQuery
Connection Category: Database
Template Category: Marketplace
What's Included
Connection Configuration
- Supports BigQuery connections
- Identifier delimiters:
`/`
Data Type Mappings
Includes mappings for BigQuery data types:
- String types:
STRING - Numeric types:
INT64,FLOAT64,NUMERIC,BIGNUMERIC - Date/time types:
DATE,DATETIME,TIMESTAMP,TIME - Boolean:
BOOL - Binary:
BYTES - Complex types:
ARRAY,STRUCT - Other:
GEOGRAPHY,JSON
Metadata Ingestion
Queries BigQuery's INFORMATION_SCHEMA views at the dataset and project level to discover datasets (schemas), tables, and columns.
Installation
Customization
Common customizations:
- Project and dataset scope — Filter to specific projects or datasets
- Partitioned tables — Handle BigQuery's partitioning in metadata discovery
- Cost control — Use execution scripts to set query bytes limits