BigQuery
Overview
Feature | Available |
---|---|
Data normalization | No |
Data invalidation for Unified API | No |
Setup
- Go to Connectors -> Destinations.
- Click the Configure button on the BigQuery card.
- Enter your BigQuery dataset and upload your service account JSON file.
Note that the service account will need the following roles attached:
- BigQuery Data Editor
- BigQuery Job User
If these roles are too broad for your security policies, you can create a custom role with the following permissions:
- bigquery.datasets.get
- bigquery.tables.create
- bigquery.tables.delete
- bigquery.tables.get
- bigquery.tables.getData
- bigquery.tables.list
- bigquery.tables.update
- bigquery.tables.updateData
- bigquery.jobs.create
You can also add conditional access policies to restrict access to specific datasets.
Query patterns
Here are a few high-level best practices when working with tables that Supaglue land:
- Avoid altering the schema of the existing columns
There are a few patterns (from simplest to more complex) for querying tables that Supaglue writes into your BigQuery dataset:
Schema Evolution
Supaglue may evolve the destination table schemas from time to time. To evolve schemas, drop your destination tables, and Supaglue will recreate the tables with the new schemas. Please reach out to (support@supaglue.com) if you need support for backward-compatible strategies.
IP Whitelist
The following are Supaglue's CIDR ranges:
54.214.243.61/32
54.201.123.169/32
44.226.37.107/32