Artie Transfer
Search
K
Comment on page

BigQuery

Going over how to find your BigQuery settings and outline the typing support.

Finding your BigQuery settings

Getting your project identifier

When you are in your GCP project, you can see your GCP project ID at the top of the navigation bar.

Getting your default dataset

In order for Transfer to connect to BigQuery, we will need to specify a default dataset.
The default dataset is only meant to establish the initial connection with BigQuery. The actual dataset specified within topicConfig can be different from the default dataset!

Retrieving your credentials

For best practice, create a separate service account for Transfer and download the keys by following this guide from Google!

Typing

BigQuery type
Artie type
Array
Array<String>. BigQuery requires elements within an array to be typed to avoid nested arrays. As such, Artie standardized on Array<String>.
String
String
Bytes
🟠 Currently not supported.
Int64
Integer
Float64
Float
Big Decimal / Big Numeric / Numeric
Numeric
Bool
Boolean
Date
Date
Datetime
Datetime
Timestamp
Datetime
Timestamp without TZ
Datetime with UTC TZ
Time
Time
Geography
🟠 Currently not supported.
JSON
Struct
Record
Struct
Interval
🟠 Currently not supported.
Struct
Struct
Last modified 5mo ago