Google BigQuery Connector Setup Guide

This article describes how to set up the Google BigQuery connector.

API Information

This connector uses the following vendor API:

• API Name: Google API
• API Version: v2
• API Endpoint: https://bigquery.googleapis.com/bigquery/v2
• Documentation: Google API

Batch Limits

This connector uses batched requests to support high-volume data transfers to the vendor. For more information, see Batched Actions. Requests are queued until one of the following thresholds is met or the profile is published:

• Max number of requests: 100,000
• Max time since oldest request: 60 minutes
• Max size of requests: 90 MB

Configuration

Go to the Connector Marketplace and add a new connector. For general instructions on how to add a connector, see About Connectors.

After adding the connector, configure the following settings:

• Project ID
  • Select the Project ID to connect to.

Actions

Action Name	AudienceStream	EventStream
Upsert record	✓	✓
Upsert record batch	✓	✓
Send Entire Event Data batch	✗	✓
Send Entire Visitor Data batch	✓	✗

Enter a name for the action and select the action type from the drop-down menu.

The following section describes how to set up parameters and options for each action.

Upsert record

Parameters

Parameter	Description
Dataset	Select the ID of the collection of tables that to connect to.
Table	Provide the table name to connect to.

Event Parameters

Map the parameters to the columns of the table. You must map at least one parameter.

The parameters available for mapping are dependent on the dataset and table selected when the connector is configured.

Upsert record batch

Batch Limits

This action uses batched requests to support high-volume data transfers to the vendor. For more information, see Batched Actions. Requests are queued until one of the following thresholds is met or the profile is published:

• Max number of requests: 100,000
• Max time since oldest request: 60 minutes
• Max size of requests: 90 MB

Parameters

Parameter	Description
Dataset	Select the ID of the collection of tables that you want to connect to.
Table	Provide the table name you want to connect to.

Event Parameters

Parameter	Description
Batch Time To Live	Time To Live (Minute) should be between 5 and 60 minutes. The default value is 60 minutes.

Send Entire Event Data batch

Batch Limits

This action uses batched requests to support high-volume data transfers to the vendor. For more information, see Batched Actions. Requests are queued until one of the following thresholds is met or the profile is published:

• Max number of requests: 100,000
• Max time since oldest request: 60 minutes
• Max size of requests: 90 MB

Parameters

Parameter	Description
Dataset	Select the ID of the collection of tables that you want to connect to.
Table	Provide the table name you want to connect to.
Column to record the Timestamp	Choose the column to record the timestamp.
Column to record the Payload	Choose the JSON column to record the payload.
Timestamp Attribute	The default sends the current timestamp for the action. Select an attribute to assign as the timestamp if you want to send it in a different format. If an attribute is assigned and produces an empty value, we will send the current timestamp.
Print Attribute Names	By default, the attribute keys are used. If you want to use the attribute names as keys instead, enable this checkbox. Consider that the payload names will reflect the update if the attribute names are updated.
Batch Time To Live	Time To Live (Minute) should be between 5 and 60 minutes. Default is 60 minutes.

Send Entire Visitor Data batch

Batch Limits

This action uses batched requests to support high-volume data transfers to the vendor. For more information, see Batched Actions. Requests are queued until one of the following thresholds is met or the profile is published:

• Max number of requests: 100,000
• Max time since oldest request: 60 minutes
• Max size of requests: 90 MB

Parameters

Parameter	Description
Dataset	Select the ID of the collection of tables that you want to connect to.
Table	Provide the table name you want to connect to.
Column to record the Timestamp	Choose the column to record the timestamp.
Column to record the Payload	Choose the JSON column to record the payload.
Timestamp Attribute	The default sends the current timestamp for the action. Select an attribute to assign as the timestamp if you want to send it in a different format. If an attribute is assigned and produces an empty value, we will send the current timestamp.
Include Current Visit Data with Visitor Data	Include the current visit data with the visitor data.
Print Attribute Names	By default, the attribute keys are used. If you want to use the attribute names as keys instead, enable this checkbox. Consider that the payload names will reflect the update if the attribute names are updated.
Batch Time To Live	Time To Live (Minute) should be between 5 and 60 minutes. Default is 60 minutes.