Manage CloudStream data sources

Supported vendors

The configuration for cloud data sources is nearly the same for every vendor. For vendor-specific configuration details, see the following:

• Databricks
• Snowflake

Create a cloud data source

To create a cloud data source for CloudStream, use the following steps:

1. Go to CloudStream > Data Sources.
2. Click + Add Data Source.
3. Under Categories, click Data Warehouse and select a vendor.
4. In the Name field, enter a unique name for the data source related to your use case.
5. Click Continue.

You can connect to up to 10 data sources in a profile.

Establish a connection

Before you configure the data to import, you must establish a connection to your cloud data source. A connection is the reusable configuration of your vendor credentials that connects Tealium to your cloud data source.

On the Connection Configuration screen, confirm the name of the data source, then select an existing connection from the list or create a connection by clicking the + icon.

Click Save to return to the Connection Configuration screen, then click Establish Connection.

After you successfully establish a connection, select a table from the Table Selection list.

For more information about connecting to your vendor, see:

• Databricks
• Snowflake

Enable processing

Turn on Enable Processing to begin importing data immediately after you save and publish your changes. Or, leave this setting off while you complete the configuration and turn it on later.

Configure the query

In the Query Mode and Configuration screen, select the appropriate query mode and optionally include a SQL WHERE clause to import only those records that match your custom condition.

Select a query mode

The query mode determines how to select new rows, modified rows, or both for import.

• If you select Timestamp + Incrementing (recommended) you must select two columns, a timestamp column and a strictly incrementing column.
• If you select Timestamp or Incrementing, you must select a column to use to detect either new and modified rows or new rows only.

For more information, see Query modes.

Configure the query

1. In the Query > Select Columns section, select the columns to import. To change the table or view, click Previous and select a different table.

2. (Optional) To add a custom condition, include a SQL WHERE clause.

   The WHERE clause does not support subqueries from multiple tables. To import data from multiple tables, create a view and select the view in the data source configuration.

3. Click Test Query to validate your SQL query and preview the results.

Map columns

On the column mapping page, you’ll see the columns you selected in the previous step. Each column is automatically assigned a data type and a suggested cloud attribute name, which you can change as needed.

Columns not mapped to a cloud attribute are ignored.

Summary

In this final step, view the summary, make any needed corrections, and then save and publish your profile. To edit your configuration, click Previous to return to the step where you want to make changes.

1. Confirm the cloud attribute mappings.
2. Click Finish to create the data source and exit the configuration screen. The new data source is listed in the Data Sources dashboard.
3. Click Save/Publish to save and publish your changes.

Duplicate a data source

To duplicate a data source, click the Duplicate button and enter a name for the new copy of the data source.

Processed rows and errors

To see import activity, navigate to Data Sources and expand the data source.

CloudStream can ingest up to 500 events per second.

Statuses

After configuring a cloud data source, it may display one of the following statuses: