BigQuery

How to create the BigQuery integration and set up a sync.

The BigQuery integration lets you sync data directly from your Bigquery data warehouse into Calixa on an ongoing basis. It makes it easy to send product analytics, billing information, or any other kind of data you have on your customers to Calixa.

To add BigQuery, go to the Integrations Page in Calixa, click add integration, then click on the BigQuery logo, and follow the steps below.

IP addresses

Calixa lets you securely configure your private network to external connections. You can provide access to Calixa by adding static IP addresses to your firewall allowlist.

Connections to your warehouse will only come from the following IP addresses:

35.225.70.115  
35.238.44.68

Setting up Required Permissions

In order to connect to BigQuery, you need to set up a few required permissions in your Google Console.

  1. To start, find your Google BigQuery Project ID. You can copy it from your Google Cloud Dashboard here.

  1. Next you'll need to add a Principal for Calixa to grant our app permissions to pull data from BigQuery. Go to your IAM admin panel in you Google Dashboard (here).

  2. Click "Add" in the top left.

  1. Paste in the Calixa principal address: [email protected]

  2. Make sure you give the principal a default role of "Viewer" or higher for the Project you want to connect. Calixa needs bigquery.dataViewer and bigquery.user permissions, both of which are available on the default "Viewer" role.

  3. After saving this new principal, go back to your Calixa tab.

  4. Click "Sign in to BigQuery". At this point, if you've correctly added the Calixa principal, you should be successfully connected.

Setting up a sync

Once you've connected BigQuery, you're ready to create a sync to pull your data into Calixa. By default, syncs will run every 15 minutes and pull in any changes to the data.

To set up your sync, click "Add sync" on the Integrations > Sync page in Calixa.

  1. Select the Calixa Object you would like to sync.

  2. Select the BgQuery warehouse you'd like to pull data from. You will only see projects that you connected in the Integration tab, so if you're not seeing a project you may need to add an additional BigQuery integration.

  3. Choose a Dataset and Table from BigQuery.

  1. Map your properties from BigQuery to Calixa. There are 4 required properties for Accounts and 4 for Users.

For Accounts, you must have:

  1. Name (string)
  2. ID (string or integer)
  3. Created At (timestamp)
  4. Updated At (timestamp)

For Users, you must have:

  1. Email (string)
  2. ID (string or integer)
  3. Created At (timestamp)
  4. Updated At (timestamp)

  1. Test your mappings. If they're working properly you should see a green "success" message. You must get a successful test in order to create the sync.

  2. Click "Create Warehouse Sync". Congratulations! You're all set up. The initial sync may take longer than 15 minutes depending on the amount of data in the table you chose. You should start to see data populate in Segments within a few minutes.

Updated 5 months ago