Skip to main content
BigQuery integration

Analyze survey data in your BigQuery data warehouse

Agnieszka avatar
Written by Agnieszka
Updated over 2 months ago

Integrating Google BigQuery and Survicate allows you to collect and automatically send survey responses directly to your BigQuery data warehouse to store, query, and analyze user insights.

By integrating Survicate with BigQuery, you can:

  • Gain in-depth insights: Uncover patterns, identify trends, and get actionable insights from your survey data. For example, you can evaluate the effectiveness of your marketing campaigns by marrying survey responses with campaign performance data.

  • Simplify data management: Survicate structures and formats survey data automatically, making it ready for immediate use in BigQuery. The integration saves your time and effort in data preparation and lets you focus on more important tasks, like prioritizing feature requests by consolidating and analyzing the feedback received from your users.

  • Access real-time data: Your survey data is kept synced in real-time, so you have up-to-date insights for timely analysis and decision-making. With real-time data access, you can dynamically create targeted customer segments based on the most recent survey responses and other relevant data.

  • Benefit from improved security and efficiency: As a native integration, it ensures a fast connection, robust security, and guarantees no missed survey responses. Better efficiency means you can run thorough market research and competitive analysis by integrating survey responses with market trends and competitor insights.

In this article, you'll learn:

šŸ“Œ Please note that you must have a billing (paid) account in BigQuery to connect it to Survicate.

How Survicate & BigQuery Work Together

Survicate collects and sends survey data directly to your BigQuery data warehouse. This data includes all responses to your surveys, respondent details, and other metadata, which can then be analyzed using BigQuery's powerful SQL-like queries.

Setting Up Survicate & BigQuery Integration

To store your Survicate data in BigQuery, complete the following steps:

  1. Create a project and enable BigQuery

  2. Create a service account for Survicate

  3. Connect BigQuery integration in Survicate

šŸ“Œ BigQuery integration is available as a paid add-on on some of our plans. Reach out to our team to enable it on your account.

Step 1. Create a Project and Enable BigQuery *

To create a project and enable BigQuery:

  1. Navigate to the Google Developers Console.

  2. Configure the Google Cloud Platform

    1. If you donā€™t have a project already, create one.

    2. If you have an existing project, enable the BigQuery API. Once youā€™ve done so, you should see BigQuery in the ā€œResourcesā€ section of Cloud Platform.

3. Copy the project ID. Youā€™ll need it when connecting BigQuery in the Survicate panel.

When you create your project, you must enable billing so Survicate can successfully write data.

* if you don't have it yet

Step 2. Create a service account for Survicate

To create a service account for Survicate:

  1. From the Navigation panel on the left, select IAM & admin > Service accounts.

  2. Click Create Service Account.

  3. Enter a name for the service account (for example, survicate-warehouse) and click Create.

  4. Assign the service account the following roles:

    • BigQuery Data Owner (You would need to create a new dataset named ā€œsurvicateā€ in case you want to add BigQuery Data Owner permission only to a single dataset.)

    • BigQuery Job User

  5. Create a JSON key. The downloaded file will be used to connect the integration in the Survicate panel.

If you have trouble creating a new service account, refer to Google Cloudā€™s documentation about service accounts for more information.

Step 3. Connecting BigQuery in Survicate

Here's how to connect BigQuery in Survicate.

  1. Find the Google BigQuery on the Integrations list, click Configure

  2. Fill out two required fields: Project ID, Credentials

šŸ’” Here's where to find the project ID in Google BigQuery

Follow the above instructions to create a dedicated project for Survicate data. Here's where you can find it in Google BigQuery:

šŸ’”Credentials

Follow the above instructions to generate a dedicated .json file with credentials. Here's how the file looks after the download:

Seeing survey data in BigQuery

Once you have Survicate and BigQuery integrated, Survicate collects survey data and sends it instantly to your BigQuery data warehouse in real-time.

Survey data is structured and formatted to be compatible with BigQuery's analysis tools, ensuring immediate usability.

The integration will consistently sync all survey data, both old and new, maintaining an up-to-date data set in Google BigQuery.

FAQ

How often is data synchronized for the Survicate - BigQuery integration?

We sync data real time - it sometimes can appear in BigQuery with some delay, however, we sync responses as soon we are able to send them through the API.
The delay can be caused by API limitations, network problems, or huge amount of data to sync.

Would you like to learn more? Talk to us on chat šŸ‘‰

Did this answer your question?