Google BigQuery

Learn more about the Google BigQuery integration in Nexudus.

Google BigQuery is a Google Cloud Platform service that lets you transfer data from your Nexudus account to a data warehousing project in real-time. You can then build queries using SQL.

  BigQuery is a paid integration that adds a $/£/€100 charge per location to your Nexudus subscription.
It doesn't include what Google BigQuery will charge you based on your data usage and queries

Integrating Google BigQuery

You need a Google BigQuery account prior to starting the integration process. Integrating Google BigQuery is a three-step process. 

Step 1. Creating a Project in Google BigQuery

The first step of the integration is to create a project for your location in Google BigQuery and copy the project ID. 

 Managing more than one location?

You can choose to keep track of each individual location in the same project or create an individual project per location. 

  1. Log in to your Google BigQuery account.
  2. Click Create Project
  3. Name your project. 
  4. Copy and save your project ID that is displayed under your project name. 

    mceclip0.png

    You will need the project ID during Step 3 to enable the integration in Nexudus.

  5. Select your organization from the drop-down menu. 
  6. Select the relevant location from the drop-down menu. 
  7. Click Create

You've successfully created a project for your Nexudus location. Make sure you have your project ID saved for Step 3 of the integration process. 

Step 2. Getting Your Google BigQuery Credentials

Now that you've created your project, you need to get Google BigQuery credentials. These credentials are necessary to enable the integration in Nexudus. 

  1. Go to https://console.cloud.google.com/apis/credentials.
  2. Click Create Credentials > Service Accounts
  3. Add a meaningful title in the Service Account Name field.

    mceclip1.png

  4. Click Done
    You are redirected to the Credentials page.
  5. Click the service account you've just created in the Service Accounts option. 

    mceclip2.png

  6. Click the KEYS > Add Key
  7. Select Create New Key in the drop-down list. 
  8. Select JSON as the key type.
  9. Click Create.
    A JSON file is automatically downloaded. 
  10. Click Close.

Your credentials are in a JSON file that you can find in the Downloads folder of your device. You can use the simple text editor that is already available on your device to open the file, namely Notepad in Windows or TextEdit in Mac. 

  1. Open Notepad or TextEdit on your device. 
  2. Click File > Open
  3. Select All files from the drop-down menu next to the File Name field.
  4. Select your JSON credentials file and click Open.
    Your file includes a code snippet between curly braces.

    mceclip4.png

Leave the file open and move to Step 3. 

Step 3. Enabling the Google BigQuery Integration in Nexudus

Make sure you have the following information ready to copy and paste in Nexudus: 

  • Your Google BigQuery project ID
  • Your JSON credentials file

  Want to transfer data from various locations to Google BigQuery?

Enable the integration in every location that you want to connect to Google BigQuery. 

  1. If the side menu is not visible, click  .
  2. Click Settings > Integrations > Google BigQuery.
  3. Set the Enable toggle to YES.
  4. Select the data you want to have transferred from Nexudus to Google BigQuery by dragging the relevant transfer toggles to YES
  5. Copy and paste your Google BigQuery project ID in the Project ID field.
  6. Remove the [obfuscated] element in the Credentials field. 
  7. Copy and paste the entire code snippet from your credentials file in the Credentials field.
    Make sure you include all the code snippet, including the curly braces.
  8. Click Save Changes.
  9. Click Upload All Data in order to transfer the existing data in your account to Google BigQuery.

Now that you've completed the integration process, you can see a menu named Nexudus in your Google BigQuery project. This menu includes a dataset for each of the type of record you decided to transfer from Nexudus to your Google BigQuery project.

If you create or update a Nexudus record that is part of the transfers included in the integration settings, the record is added or updated almost instantly in BigQuery. Deleted Nexudus records can take up to 24 hours to be removed from your Google BigQuery project.

image__33_.png
BigQuery Nexudus dataset
 

ERD Diagram

You can access this ERD Diagram to help you understand how the different entities relate in Nexudus.

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

Comments

Please sign in to leave a comment.