Set up a Google BigQuery connector
Capabilities
Resource | Sync | Provision |
---|---|---|
Accounts | ✅ | |
Service accounts | ✅ | |
Roles | ✅ | |
Datasets | ✅ |
Gather Google BigQuery credentials
Configuring the connector requires you to pass in credentials generated in Google BigQuery. Gather these credentials before you move on.
A user with the permission to make a service account in Google Cloud must perform this task.
Create a service account
In the Google Cloud console, navigate to the Create service account page.
Select your project.
Choose a name for the service account and enter it in the Service account name field.
Google Cloud automatically sets the service account ID based on the name you choose.
Enter a description for the service account in the Service account description field.
Click Create and continue.
From the Select a role list, grant the service account either the Viewer or BigQuery Data Viewer role.
Click Continue.
Click Done to create the service account.
Create a service account key
Still in the Google Cloud console, click the email address of the service account you created in Step 1.
Click Keys.
Click Add key > Create new key.
Click Create. A JSON file containing the account key is created and downloaded. Keep the downloaded file safe, you’ll use it to set up the connector.
Click Close.
That’s it! Next, move on to the connector configuration instructions.
Configure the Google BigQuery connector
To complete this task, you’ll need:
- The Connector Administrator or Super Administrator role in ConductorOne
- Access to the set of Google BigQuery credentials generated by following the instructions above
Follow these instructions to use a built-in, no-code connector hosted by ConductorOne.
In ConductorOne, navigate to Admin > Connectors and click Add connector.
Search for Google BigQuery and click Add.
Choose how to set up the new Google BigQuery connector:
Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)
Add the connector to a managed app (select from the list of existing managed apps)
Create a new managed app
Set the owner for this connector. You can manage the connector yourself, or choose someone else from the list of ConductorOne users. Setting multiple owners is allowed.
If you choose someone else, ConductorOne will notify the new connector owner by email that their help is needed to complete the setup process.
Click Next.
Find the Settings area of the page and click Edit.
Upload the JSON file you created in the Credentials (JSON) field.
Click Save.
The connector’s label changes to Syncing, followed by Connected. You can view the logs to ensure that information is syncing.
That’s it! Your Google BigQuery connector is now pulling access data into ConductorOne.
Follow these instructions to use the Google BigQuery connector, hosted and run in your own environment.
When running in service mode on Kubernetes, a self-hosted connector maintains an ongoing connection with ConductorOne, automatically syncing and uploading data at regular intervals. This data is immediately available in the ConductorOne UI for access reviews and access requests.
Step 1: Set up a new Google BigQuery connector
In ConductorOne, navigate to Connectors > Add connector.
Search for Baton and click Add.
Choose how to set up the new Google BigQuery connector:
Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)
Add the connector to a managed app (select from the list of existing managed apps)
Create a new managed app
Set the owner for this connector. You can manage the connector yourself, or choose someone else from the list of ConductorOne users. Setting multiple owners is allowed.
If you choose someone else, ConductorOne will notify the new connector owner by email that their help is needed to complete the setup process.
Click Next.
In the Settings area of the page, click Edit.
Click Rotate to generate a new Client ID and Secret.
Carefully copy and save these credentials. We’ll use them in Step 2.
Step 2: Create Kubernetes configuration files
Create two Kubernetes manifest files for your Google BigQuery connector deployment:
Secrets configuration
# baton-google-bigquery-secrets.yaml
apiVersion: v1
kind: Secret
metadata:
name: baton-google-bigquery-secrets
type: Opaque
stringData:
# ConductorOne credentials
BATON_CLIENT_ID: <ConductorOne client ID>
BATON_CLIENT_SECRET: <ConductorOne client secret>
data:
# Google BigQuery credentials
BATON_CREDENTIALS_JSON: <base64 encoded credentials JSON>
Base64 Encoding: Use echo -n "your-value" | base64
to encode your secrets.
See the connector’s README or run --help
to see all available configuration flags and environment variables.
Deployment configuration
# baton-google-bigquery.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: baton-google-bigquery
labels:
app: baton-google-bigquery
spec:
selector:
matchLabels:
app: baton-google-bigquery
template:
metadata:
labels:
app: baton-google-bigquery
baton: true
baton-app: google-bigquery
spec:
containers:
- name: baton-google-bigquery
image: ghcr.io/conductorone/baton-google-bigquery:latest
imagePullPolicy: IfNotPresent
envFrom:
- secretRef:
name: baton-google-bigquery-secrets
Step 3: Deploy the connector
Create a namespace in which to run ConductorOne connectors (if desired), then apply the secret config and deployment config files.
Check that the connector data uploaded correctly. In ConductorOne, click Applications. On the Managed apps tab, locate and click the name of the application you added the Google BigQuery connector to. Google BigQuery data should be found on the Entitlements and Accounts tabs.
That’s it! Your Google BigQuery connector is now pulling access data into ConductorOne.