Step-2: At the top of your screen click on the drop-down menu:
Step-3: Click on the ‘New Project’ button:
We are going to use this new project for collecting and querying Google Analytics data in BigQuery.
Step-4: Name your new project and then click on the ‘Create’ button:
Step-5: Click on the ‘Select project’ link on the top right-hand side of your screen:
You are now in the ‘Google Analytics’ project.
You will know that you are in the right project because the project name will appear at the top of your screen:
Step-6: Click on the Google Analytics project ID:
Step-7: Click on ‘CREATE DATASET’ button:
Step-8: Name your data set (say ‘GA_data_set’) and then click on the ‘Create Dataset’ button:
Before you create a custom schema, you will need to first figure out the overall layout and format of what your data table should look like in the BigQuery.
It’s like creating a wireframe before you actually start designing a website.
You can create this wireframe either in your head or on a piece of paper. You can also use an existing Google Analytics report as a wireframe.
Let’s extract Google Analytics data in the following format in BigQuery:
Here the screenshot of the GA report acts as a wireframe for us.
From the GA screenshot above we can determine the following things about, how our data table should look like in BigQuery:
Our data table should have one primary dimension called ‘Country’.
Our data table should have the following three metrics: ‘Sessions’, “%New Sessions’ and ‘New users’.
The data table needs to have 10 rows
The data in the data table should be sorted by ‘sessions’ in descending order.
The data in the data table should be from the last month (not shown in the GA screenshot above).
Based on your wireframe, create a custom schema via a third-party solution (connector). We use the same connector to extract Google Analytics data into BigQuery.
You can either search for such third-party solutions online or use the one that I use which is ‘Supermetrics for BigQuery‘. They provide a free 14 days trial of their solution. No credit card required.
You should now see a screen like the one below with status 200 OK:
Step-30: Click on the ‘Save as’ button to save this query in your new custom schema:
Step-31: Give your query a name (say ‘Top Countries by Sessions’):
Step-32: Select your custom schema from the drop-down menu and then click on the ‘OK’ button:
Congratulations.
You have now successfully created your custom schema:
Note: Each query in your custom schema corresponds to one data table in your BigQuery project. So if you create multiple queries in your custom schema (which is possible) then multiple data tables would automatically be created in your BigQuery project when you use the custom schema while creating a data transfer.
Step-34: Make sure that you are in the ‘Google Analytics’ project:
Step-35: Click on link ‘Data transfers’ from the left-hand side navigation:
Step-36: Click on the ‘Enable’ button to enable the ‘BigQuery Data Transfer API’:
Step-37: Click on the ‘CREATE A TRANSFER’ link:
Step-38: Click on the ‘Explore data sources’ button:
Step-39: Type ‘supermetrics google analytics’ in the search box:
Step-40: Click on the button ‘Google Analytics by Supermetrics’:
You should now see the ‘Data Source enrolled‘ status:
Step-41: Click on the ‘Configure transfer’ button:
You should now see a screen like the one below which is about creating a data transfer:
Step-42: Type a meaningful name for the ‘Transfer config name’ field:
Step-43: Keep the scheduling options (which specify when the transfer will run) to ‘Start now’ (unless you want to change it) and then move on to the next step:
Step-44: Keep the ‘Repeats’ setting to ‘Daily’ to have new data added once a day and move on to the next step:
Note: The ‘Start date and run time‘ setting is locked for editing when ‘Start now‘ setting is selected.
Step-45: Select the data set you created earlier from the drop-down menu:
We are going to use this data set for storing Custom Google Analytics data in BigQuery.
Step-46: Click on the ‘Connect source’ button:
Step-47: Click on the ‘Accept Agreement’ button:
Step-48: Click on ‘Sign in with Google’ button:
Step-49: Click on the name of the Google account which is associated with both your Google Analytics account and BigQuery project:
Step-50: Click on the ‘Authorize with Google Analytics’ button:
Step-51: Click on the name of the Google account which is associated with both your Google Analytics account and BigQuery project:
Step-52: Click on the ‘Allow’ button:
Step-53: Click on the ‘Continue’ button:
You should now see a screen like the one below:
Step-54: Select ‘My GA Schema’ from the ‘Select Schema’ drop-down menu:
Step-55: Select the Google Analytics view (from which you want to send data to BigQuery) from the ‘Accounts’ drop-down menu and then click on the ‘Submit’ button:
You should now see the ‘Source Connected‘ message just below ‘Third party connection‘:
Step-56: Click on the ‘Save’ button to save the transfer and also start the initial data transfer:
You should now see a screen like the one below:
Step-57: Click on the ‘Schedule backfill’ button to backfill the entire last month of Google Analytics data into your BigQuery table:
Step-58: Select your start and end date and then click on the ‘OK’ button:
Step-59: Wait for the data transfer to complete:
Step-60: Click on the ‘SQL workspace’ link from the left-hand side navigation:
Step-61: Navigate to the data set named ‘GA_data_set’ (which we created earlier).
You should now see the data table(s) automatically created by Supermetrics:
Since our custom schema contains only one query, therefore only one data table is automatically created.
Had our custom schema got multiple queries (say four queries) then four data tables would have been automatically created.
Step-62: Click on the data table (GA_TOP_COUNTRIES_BY_SESSIONS_) to see what data it contains:
At this point, you can query a particular set of data by clicking on the ‘Query Table’ button:
That’s how you can pull custom data from Google Analytics to BigQuery.
"How to use Digital Analytics to generate floods of new Sales and Customers without spending years figuring everything out on your own."
Here’s what we’re going to cover in this training…
#1 Why digital analytics is the key to online business success.
#2 The number 1 reason why most marketers are not able to scale their advertising and maximize sales.
#3 Why Google and Facebook ads don’t work for most businesses & how to make them work.
#4 Why you won’t get any competitive advantage in the marketplace just by knowing Google Analytics.
#5 The number 1 reason why conversion optimization is not working for your business.
#6 How to advertise on any marketing platform for FREE with an unlimited budget.
#7 How to learn and master digital analytics and conversion optimization in record time.
My best selling books on Digital Analytics and Conversion Optimization
Maths and Stats for Web Analytics and Conversion Optimization
This expert guide will teach you how to leverage the knowledge of maths and statistics in order to accurately interpret data and take actions, which can quickly improve the bottom-line of your online business.
Master the Essentials of Email Marketing Analytics
This book focuses solely on the ‘analytics’ that power your email marketing optimization program and will help you dramatically reduce your cost per acquisition and increase marketing ROI by tracking the performance of the various KPIs and metrics used for email marketing.
Attribution Modelling in Google Analytics and BeyondSECOND EDITION OUT NOW!
Attribution modelling is the process of determining the most effective marketing channels for investment. This book has been written to help you implement attribution modelling. It will teach you how to leverage the knowledge of attribution modelling in order to allocate marketing budget and understand buying behaviour.
Attribution Modelling in Google Ads and Facebook
This book has been written to help you implement attribution modelling in Google Ads (Google AdWords) and Facebook. It will teach you, how to leverage the knowledge of attribution modelling in order to understand the customer purchasing journey and determine the most effective marketing channels for investment.
About the Author
Himanshu Sharma
Founder, OptimizeSmart.com
Over 15 years of experience in digital analytics and marketing
Author of four best-selling books on digital analytics and conversion optimization
Nominated for Digital Analytics Association Awards for Excellence
Runs one of the most popular blogs in the world on digital analytics
Consultant to countless small and big businesses over the decade
error: Alert: Content is protected !!
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Allow Cookies”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie
Duration
Description
cookielawinfo-checkbox-analytics
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional
11 months
The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy
11 months
The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.