Automating and Scaling Keyword Research through SEMRush

Today I would like to introduce you to a keyword tool which is truly a gem for any SEO and keyword junkie. Meet SEMRush.

The kind of tasks it can perform in keyword research and competitive analysis is truly outstanding and I am just plain lucky to find this tool. Within a few minutes of reading my post you will have the same opinion. Here is how you can scale your keyword research.

Determine keywords which are driving majority of organic traffic to competitor(s) website and target them

Lets say I want to know, which keywords are driving majority of organic traffic to the website say cotswoldoutdoor.com. This website sells outdoor clothing, footwear and equipment. So I go to semrush.com, type the URL of the website, select the country specific version of Google (in my case Google UK) and click on ‘search’ button. Boom. I get the keyword report which i can’t get from anywhere else (at least to my knowledge):

 

 

The cool thing about this report is that not only you get a list of keywords which are driving traffic to your competitor’s site but you can also find out:

  • Where your competitor is currently ranking on Google (see the ‘Pos’ column in the chart above) for each traffic keyword
  • Local search volume of each keyword (see the ‘volume’ column)
  • Average CPC of each keyword in US$ (check the CPC column). I hope the cost is available in pounds & other currencies too.
  • Web page of the website which is ranking for the keyword (check the URL column). Just click on the page URL to find out other keywords for which the web page is ranking in top 20 on Google and getting traffic.
  • What percentage of page total traffic is coming from the keyword (check the traffic % metric) . This is a really cool metrics and can help you in your keyword selection. You get an idea of how much traffic you can expect from a keyword if you rank at a particular position on Google SERP. Isn’t that cool???
  • Number of Google search results and seasonality of each keyword (check the results and trend columns). You would not first like to target a highly competitive keyword which is very seasonal for a non-seasonal SEO campaign. This is where keywords trends can help you in your keyword selection.
  • Cost% and competition columns help PPC guys more. Cost% is the ratio of the estimated cost of buying the same number of visitors for a keyword to the estimated cost of purchasing the same number of targeted visitors coming to this site from Google search results. Competition metrics talk about the number of Google adwords advertiser bidding for the keyword.  Higher is the competition, more valuable is the keyword. This is another key factor to keep in mind while selecting keywords.  Advertisers won’t heavily compete for keywords which are not driving conversions.

Even more cool thing about these reports is that you can download them into excel, sort the columns, separate branded keywords from non-branded keywords and do all those cool things which an excel ninja can do.

 Related Post: Keyword Research for e-commerce Websites – Tutorial

Determine your top SEO competitors in a scalable way

Before I discovered SEMrush, I used to follow a pretty tedious process of determining top competitors in organic search.

Here is what i used to do. I created a list of top five or top ten primary keywords. Run SEOmoz keyword difficulty tool for each keyword. Download the top ten websites ranking for each keyword in excel. Manually highlight those websites which rank for majority of my targeted keywords to determine my top SEO competitors.

This process is pretty time consuming, not very effective and is not scalable at all. If I wanted to determine top SEO competitors for say 100 keywords, then it would take me a day or two. If I wanted to determine top SEO competitors for say ten websites then it would take me weeks. The more clients, the harder the work.

Here is the solution I have found.

 

 

To determine top SEO competitors I simply clicked on the ‘competitors in Google’ link on the left hand side menu. And then just like Avinash style….. BOOM….Here we get a list of our top SEO competitors within seconds. The website Amazon is competing with Cotswold Outdoor for 2,933 keywords (check the ‘common keywords’ column). Therefore it is the number one SEO competitor. The website gooutdoors.co.uk is competing with Cotswold Outdoor for 2,397 keywords and that’s why it is their number two SEO competitor.

If you click on a common keywords link, you can determine the keywords for which website like amazon is competing with cotswoldoutdoor.

 

Form the chart above i can see that cotswoldoutdoor is ranking pretty poorly (rank 16) for the keyword ‘rab microlight jacket’. This keyword has good search volume and I need to work on it.

You can download this list into Excel, sort the list in decreasing order of SERP rankings and find out the keywords for which your competitor is outranking you. Similarly you can determine many hidden opportunities. Creativity is the key.

Keywords mining through competitor’s PPC campaigns

You know, I believe in the why every SEO should know PPC theory. The reason is simple. By running PPC campaigns you can test your keywords and get a fairly accurate estimates of a keyword’s search volume and its potential to convert even before you target them via SEO.

It can take several months to year to rank for your target keywords. So if you ended up optimizing your website for keywords which didn’t generate the traffic and conversions as you expected then all of your hard work (along with the client’s money) goes down the drain .

SEO mistakes are so costly that it is better to make some relatively cheap PPC mistakes by testing your targeted keywords first.

For small clients running PPC campaigns just to test keywords can be pretty expensive and not all SEO consultants /agencies are comfortable with the idea of suggesting PPC to their clients in any way or form. Here is the solution. Determine your competitors who run PPC campaigns and then determine the keywords they are bidding on and traffic they are getting through these keywords.  For e.g. outdoorkit.co.uk is one of the top SEO competitor of the website cotswoldoutdoor.com and they also run PPC campaigns on Google.

I clicked on the ‘competitors in adwords’ link on the left hand side menu to see this report. As you can see from the report, the website outdoorkit.co.uk is bidding on 524 keywords (check the ‘Adw Keywords’ column) which are driving traffic to the website. Lets see what these keywords are.

 

Boom. I can see the keywords on which outdoorkit is bidding. The site is bidding on ‘water proof trousers’. This keyword is relevant to my site and i should investigate it further. So i just click on the ‘waterproof trousers’ link.

Now i can see all the keyword data: avg. CPC, advertising competition, local monthly search volume etc. Through phrase match report and related keywords report i can get tons of keyword ideas.

Other features in SEMRush

1. Ability to scrap competitors’ Google adwords ad copies. You can dowload the ad copies your competitor is using for adwords ads into excel and then mine keywords or just get ad copy ideas.

2. You can find potential ad buyer and ad sellers for any domain.

3. One of the biggest advantage of using SEMrush is that this tool is available in different languages, you can access its API and you can use country specific version of Google to mine keywords. SEMRush uses different database for different country specific versions of Google. So set of keywords, avg. CPC, local search volume etc vary from version to version.

The only downside of this tool is that it is not free. But then best things in life are not free. You can use the basic features for free but to get the full functionality (which you should) you need to upgrade to the pro account.  If you think there are other keyword tools which can do the above tasks much better then please share in the comments below.

Other posts you may find interesting:

 

Do you know the difference between Digital Analytics and Google Analytics?


99.99% of course creators themselves don’t know the difference between Digital analytics, Google Analytics (GA) and Google Tag Manager (GTM).

So they are teaching GA and GTM in the name of teaching Digital analytics.

They just copy each other. Monkey see, monkey do.

But Digital analytics is not about GA, GTM.

It is about analyzing and interpreting data, setting up goals, strategies and KPIs.

It’s about creating strategic roadmap for your business.


Digital Analytics is the core skill. Google Analytics is just a tool used to implement ‘Digital Analytics’.

You can also implement ‘Digital analytics’ via other tools like ‘adobe analytics’, ‘kissmetrics’ etc.

Using Google Analytics without the good understanding of ‘Digital analytics’ is like driving around in a car, in a big city without understanding the traffic rules and road signs.

You are either likely to end up somewhere other than your destination or you get involved in an accident.


You learn data analysis and interpretation from Digital analytics and not from Google Analytics.

The direction in which your analysis will move, will determine the direction in which your marketing campaigns and eventually your company will move to get the highest possible return on investment.

You get that direction from ‘Digital analytics’ and not from ‘Google Analytics’.


You learn to set up KPIs, strategies and measurement framework for your business from ‘Digital analytics’ and not from ‘Google Analytics’.

So if you are taking a course only on 'Google Analytics’, you are learning to use one of the tools of ‘Digital analytics’. You are not learning the ‘Digital analytics’ itself.

Since any person can learn to use Google Analytics in couple of weeks, you do no get any competitive advantage in the marketplace just by knowing GA.

You need to know lot more than GA in order to work in digital analytics and marketing field.


So what I have done, if you are interested, is I have put together a completely free training that will teach you exactly how I have been able to leverage digital analytics to generate floods of news sales and customers and how you can literally copy what I have done to get similar results.

Here what You'll Learn On This FREE Web Class!


1) The number 1 reason why most marketers and business owners are not able to scale their advertising and maximise sales.

2) Why you won’t get any competitive advantage in the marketplace just by knowing Google Analytics.

3) The number 1 reason why conversion optimization is not working for your business.

4) How to advertise on any marketing platform for FREE with an unlimited budget.

5) How to learn and master digital analytics in record time.

 
 

My best selling books on Digital Analytics and Conversion Optimization

Maths and Stats for Web Analytics and Conversion Optimization
This expert guide will teach you how to leverage the knowledge of maths and statistics in order to accurately interpret data and take actions, which can quickly improve the bottom-line of your online business.

Master the Essentials of Email Marketing Analytics
This book focuses solely on the ‘analytics’ that power your email marketing optimization program and will help you dramatically reduce your cost per acquisition and increase marketing ROI by tracking the performance of the various KPIs and metrics used for email marketing.

Attribution Modelling in Google Analytics and Beyond
Attribution modelling is the process of determining the most effective marketing channels for investment. This book has been written to help you implement attribution modelling. It will teach you how to leverage the knowledge of attribution modelling in order to allocate marketing budget and understand buying behaviour.

Attribution Modelling in Google Ads and Facebook
This book has been written to help you implement attribution modelling in Google Ads (Google AdWords) and Facebook. It will teach you, how to leverage the knowledge of attribution modelling in order to understand the customer purchasing journey and determine the most effective marketing channels for investment.

Himanshu Sharma

Digital Marketing Consultant and Founder of Optimizesmart.com

Himanshu helps business owners and marketing professionals in generating more sales and ROI by fixing their website tracking issues, helping them understand their true customers purchase journey and helping them determine the most effective marketing channels for investment.

He has over 12 years experience in digital analytics and digital marketing.

He was nominated for the Digital Analytics Association's Awards for Excellence.

The Digital Analytics Association is a world renowned not-for-profit association which helps organisations overcome the challenges of data acquisition and application.

He is the author of four best-selling books on analytics and conversion optimization:

error: Alert: Content is protected !!