Pocket Guide to do it yourself Usability Testing

 

Usability testing is a technique which is used to evaluate website usability i.e. how easy it is for the visitors to use your website.

This technique should not be confused with website accessibility which measures how much accessible your website is to search engine crawlers like googlebot.

This technique should also not be confused with A/B testing in which marketers usually test their own assumptions.

All websites have got usability issues but these issues are generally not visible to the webmasters, as they know how their website work or is supposed to work. In other words,

You are not the best person to determine your own website’s usability issues.

You need third party perspective.

To carry out usability testing, follow the steps below:

Step 1: Determine what you are going to test

Test the objections raised by your customers.

The majority of optimizers test their own assumptions or what their client/boss has to say about perceived customer problems. You are smarter than that. You test customer’s objections. This is the sure fire way to find and fix usability issues.

If something does not matter to your customers, then fixing it will not impact your business bottom-line. It is as simple as that. If you are regularly taking feedback from your customers/users and recording their objections then you will never be short of objections.

Record your customers’ objections regarding:

  1. navigation
  2. website design
  3. usability
  4. text readability
  5. informativeness
  6. attention span
  7. shopping cart
  8. checkout process
  9. product price
  10. shipping
  11. delivery
  12. customer service etc.

Call your customers, email them, give them incentives, conduct surveys, offer discounts or anything that encourage them to give you feedback. Your target audience are your best testers. This is one of the best way to determine usability issues.

 

Step 2: Decide what you should test first

You may have discovered ‘N’ number of usability issues with your website through user feedback. But you probably do not have the time or resources to fix them all.

So it is prudent and practical to test those usability issues first and foremost which are significantly impacting your website sales like issues with the: checkout process, customer service, offering, pricing, shipping etc.

 

Step 3: Ask or hire a test participant

Ask or hire someone to be a test participant. Ask someone from another company to be your test participant or ask a friend who has never visited your website before.

You also can hire someone (online or offline) to be your test participant but bear in mind, that this is usually expensive.

Make sure that whoever you ask is not familiar with your website at all i.e. they have never visited your website before. Otherwise they may not be able to determine the most obvious usability issues as they already know how your website works.

You should aim to get five test participants for conducting your usability test in order to get optimum results. If you cannot arrange five test participants then even one test participant is better than choosing not to conduct the usability test.

Since usability test is qualitative, sample size does not really matter.

 

Step 4: Create a task

Create the task which you want your test participant to complete.

Example of a task:

Purchase car insurance from our website

 

Step 5: Create a scenario

Write a brief description which helps your test participant in completing your task. This brief description is known as a scenario.

Example of a scenario:

You are a person who needs to renew their car insurance. Determine how much car insurance you need, compare car insurance quotes and then make a purchase. Here are your account and credit card details:

Note: Make sure that your scenario is easy to understand and provides all the necessary information to complete the task.

 

Step 6: Deliver instructions to your test participant

Handover the task and scenario to your test participant and ask them to complete the task.

Deliver the following instructions:

  1. Request your test participant to speak their thoughts and actions as they browse the website.
  2. Request that they do not to ask any questions about how the website should be used during the test. For example, asking how to find a particular product on the website or how to complete the task in any other way.

Delivering instructions are very important part of the usability test.

If you help your test participant in any way during the test (even via body language) then you will skew your own test results.

So it important that you deliver the instructions and stop the test participant from expecting any help from you while using your website.

 

Step 7: Ask questions from the test participant but do not help them

Ask questions whenever the participant looks confused, puzzled or frustrated.

However, do not answer the participant’s questions regarding website usage and do not help them under any circumstances, in any way, shape or form (including body language such as  nodding or shaking head to show agreement or disagreement etc.) to complete your task.

Allow the test participant to figure out on their own how to use your website. After all, this is what you are testing in the first place.

 

Step 8: Record the screen activities of your test participant

Use a screen recording software like Camtasia to record the activities which happened on the screen and the conversation between you and the participant. This is an important step, as it will later help you in taking detailed notes.

 

Step 9: Take notes throughout the test

Jot down all the objections and frustrations raised or expressed by your participant during the test. These objections are the usability issues and you need to fix them.

 

Step 10: Draw conclusions from your usability test

You can draw conclusions from the notes you took while conducting the test. Once you have drawn the conclusions then you go ahead and fix the website usability issues.

 

 

Sample Usability Test

Here is a sample usability test:

Task – Purchase car insurance from our website

Scenario– You are a person who needs to renew his car insurance. Determine how much car insurance you need, compare car insurance quotes and then make a purchase. Here is your account and credit card details:

username: alex3456
Password: rtghdu5463@$JUKN
e-mail address: [email protected]
Credit Card Number: 938494892423781
Card Expiry Date: 12/15
CVV number: 456

Instructions:

  • Speak your thoughts or whatever you do as much as possible as you browse the website.
  • Don’t ask any question related to website usage during the task.

Notes:

  • User faced problem in finding out the car insurance calculator so he used the site search feature.
  • User is frustrated because ‘compare insurance quotes’ page take too much time to download.
  • User is not sure whether he is going to get the best deal as he is not satisfied with the insurance quotes.
  • User got frustrated as he had to enter the email address twice while checking out.
  • User doesn’t know the chassis number of his car so he can’t make the purchase.

Conclusions:

  • Make car insurance calculator more prominent on the website.
  • Reduce the download time of the ‘compare car insurance quotes’ page.
  • Check out what quotes leading competitors are providing.
  • Work on the checkout process.
  • Find out whether it is possible to purchase car insurance without specifying the car chassis number. If yes, then eliminate this field from the checkout process.

Quick Announcement about my new books

maths and stats bottom banner email analytics bottom banner attribution modelling bottom banner

Book #1: Maths and Stats for Web Analytics and Conversion Optimization - This expert guide will teach you, how to leverage the knowledge of maths and statistics, in order to accurately interpret data and take actions, which can quickly improve the bottom-line of your online business.

Book #2: Master the Essentials of Email Marketing Analytics - This book focuses solely on the ‘analytics’ that power your email marketing optimization program and help you in dramatically reducing your cost per acquisition and increasing marketing ROI, by tracking the performance of the various KPIs and metrics used for email marketing.

Book #3: Attribution Modelling in Google Analytics and Beyond - Attribution modelling is the process of determining the most effective marketing channels for investment. This book has been written to help you, in implementing attribution modelling. It will teach you, how to leverage the knowledge of attribution modelling, in allocating marketing budget and understanding buying behaviour.

Himanshu Sharma

Certified web analyst and founder of OptimizeSmart.com

My name is Himanshu Sharma and I help businesses in finding and fixing their Google Analytics and conversion issues.
  • More than ten years' experience in SEO, PPC and web analytics
  • Certified web analyst (master level) from MarketMotive.com
  • Google Analytics certified
  • Google AdWords certified
  • Nominated for Digital Analytics Association Award for Excellence
  • Bachelors degree in Internet Science
  • Founder of OptimizeSmart.com and EventEducation.com
I am also the author of the book Maths and Stats for Web Analytics and Conversion Optimization If you have any questions or comments please contact me