Research

Usability Testing

The practice of watching real users attempt real tasks on your product to identify friction, confusion, and failure points before they cost you.

#usability testing#user testing#moderated#unmoderated#think aloud#task completion#usability

What is it?

Usability testing is a research method in which representative users are asked to complete realistic tasks using a product (or prototype) while researchers observe, listen, and measure. It identifies where users struggle, why they struggle, and what they do instead of what designers expected. Unlike surveys or analytics, usability testing reveals the reasoning behind behaviour — the "why" behind the "what".

Why it matters

Analytics show you where users drop off. Usability testing shows you why. A 5-user usability test typically uncovers 85% of major usability problems (Nielsen, 1993). It is one of the highest-ROI research methods available: catching a single critical usability failure before launch can save hundreds of hours of post-launch fixes, loss of users, and brand damage. It is also the only method that puts actual human behaviour — not assumptions — at the centre of design decisions.

Best Practices

  • Test with 5 users per round to find ~85% of usability problems. Run multiple small rounds rather than one large one.
  • Write task scenarios using realistic user goals — "Find and book a hotel for 2 nights in Lisbon in July" — not instructions — never say "click the search button".
  • Use the think-aloud protocol: ask participants to narrate their thoughts as they work. This reveals mental models, confusion, and expectations.
  • Recruit participants who match your real user demographics and technical fluency. Testing with developers is not the same as testing with your actual users.
  • Observe without intervening. Resist the urge to help when participants struggle — that struggle IS the data.
  • Record sessions (with consent). You cannot watch, note, and analyse simultaneously. Video evidence also convinces stakeholders.
  • Measure both qualitative data (verbal confusion, misunderstandings) and quantitative data (task completion rate, time-on-task, error count).
  • Run unmoderated testing (e.g., Maze, UserTesting.com) for speed and scale. Run moderated testing for depth and nuance.
  • Test prototypes early — even paper prototypes reveal navigation and flow problems before a single line of code is written.
  • Debrief immediately after each session. Memory of nuanced moments fades within hours.

Common Mistakes

  • Writing leading tasks: "Use the search feature to find a hotel" tells users what to do instead of giving them a goal.
  • Testing with colleagues or teammates who know the product — familiarity blinds them to the friction real users experience.
  • Running one large test at the end of a project instead of iterative small tests throughout.
  • Focusing only on whether tasks are completed, not on how — the path reveals mental model mismatches.
  • Treating usability testing as a checkbox activity rather than acting on the findings.
  • Recruiting too few or too many participants — 5 is enough for qualitative; 20+ is needed for statistical significance in quantitative studies.
  • Asking participants if they "like" the design — preference is not usability.

Checklist

Research & Theory

Nielsen (1993) — Why You Only Need to Test with 5 Users

Jakob Nielsen's analysis of usability studies showed that a single evaluator finds only 35% of issues. With 5 users, you uncover approximately 85% of all major usability problems. Returns diminish sharply after that.

Why it's relevant

The 5-user rule liberates teams from waiting for perfect sample sizes. Iterative 5-user tests beat one 50-user test every time.

Think-Aloud Method (Ericsson & Simon, 1980)

The concurrent think-aloud protocol, where participants verbalise their thoughts in real time, is the most widely validated method for externalising cognitive processes during task performance.

Why it's relevant

Narrated user behaviour reveals mental models and decision logic that silent observation entirely misses. It is the gold standard for qualitative usability research.

Usability ROI (Bias & Mayhew, 1994)

Research on the cost-benefit of usability testing consistently shows returns of $10–$100 for every $1 invested, driven by reduced support costs, reduced development rework, and increased conversion.

Why it's relevant

Usability testing is not a cost — it is an investment. Catching a critical flow failure in testing is 10–100× cheaper than fixing it after launch.

Real-World Examples

Google

Runs thousands of usability studies per year across products. Every major UI change to Search, Maps, and Gmail is validated through task-based user testing before rollout.

Airbnb

Ran early usability tests on paper prototypes of the booking flow, discovering that users expected to see total price (with fees) much earlier than the design showed. This informed their now-famous pricing transparency.

GOV.UK

Every government service is tested with real citizens before launch, including vulnerable populations. Their public research sessions are a masterclass in inclusive usability testing.