Master the art of keyword research with our comprehensive guide. Learn proven strategies to identify high-intent keywords, analyse competitor tactics, and optimise your content for better search rankings and organic visibility.

Keyword research is the foundation of every successful SEO strategy — it identifies what your target audience is actually searching for, allowing you to create content that meets their needs and ranks in search engines. Done properly, keyword research reveals not just search terms but user intent, commercial opportunity, and content gaps your competitors have missed.

At a Glance

  • What it is: The systematic process of discovering, analysing, and prioritising search terms your target audience uses to find businesses, products, or information like yours
  • Why it matters: Without keyword research, you're creating content based on guesswork — wasting time and budget on topics that don't drive traffic or conversions
  • Time investment: Initial research for a new site: 15–25 hours; quarterly refresh: 4–6 hours
  • Core tools needed: Google Keyword Planner (free), Google Search Console, plus one paid tool (Ahrefs, Semrush, or similar)
  • Biggest UK-specific consideration: British vs American English variations matter significantly — "solicitor" vs "lawyer", "estate agent" vs "realtor", "car insurance" vs "auto insurance"

Key Takeaways

Understanding Search Intent: The Missing Foundation in Most Keyword Strategies

Before you open a single keyword tool, you need to grasp the concept that has fundamentally reshaped SEO since 2021: search intent. Google's algorithms now prioritise understanding why someone searches, not just what they search for. A keyword without context is just a word — understanding intent transforms it into a strategic asset.

What Is Search Intent?

Search intent (also called user intent) is the underlying goal a user has when typing a query into a search engine. It answers: "What does this person actually want to accomplish?" The four primary categories are informational (learning), navigational (finding a specific site), commercial (researching before buying), and transactional (ready to purchase or convert).

Here's why this matters practically: if you target "best accountants London" with a blog post explaining accounting basics, you'll never rank. Google recognises that query has commercial intent — users want to compare and hire accountants — so it surfaces directory listings, review pages, and firm websites, not educational content.

Business person searching laptop comparing services

The Four Intent Categories and Where Your Keywords Belong

Intent Type User Goal Keyword Examples Best Page Type Conversion Likelihood
Informational Learn or understand something "what is SEO", "how does keyword research work" Blog post, guide, tutorial Low (but builds authority)
Navigational Find a specific website or page "HeroSEO contact", "Google Analytics login" Homepage, login page, contact page N/A (brand search)
Commercial Research options before deciding "best SEO agency UK", "Ahrefs vs Semrush" Comparison page, service page, case studies Medium-High
Transactional Complete an action or purchase "hire SEO consultant", "buy Ahrefs subscription" Service page, product page, booking form Very High

At HeroSEO, we've found that businesses often make a costly mistake: they target transactional keywords exclusively because "those are the ones that convert". The problem? Transactional keywords are brutally competitive and represent only 10–15% of total search volume in most industries. A balanced strategy captures users at every stage of their journey, building trust through informational content whilst converting ready buyers through commercial and transactional pages.

How to Determine Intent Without Guessing

Never assume intent based on the keyword alone. Instead, search the term yourself in an incognito window and examine the top 10 results. What type of content does Google predominantly show? If eight of the top 10 are blog posts, that's informational intent. If they're product pages or service descriptions, it's transactional. If you see comparison articles and review sites, it's commercial. Google has already done the intent analysis for you through billions of user interactions — your job is simply to observe and align.

This is especially important for UK businesses operating in regulated industries. A search for "how to choose a financial adviser" (informational) requires completely different content than "independent financial adviser Manchester" (transactional), even though both might seem relevant to an IFA firm.

The Five-Stage Keyword Research Process That Actually Works

Effective keyword research isn't about downloading a massive spreadsheet of every remotely related term. It's a strategic process of discovery, analysis, prioritisation, and ongoing refinement. Here's the methodology we use for clients across sectors from SaaS to professional services.

Stage 1: Seed Keyword Generation (The Brainstorm Phase)

Start by listing 10–20 "seed keywords" — broad terms that describe your core offerings, industry, or the problems you solve. For a commercial insurance broker, seeds might include: business insurance, public liability insurance, professional indemnity insurance, employer liability cover, insurance broker, commercial insurance quotes.

Expand this list by considering:

Don't self-edit at this stage. The goal is breadth, not precision. You'll filter later.

Stage 2: Keyword Expansion (Mining the Data)

Now you multiply those 20 seeds into hundreds of variants using keyword research tools. Each tool offers different strengths:

Google Keyword Planner (free, requires a Google Ads account): Enter your seed keywords and it returns related terms with search volume ranges and competition levels. The data is directly from Google, making it reliable for UK-specific volumes. However, volume ranges are broad ("1K–10K") unless you're running active campaigns.

Google Search Console (free): If your site is already live, the Performance report shows every query that generated an impression or click. Filter by queries where you rank positions 8–20 — these are your quickest wins because you're already close to page one.

Ahrefs Keywords Explorer (paid): Enter a seed and get thousands of variations, along with keyword difficulty scores, click data, and SERP analysis. The "Questions" report is invaluable for identifying question-based keywords for blog content. Ahrefs also provides accurate UK-specific search volumes.

Keyword research tool dashboard analytics screen

Semrush Keyword Magic Tool (paid): Similar functionality to Ahrefs with strong competitor keyword analysis. The "Keyword Gap" tool reveals terms your competitors rank for that you don't — often your fastest path to new traffic.

Answer The Public (freemium): Visualises questions and prepositions people use with your seed term. Excellent for content ideation and capturing long-tail informational keywords.

Stage 3: Competitor Keyword Analysis (Finding the Gaps)

Your direct competitors have spent years and significant budget discovering what works in your market. Why reinvent the wheel? Analyse their keyword profiles to identify opportunities they've already validated.

In Ahrefs or Semrush, enter a competitor's domain and navigate to their Organic Keywords report. Export keywords where they rank positions 1–10. Now run a gap analysis: which of those keywords does your site not rank for at all? These represent proven opportunities in your market.

Expert Insight: The 10/100 Rule for Competitive Analysis

At HeroSEO, we use the "10/100 rule" when analysing competitor keywords. Identify 10 competitors (including direct rivals and larger players whose authority you're building towards). For each, extract their top 100 organic keywords by traffic. The keywords that appear on multiple competitors' lists — but not yours — are your priority targets. These represent established demand with proven commercial value. This method surfaces opportunities that broader keyword tools miss, particularly for UK regional service businesses where national competitors and local independents target different keyword sets.

Pay special attention to keywords where competitors rank in positions 4–10. These are terms they're targeting but haven't fully optimised for — meaning the competition is beatable. If a competitor ranks #8 for "corporate legal services Birmingham" with a thin 400-word page, you can outrank them with comprehensive, well-structured content.

Stage 4: Keyword Prioritisation (The Filtering Framework)

You now have a spreadsheet with 500+ keywords. Most will never make it into your strategy, and that's the point. Prioritisation separates effective keyword research from data hoarding.

Score each keyword across four dimensions:

1. Search Volume: How many people search this per month in the UK? Tools provide monthly averages. For local businesses, don't dismiss low volumes — "solicitor Tunbridge Wells" might only see 90 searches monthly, but if you're the only solicitor firm in Tunbridge Wells targeting it, that's 90 highly qualified local prospects.

2. Keyword Difficulty: How hard will it be to rank on page one? Ahrefs and Semrush provide difficulty scores (0–100). As a rough guide: 0–20 is achievable for new sites, 20–40 requires decent content and some backlinks, 40–60 needs strong domain authority, and 60+ is extremely competitive. Don't only chase easy keywords — a mix across the difficulty spectrum builds sustainable growth.

3. Commercial Intent: How likely is this search to generate business value? A search for "what is SEO" (informational) has lower immediate value than "hire SEO agency Bristol" (transactional), but informational content builds the authority that helps transactional pages rank. Score intent as low/medium/high based on the user's position in the buying journey.

4. Relevance: How closely does this keyword align with what you actually offer? A keyword with perfect volume and low difficulty is worthless if it attracts the wrong audience. A cybersecurity firm might discover "free antivirus software" has huge volume and low difficulty, but targeting it attracts consumers seeking free tools, not enterprises needing managed security services.

The Keyword Priority Matrix

Plot your keywords into four categories:

For most businesses, your first 90 days should focus exclusively on Quick Wins — terms you can realistically rank for within 3–6 months that will drive qualified traffic.

Stage 5: Keyword Mapping (Assigning Keywords to Pages)

Don't make the rookie mistake of creating one page per keyword. Modern SEO targets keyword clusters — groups of related terms with the same intent that can be comprehensively covered on a single page.

For example, these keywords form a natural cluster for one service page:

They all have transactional intent and describe the same service from slightly different angles. One well-optimised page can rank for all of them.

Content calendar spreadsheet keyword mapping

Create a keyword map spreadsheet with columns for: Target Page, Primary Keyword, Secondary Keywords (4–6 related terms), Search Intent, Current Ranking (if applicable), Priority Level. This becomes your content roadmap.

UK-Specific Keyword Research Considerations (What Generic Guides Miss)

Most keyword research tutorials are written for US markets and miss critical factors that UK businesses must account for. These aren't minor details — they can make the difference between a strategy that works and one that wastes budget.

British vs American English Variations

Search volume differs significantly between British and American spellings, and Google treats them as distinct keywords. "Optimise" and "optimize" don't rank for each other. In most cases, British spellings have substantially lower search volumes in global tools because they aggregate worldwide data where American English dominates.

Always filter your keyword tool to "United Kingdom" when researching. If you're targeting UK audiences, prioritise British spellings even if US variants show higher volume — that volume isn't relevant to you. Common variations to check:

Regional and Localised Keywords

The UK is not a homogeneous market. "Best Italian restaurant" performs very differently in Manchester vs London vs Edinburgh, and local businesses need city-specific keyword variants for every service or product category they target.

For service businesses with physical locations, create keyword variations for:

Don't assume demand exists equally everywhere. "Conveyancing solicitor" sees 5× higher search volume in London and the South East than in Wales or Scotland. Validate local demand before building content for every region.

Industry-Specific Terminology Differences

Certain industries use different terminology in the UK vs US, and ranking for the wrong variant means attracting the wrong audience or no audience at all.

Examples: In financial services, "pension" is the UK term whilst "401k" is American — but many UK sites mistakenly optimise for "retirement planning 401k" because it shows higher volumes in non-filtered tools. In legal, "solicitor" is distinctly British; Americans search "attorney". In property, "estate agent" and "letting agent" are UK-specific; "realtor" and "property manager" are American.

When in doubt, check the SERPs. Search your keyword and see if results are predominantly UK sites using UK terminology, or if you're seeing US results. That tells you whether the keyword is relevant to your market.

The Intent-First Keyword Framework: A Fresh Approach Beyond Standard SEO Methodology

Most keyword research workflows follow the same pattern: identify seeds, expand with tools, filter by metrics, map to pages. This method works, but it produces predictable strategies that mirror your competitors. To uncover genuinely differentiated opportunities, flip the conventional process on its head with what we call the Intent-First Keyword Framework.

Rather than starting with products or services (your perspective), begin by mapping your audience's complete decision journey — every question they ask, every problem they encounter, and every information need they have from first awareness through post-purchase. According to research from Google, the average B2B buyer consumes 13 pieces of content before making a purchase decision, and B2C customers engage with 10+ touchpoints across multiple channels. Most businesses only create content for 2–3 of those touchpoints.

Step 1: Journey Mapping Before Keyword Discovery

Interview 5–10 recent customers or clients. Ask them to reconstruct their journey: What triggered their initial search? What did they Google first? What questions did they need answered before they'd even consider vendors? What comparisons did they make? What final doubts needed resolving before purchase?

Document the actual search phrases they remember using — not sanitised marketing terms. You'll discover patterns: accounting firms find prospects searched "what happens if I file tax return late" and "can HMRC see my bank account" long before searching "accountant near me". These early-stage informational queries represent awareness-building opportunities your competitors ignore because they don't map directly to transactions.

Step 2: Intent Stage Clustering

Organise your keyword targets into five journey stages, not four intent categories:

This five-stage model reveals keyword gaps in stages 1–3 where competition is lower and trust-building happens. In our experience, businesses that dominate early-stage keywords build authority that makes later-stage conversions significantly easier — prospects arrive at your commercial pages already familiar with your expertise.

Step 3: Reverse-Engineer Intent Signals

Rather than accepting tool classifications, analyse intent signals hidden in SERP features and user behaviour. A keyword might appear "informational" but contain strong commercial signals:

"How much does [service] cost" looks informational (begins with "how"), but triggers price comparison results and indicates purchase-stage research. "Best [product] for [use case]" appears educational but surfaces buying guides and affiliate content. These hybrid-intent keywords convert better than pure transactional terms because they capture users actively comparing options with lower competition than obvious commercial keywords.

Use this signal analysis to build a "hidden high-intent" keyword list — terms that tools classify as informational but SERP analysis reveals have commercial value. These represent your competitive advantage.

Why This Framework Works Differently

Standard keyword research starts with your business and works outward ("What do we sell? What keywords describe that?"). The Intent-First Framework starts with customer psychology and works backward ("What journey do customers take to realise they need us? What do they search at each stage?").

This approach surfaces keywords competitors miss because they're not obvious product or service terms. It builds content moats around your commercial pages — layers of trust-building content that make your transactional pages significantly more effective. And it creates natural internal linking pathways that guide users from awareness through to conversion whilst signalling topical authority to Google.

When we've applied this framework for clients, we consistently identify 20–40% more targetable keywords than conventional research methods, with particular strength in low-competition, early-journey terms that establish market authority before competitors even know those keywords exist.

Advanced Keyword Research Tactics for Competitive Markets

Once you've mastered the fundamentals, these advanced techniques help you find opportunities that competitors miss — particularly valuable for businesses in saturated sectors like legal, finance, or property.

The SERP Feature Opportunity Hunt

Featured snippets, People Also Ask boxes, and other SERP features represent "position zero" — above traditional organic results. Keywords that trigger these features are disproportionately valuable because capturing the feature means massive visibility even if you rank #3 or #4 organically.

In Ahrefs, filter your keyword list to show only terms with SERP features. Prioritise questions that trigger PAA boxes and keywords with featured snippets where the current snippet is a weak answer (thin content, poorly formatted, outdated). You can win these by providing a superior, structured answer.

For UK businesses, particularly in B2B services, featured snippets for "how to" and "what is" queries drive significant qualified traffic. Solicitor firms can capture snippets for "how to change company name at Companies House" and "what is a statutory declaration" — informational queries that build trust and lead to commercial enquiries.

Mining Google Search Console for Hidden Gems

Your existing Search Console data reveals opportunities that no keyword tool can surface: terms where you're accidentally ranking without optimisation. These are the easiest wins in your entire strategy.

In Search Console, filter the Performance report to show queries with:

These queries represent existing Google recognition of your site's relevance. Optimise the ranking page's content, improve internal linking to it, and you'll often see it move to page one within 4–8 weeks.

Google search console performance graph rankings

Seasonal and Trending Keyword Identification

Some keywords surge at predictable times. "Tax return accountant" spikes January–April. "Wedding photographer" peaks March–May. "Boiler repair" surges in November–December. If you publish content for seasonal keywords at the right time — 2–3 months before the surge — you maximise traffic capture during peak demand.

Use Google Trends (filter to United Kingdom) to identify seasonal patterns for your core keywords. Plot a content calendar that publishes seasonal content well ahead of demand spikes, giving it time to rank before the traffic arrives.

Forum and Community Mining

Reddit, Quora, industry forums, and Facebook groups reveal the actual language your target audience uses — often different from how businesses describe their services. Search your industry or problem space on these platforms and extract common questions, pain points, and phrasing.

These insights surface long-tail keywords that tools miss because they're conversational rather than perfectly grammatical. Someone might not search "statute of limitations breach of contract UK" (formal, legal phrasing) — they search "how long can someone sue me for breaking contract" (conversational, natural). The latter has clearer intent and often less competition.

Common Keyword Research Mistakes That Kill ROI

We've audited hundreds of keyword strategies over the years, and these errors appear consistently — even from businesses that understand SEO basics.

Chasing Volume Over Intent

A keyword with 50,000 monthly searches sounds better than one with 500 — until you realise the high-volume term is informational whilst the low-volume term is transactional. "What is life insurance" (high volume, informational) attracts people at the start of their research