What is SEO? How it works, tested on 20 real sites

SEO (search engine optimization) is the practice of making a website easier for search engines to crawl, understand, and rank, so it earns unpaid traffic. It is never finished: when we ran SEOmator's 251-rule audit against the homepages of 20 well-known public sites in July 2026, not one came back clean.

SEO is the work of aligning a website's content, code, and reputation with how search engines find and rank pages, in order to earn organic (unpaid) traffic. Unlike paid search, you don't buy the position — you qualify for it, and you have to keep qualifying.

That last part is the bit most beginner guides skip. SEO is presented as a project with a finish line. The audit data below says otherwise: sites with real engineering budgets still ship homepages missing a canonical tag.

How do search engines actually work?

Search engines run three separate processes — crawling, indexing, and ranking — and a page can pass the first and fail the second. Understanding where your page drops out is most of technical SEO.

Crawling. Automated programs (crawlers, bots, or spiders) request pages and follow the links they find to reach others. Googlebot doesn't browse your site the way a person does; it queues URLs, respects your robots.txt, and budgets how much it fetches.

Indexing. Fetched pages are parsed, rendered, and stored in an index — a database of what each page is about. Being crawled does not guarantee being indexed. Google can fetch a page and decide it's a near-duplicate, too thin, or explicitly excluded. If you're not sure where you stand, check if a page is indexed before assuming a ranking problem.

Ranking. When someone searches, the engine pulls candidate pages from the index and orders them using hundreds of signals: how well the page matches the query, how usable it is, how much the rest of the web references it, and how well it satisfies what the searcher actually wanted.

Google's own SEO Starter Guide puts the goal plainly: help search engines understand your content, and help users find your site. Those two jobs overlap far more than they conflict.

What did we find when we audited 20 well-known homepages?

On 20 July 2026 we ran SEOmator's full 251-rule engine against the homepages of 20 named public sites — Allbirds, Warby Parker, Glossier, Patagonia, Notion, Figma, Linear, Vercel, The Verge, Ars Technica, CSS-Tricks, Smashing Magazine, Etsy, Shopify, Stripe, Basecamp, Sweetgreen, Blue Apron, Khan Academy, and Mozilla. Every audit completed. None were excluded.

Not one came back clean. The median site failed 13 rules and picked up 39 warnings. Overall scores landed in a narrow band: 93 to 95 out of 100. Even the best-resourced sites on the web don't score 100.

Here's how the failures distributed across the engine's 20 categories. The percentage is the share of the 20 sites with at least one hard failure in that category:

Content quality was the only category where all 20 sites had at least one hard failure. And the categories at 0% aren't necessarily healthy — E-E-A-T recorded no hard failures but came back with the lowest median score of all 20 categories (86/100), with every single site drawing at least one warning there.

Zooming in on individual rules changes the picture again. These are the checks that failed most often:

The single most common failure was horizontal scrolling on mobile, on 11 of the 20 sites. Below that, the list is startlingly basic: 8 of the 20 homepages shipped without a rel=canonical tag, and 6 had no meta description at all — two of the oldest, simplest checks in SEO.

The useful lesson for a beginner isn't that these sites are bad — they're among the best-run on the web. It's that SEO is never "finished". Teams with real engineering budgets still ship homepages missing a canonical tag or an og:image. That's what makes an audit a routine, not a one-off project. It also reframes the advice below: the checks that break in the wild are not the exotic ones.

Why does SEO matter for a business?

SEO matters because search is still where demand starts, and because organic clicks don't carry a per-click cost. The scale is the argument.

According to Reboot Online, Google accounts for almost 90% of the global search engine market, equating to nearly 14 billion searches a day. (If you've read an older guide claiming 3.5 billion — that figure is roughly a decade stale.) The same roundup puts 53% of website traffic as arriving from organic search, with an average close rate of 14.6% on that traffic.

Four concrete reasons it earns budget:

• Organic traffic compounds. A page that ranks keeps earning visits without incremental spend. Paid search stops the moment the card declines.
• Position carries credibility. Searchers treat top results as vetted. That trust transfers to your brand before anyone reads a word of your copy.
• It forces user-experience work. Page speed, mobile layout, clear navigation and readable content are ranking inputs and conversion inputs. Fixing them pays twice.
• The intent is already qualified. Someone searching "protein supplements for runners" has told you exactly what they want. No other channel hands you that.

Cost is the part people oversell. SEO isn't free — it costs tool subscriptions, engineering hours, and content time. What it avoids is a per-click auction. Yahoo Finance reports the global SEO services market is estimated to exceed $83 billion in 2026 — a fair proxy for how much of this is labour rather than magic.

There's a newer wrinkle. Ahrefs' analysis of AI Overviews found the average click-through rate on position one drops by 34.5% when an AI Overview is present. Ranking first is worth less than it was. As Adobe framed it, visibility increasingly depends less on page position and more on whether a brand is cited within AI-generated responses — which is why "poor content structure for AI extraction" showed up on 35% of the sites we audited, and why a GEO audit is now a separate check from a classic SEO one.

What are the four types of SEO?

SEO splits into four practices: on-page, technical, off-page, and local. Most guides present them as equally weighted. Our audit data says two of them break far more often than the others — with the honest caveat that a single-page audit can only see two of the four at all.

Read the order as "what our data could see failing", not as a ranking of importance. Off-page and local sit last here because a homepage audit cannot observe them, not because they matter less.

On-page SEO

On-page SEO is everything on the page itself: the words, the HTML that describes them, and the structure that connects them. It's the type that failed most in our sample, and by a wide margin.

The building blocks:

• Content quality. Does the page answer the question the searcher actually asked, better than the alternatives? Depth is not word count.
• Keyword usage. Target terms belong in the title, URL, and body — used naturally. Note that 8 of our 20 sites tripped the excessive keyword density rule, which is a failure, not an optimization.
• Title tags and meta descriptions. The title is a primary relevance signal; the description drives click-through. Six of our sample had no description at all. If you're unsure of the limits, see how long a meta title should be.
• URL structure. Short, readable, and descriptive of the destination.
• Internal linking. Links between your own pages help crawlers reach everything and tell them which pages you consider important. You can find internal links to a page to check whether a URL is orphaned.

Technical SEO

Technical SEO is the infrastructure layer: whether crawlers can reach your pages, render them, and trust them. It broke on most of our sample, most often on performance and security headers.

Where to look first:

• Page speed and Core Web Vitals. Slow pages lose users and rank worse. Start with how to fix a failed Core Web Vitals assessment if your field data is red.
• Mobile rendering. Horizontal scroll was our single most common failure across all 251 rules. Google indexes the mobile version of your page first — see mobile-first indexing.
• Crawlability and site architecture. Robots directives, sitemaps, and how many clicks it takes to reach a page. Deeply buried pages get less traffic; crawl depth explains how to flatten that.
• Structured data. JSON-LD that tells engines what a page represents. Missing on 7 of 20 sites here.
• HTTPS and security headers. SSL is the baseline; HSTS and X-Content-Type-Options were missing on 40% and 50% of our sample respectively.

For a broader sweep, our roundup of top technical SEO issues covers the failures we see most often across client sites.

Off-page SEO

Off-page SEO is everything that happens away from your domain that affects how engines judge it — mostly links, plus brand mentions and coverage.

A link from another site works like a citation: it signals that someone thought your page was worth pointing at. Quality dominates quantity, and a handful of links from genuinely relevant, well-regarded sites outperforms hundreds of low-value ones. The tactics that still work are unglamorous: publishing something worth citing, contributing to publications your audience already reads, and earning coverage through actual news. Periodically running a backlink audit catches the toxic and broken links that accumulate whether you build links or not.

Be sceptical of anything that sounds like a shortcut. Directory submission schemes and article-spinning networks are relics that now carry risk rather than reward.

Local SEO

Local SEO targets searches with geographic intent — "dentist near me", "coffee shop open now" — and it's the type where the ranking system is genuinely different. Proximity and profile completeness matter in ways they don't for national queries.

The essentials are a claimed and fully populated Google Business Profile, consistent name/address/phone details across directories, real reviews, and location pages with actual local content rather than a template with the city name swapped. If you operate across regions, local SEO vs global SEO covers where the two strategies diverge.

How do keywords and search intent fit together?

Keywords are the phrases people type; intent is what they're trying to accomplish. Targeting the right keyword with the wrong intent is the most common reason a well-written page never ranks.

Intent splits three ways:

1. Informational — the searcher wants to know something. "How does a digital camera work". Serve an explainer.
2. Navigational — they want a specific destination. "Sony camera support". Serve the actual page, not a blog post about it.
3. Transactional — they're ready to act. "Buy Sony a7 IV". Serve a product or pricing page.

The practical workflow is short. Write down what a customer would plausibly type. Check volume and competition with a keyword research tool. Then — and this is the step people skip — search the term yourself and look at what already ranks. If the top ten are all product pages and you've written a 2,000-word guide, the intent mismatch will beat your on-page work every time.

Long-tail phrases ("waterproof running shoes for flat feet") convert better than head terms precisely because the intent is unambiguous.

What are the core elements that make SEO work?

Strip away the categories and four things do most of the work: content, links, architecture, and mobile performance. They reinforce each other, which is why isolated fixes underdeliver.

Content creation and optimization. Start from a real question, not a keyword. Plan on a cadence you can sustain — an abandoned blog signals neglect. Write for a person, use headings that describe what follows, and revisit older pieces rather than only adding new ones. Refreshing a page that already ranks usually beats publishing a fifth article on the same topic.

Link building. Links remain a significant input into how engines judge authority. The reliable method is to publish something with a reason to be cited — original data, a genuinely useful tool, a clear explanation of something confusing — and then tell the people who'd care. As Adam Audette put it: "Today it's not about 'get the traffic', it's about 'get the targeted and relevant traffic.'" The same applies to links.

Site architecture. A site without clear structure is a city without signage. Group related pages into sections, link across siblings, and keep important pages within a few clicks of the homepage. Good architecture helps crawlers and stops users bouncing.

Mobile-first indexing. Google predominantly uses the mobile version of your content for indexing and ranking. That means the mobile page is the page, not a reduced version of the "real" one. Given that mobile horizontal scroll was our most common failure, this is worth checking on an actual phone rather than a resized browser window.

How do you measure whether SEO is working?

You measure SEO by tracking a small set of metrics over months, not days. Rankings move constantly; the signal is in the trend line.

The tools that cover most of it:

• Google Search Console — free, and the only source of truth for how Google actually sees your site: which queries brought impressions and clicks, which pages are indexed, and what errors were found. Start here.
• Google Analytics — where organic visitors go once they arrive, and whether they convert.
• An audit tool — for the technical and on-page checks a rankings report won't surface. Ours runs the same 251 rules described above.
• A rank tracker — for position history on the terms you actually care about. Our guide to monitoring organic rank covers the methods, including the free ones.

The metrics worth watching:

Two cautions. First, impressions usually move before clicks — a rising average position with flat traffic is progress, not failure. Second, don't judge a change in under six weeks; you'll mistake normal volatility for a result.

What should a beginner do first?

Start with an audit, fix the failures that appear on most sites, and only then write more content. That order matters — publishing onto a broken foundation wastes the writing.

A first-90-days sequence that reflects what our audit data says actually breaks:

1. Verify Search Console. Nothing else is measurable until you have it. Check the Pages report for anything excluded from the index.
2. Run a full audit and fix the basics first: missing canonical tags, missing meta descriptions, missing og:image. These are cheap fixes that appeared on 30–40% of even the best-run sites in our sample.
3. Open your homepage on a real phone and check for horizontal scroll. It was our single most common failure.
4. Add security headers. HSTS and X-Content-Type-Options were absent on 40% and 50% of our sample. This is a one-line server config change, not a project.
5. Add structured data for what your pages are — Organization, Article, Product. Missing on a third of the sites we checked.
6. Fix titles and descriptions page by page, prioritizing pages that already get impressions.
7. Then start publishing — against real queries, with intent checked against what already ranks.

Methodology and limitations

The audit run. SEOmator SEO audit engine, 20 July 2026. One page per site (the homepage), 251 rules across 20 categories, default configuration, no crawl. All 20 audits completed; none were excluded. The 20 sites are named in full earlier in this post.

The charts. Every graphic in this post is built from that run and from no other source. Two of them show a subset for legibility — the category chart plots the six categories where failures concentrated, and the score chart plots the low, median and high. The complete 20-category breakdown is in the table above, and nothing has been rounded or reordered to flatter the result.

Limitations. Five, stated plainly, because they change how the numbers should be read:

1. Homepage-only. A homepage is an atypical page: it is usually the most-optimized URL on a site, so this understates what a full-site crawl would surface.
2. A rendering artifact, partly. The "thin content" rule fired on several JS-heavy homepages where the raw HTML carries little text before hydration. That is a rendering artifact as much as a content problem, and worth reading as such.
3. Lab, not field. Core Web Vitals figures here are lab measurements from a single fetch, not field data from real users (CrUX).
4. Two of the four types are invisible here. Off-page SEO (backlinks, brand mentions) and local SEO (Google Business Profile, citations) cannot be measured from a single-page audit. This dataset speaks to on-page and technical SEO only.
5. A ceiling, not an average. These are large, well-resourced sites. A typical small-business site scores lower, not higher — so treat 93–95 as a ceiling, not an average.

External figures. Search volume, market share, traffic share, and CTR statistics are cited inline to their original publishers and linked at first mention. Where a figure originates with another SEO tool vendor — the AI Overviews click-through finding — we attribute it by name without a link rather than pass it off as ours or credit the blog that re-quoted it. Where an older figure was still in wide circulation — the "3.5 billion searches a day" number — we replaced it rather than repeating it.

Frequently asked questions

What is SEO and how does it work?

SEO is the practice of improving a website so search engines rank it higher in unpaid results. It works by aligning three things with how engines operate: content that matches what searchers want, technical health so crawlers can reach and render your pages, and external signals like links that indicate the site is worth surfacing.

What does SEO stand for?

SEO stands for search engine optimization. The name is slightly misleading — modern SEO optimizes for the searcher as much as the engine, because engines increasingly measure whether users were satisfied.

How do you do SEO as a beginner?

Verify Google Search Console, audit your site for technical failures, fix the basics (canonical tags, meta descriptions, mobile layout, page speed), then publish content targeting queries you can realistically compete for. Fix before you write — our audit of 20 well-run homepages found the median site still failing 13 rules, so foundational checks are rarely wasted effort.

Can you do SEO by yourself?

Yes, for a small site. On-page and content work need no specialist tools beyond free ones, and Search Console surfaces most technical issues without cost. You'll want help when the work becomes engineering-heavy (rendering, site migrations, international setups) or when link acquisition needs relationships you don't have.

What is an example of SEO?

A concrete one: a bakery notices Search Console shows impressions for "gluten free birthday cake" but no clicks, because its ranking page is a generic menu PDF. It publishes an HTML page for that specific product, adds Product structured data, compresses the images, and links to it from the homepage. Impressions convert to clicks. That whole sequence — query research, content, structured data, performance, internal linking — is SEO.

What is SEO in digital marketing?

Within digital marketing, SEO is the organic-acquisition channel. It sits alongside paid search, email, social, and affiliate. Its distinguishing features are compounding returns and a long lag: it costs more up front in labour and pays back over months rather than on the day you spend.

What is SEO in business?

For a business, SEO is a demand-capture function. It doesn't create demand the way brand advertising does; it makes sure that when demand already exists and someone searches, your business is the one they find. Reboot Online's roundup puts organic search at 53% of website traffic, which is why most businesses treat it as core rather than optional.

What is an SEO job?

SEO roles split roughly three ways: technical SEO (crawling, rendering, site health, often working alongside engineers), content SEO (research, briefs, editorial strategy), and off-page or digital PR (links, coverage, partnerships). Larger teams add analytics and local specialists. Most job listings blend two of these.

What is an SEO certification?

An SEO certification is a course completion credential, usually from a tool vendor or a training provider. Google offers free official documentation and a Search Console course but does not certify SEO practitioners. Certifications can structure your learning; they carry little weight in hiring compared with a portfolio of measurable results.

What are search engine optimization techniques?

The durable ones: keyword and intent research, on-page optimization (titles, headings, internal links), technical fixes (speed, mobile rendering, structured data, crawlability), content refreshes on pages that already rank, and earning links by publishing something citable. Techniques that manipulate signals rather than improve the site — link buying, keyword stuffing, doorway pages — carry penalty risk.

What is SEO in Instagram?

Instagram SEO is optimizing profiles and posts for Instagram's own search: keywords in your handle, name field, and bio, descriptive captions, alt text on images, and relevant hashtags. It shares the vocabulary of web SEO but not the mechanics — there's no crawler, no index you control, and no backlinks.

How does SEO work in finance?

Financial content sits squarely in what Google treats as "Your Money or Your Life" territory, where quality standards are stricter. Experience and expertise signals matter more than in most niches: named authors with verifiable credentials, cited primary sources, clear review dates, and transparent disclosures. The technical fundamentals are identical; the trust bar is higher.

What to do next

SEO is the ongoing work of making a site that search engines can reach, understand, and confidently recommend — and it's ongoing by nature, not by choice. Twenty of the best-resourced homepages on the web scored between 93 and 95, and every one of them failed rules a beginner could fix in an afternoon.

That's the encouraging part. The gap between you and a well-run site isn't a secret technique. It's a canonical tag, a meta description, a mobile layout that doesn't scroll sideways, and the discipline to check again next month.

Start by finding out where you stand. Run your own site through the same 251 checks and work down the list.