011 min
Why SEO matters
A page can be accurate, well designed and useful, and still get no visits from search. Google says its search works in three stages, and not all pages make it through each stage. A page that search engines cannot reach or store in their database is never shown to anyone, whatever its quality.
Organic search is the part of a results page that is not advertising. Google never accepts money to include or rank sites in its search results, and it costs nothing to appear in its organic results. A paid ad stops sending visitors when the budget stops. A page that ranks in organic results keeps sending visitors until a better page replaces it.
That is why the decision belongs to founders and product managers, not only to marketers. Someone has to decide whether the company pays for visitors with ad budget, or pays with the work of making pages that search engines can find and users choose. SEO is the second choice. It is slower to start and cheaper to keep running, and it can fail in ways that are invisible until someone checks.
022 min
How search engines find and rank pages
Google describes three stages. The same model fits other search engines, and each stage is a place where a page can be lost.
- Crawling. Programs called crawlers download text, images and videos from pages they have found. Crawling depends on access. Server problems, network issues and robots.txt rules (a file that tells crawlers which URLs not to fetch) can all stop it.
- Indexing. Google analyses the page and stores what it learns in the index, a large database. Indexing is not guaranteed. Low content quality, or a robots meta rule that disallows indexing, can keep a page out.
- Serving. When a person searches, Google returns the stored pages most relevant to the query and ranks them. Google says ranking is done programmatically, by software, not by hand.
SEO work targets each stage. The table shows what goes wrong and what the work looks like.
| Stage | What can go wrong | SEO work |
|---|---|---|
| Crawling | The crawler cannot reach the page or its CSS and JavaScript | Fix robots.txt rules, server errors and blocked resources |
| Indexing | The page is thin, duplicated or marked noindex | Improve the content, remove accidental noindex rules |
| Serving | The page is indexed but a better match for the query sits above it | Match the query's intent, improve content and speed, earn links |
Ranking is the part nobody outside Google can see in full. Google states that its automated ranking systems are designed to prioritise helpful, reliable information created to benefit people, not content created to manipulate rankings. So the stable approach is to work on the first two stages with technical care, and on the third stage with content that answers what the searcher wanted. A page that matches search intent has a better chance than a page that only repeats the keyword.
031 min
Where SEO comes from
The phrase "search engine optimization" came into use in 1997, according to a 2004 article by the analyst Danny Sullivan, and Sullivan credits the practitioner Bruce Clay as one of the first people to popularise it. The word optimisation is British spelling, and both spellings name the same work.
Early search engines gave extra weight to some HTML elements, such as meta tags, and site owners could set those elements to win visibility. Providers then began adjusting their algorithms to stop that. This is the reason SEO has two sides: work that helps a search engine understand a page, and work that tries to fool it.
In 1998 Sergey Brin and Larry Page described Google as a search engine that makes heavy use of the structure of hypertext, and they extended the counting of backlinks into PageRank, which does not count links from all pages equally. A backlink is a link from another page to yours. The 1998 paper also explains why link text matters: it says anchor text, the visible words of a link, can help provide better quality results. These two ideas, that a link points to a page worth reading and that link text describes it, are the basis of most link-related SEO advice. The paper describes a university prototype, not today's ranking systems.
042 min
What SEO work covers
SEO work falls into three groups: technical access, content, and links from other sites. Google describes SEO as helping search engines understand your content and helping users find your site and decide whether to visit it. The three groups map to the three stages above.
| Group | The question it answers | Typical actions |
|---|---|---|
| Technical access | Can crawlers fetch and read the page as a user sees it? | Fast server, no blocked CSS or JavaScript, a sitemap (a file listing the URLs you want found), clean redirects |
| Content | Does the page answer what the searcher came for? | One page per query intent, clear title and headings, original information, a named author |
| Links | Do other sites point to this page? | Publish something worth citing, promote it, earn mentions |
Google adds a point about links. It says it primarily finds pages through links from other pages it already crawled, and that other sites linking to you happens naturally over time. So links work twice. They help a crawler discover a page, and they are a signal about how the page is regarded.
SEO is not the same as hiding a site from users or filling a page with keywords. It is also not a one-time setup. Search engines change their systems, competitors publish new pages and the questions people type change. The work is a cycle of publishing, checking and adjusting.
052 min
Example: Google's Panda quality update
On 6 May 2011 the Google engineer Amit Singhal wrote that Panda, a ranking change that tries to assess the quality of whole sites, was one of roughly 500 search improvements Google expected to release that year. Google had launched Panda in early 2011 to reduce the rankings of low-quality content. This post was Google's guidance to publishers who saw their traffic fall afterwards.
Singhal also wrote that some publishers had incorrectly assumed that changes in their rankings were related to Panda, when Google had rolled out over a dozen other ranking tweaks since Panda launched. The practical point is that a drop in rankings has more than one possible cause. A team that blames the one famous update can miss the change that actually affected it.
He wrote that low-quality content on some parts of a website can affect the rankings of the whole site, so removing or merging shallow pages could eventually help the higher-quality content. This is a site-level effect. A single weak page is not only a weak page. It can lower the standing of the strong pages beside it.
Google did not publish the actual ranking signals, but it did publish a list of questions that it said reflect how its engineers assess page quality. The list includes these questions:
- Does the article provide original content or information, original reporting, original research, or original analysis?
- Does the site have duplicate, overlapping, or redundant articles on the same or similar topics with slightly different keyword variations?
- Are the topics driven by genuine interests of readers of the site, or does the site generate content by attempting to guess what might rank well in search engines?
The third question describes the habit that a keyword-first approach to SEO can produce: writing the page because a phrase has traffic, not because a reader needs it. Google's later spam policies, covered below, name a related practice outright.
062 min
How SEO shows up in a product team
Each role makes different decisions that change what search engines see.
Founder or product manager
Choose the queries a page should win, and decide what the searcher wants when they type it. A person who types a symptom is at a different stage of awareness than a person who types a product name, so one page rarely serves both. Levels of awareness describes that difference. The decision is which audience gets which page. SEO is also a distribution channel with its own cost and delay, so it belongs in the same planning as paid ads and referrals.
Engineer
Make sure crawlers see what users see. Google warns that if your site hides important components such as CSS and JavaScript, Google might not be able to understand your pages. The decisions are what robots.txt blocks, whether important text is rendered in the HTML a crawler receives or only after scripts run, and how fast the page loads. Google's URL Inspection tool in Search Console shows how Google sees a page.
Designer
Layout choices affect search through page experience. Core Web Vitals include Cumulative Layout Shift, which measures visual stability, and Google says to aim for a score below 0.1. Reserving space for images and ads is a design decision that moves this number. Title wording and heading structure are also design work, because they appear in the results page and tell the searcher whether to click. A clear, scannable layout supports readability, and a visible call to action decides what happens after the click.
Say a product manager plans a help-centre article for a symptom. The engineer finds that the article text loads only after a script runs. The designer finds that a cookie banner shifts the page when it appears. All three problems come from different roles and all three reduce what search can use.
072 min
How to do SEO in order
This order follows the stages Google documents in How Search Works. Each step depends on the one before it. It is not an independent list of tactics.
Check that the page is indexed.
Search Google for
site:yourdomain.com. If your pages appear, they are in the index. If they do not, nothing below matters until you fix access.Name the query and its intent for each page.
Search the exact query and read the top results to see what searchers are given. Content written before this step is often the wrong type of page.
Write the page for that intent.
Answer the question directly, add original information and show who wrote it. Google suggests asking who created the content, how it was created and why it exists.
Make the page clear to a crawler and a user.
Give it a descriptive title, a heading structure that matches the content, and a loading time inside the Core Web Vitals limits.
Let other sites find it.
Google finds most pages through links from pages it already knows. Promote the page where its audience reads.
Measure, wait, then change one thing.
Every change takes time to show in Google results. Some changes take effect in a few hours and others can take several months, so Google suggests waiting a few weeks before judging whether a change helped.
Step 3 only works once step 2 is done, because the same words can ask for a guide, a comparison or a product page. Step 5 only helps once step 1 is true, because a link to a page that cannot be indexed adds nothing.
082 min
How to measure SEO
The free source is Google Search Console, which reports how a site appears in Google results. Search Console's Performance report counts the topmost position a link to your site holds for each query and averages those positions across queries. For example, if a page shows at positions 2, 4 and 6 for one query, that query counts as position 2.
Read the report as four numbers together: impressions (times a result was shown), clicks, the share of impressions that became clicks, and average position. A page can gain impressions and lose clicks if its title no longer matches what searchers want.
Core Web Vitals give a measurable target for speed and stability. Google says a good Largest Contentful Paint is within 2.5 seconds of the page starting to load. It also sets a target of an Interaction to Next Paint below 200 milliseconds, and a Cumulative Layout Shift below 0.1.
Third-party tools estimate rankings and traffic. Google notes that such tools do not have access to its internal ranking data, so treat their numbers as estimates and check them against Search Console.
Unlike an A/B test, a change to a search page has no control group running at the same time. All searchers see the same indexed page, so you compare periods before and after. That is why changing one thing at a time matters, and why waiting a few weeks before judging a change matters.
092 min
Common SEO mistakes
Each mistake starts with a wrong assumption.
- "Someone can guarantee us first place." No one can guarantee a #1 ranking on Google. Google advises people hiring an SEO to be wary of anyone who guarantees rankings or claims a special relationship with Google. Google's own starter guide says there are no secrets that automatically rank a site first.
- "Links can be bought." Link spam is the practice of creating links to or from a site primarily for the purpose of manipulating search rankings, and buying or selling links for ranking purposes is one of Google's examples. Google treats this as spam. A site found doing it can lose rankings.
- "More pages mean more traffic." Scaled content abuse is when many pages are generated for the primary purpose of manipulating search rankings and not helping users, no matter how the pages are created. Publishing hundreds of thin pages is the pattern this policy describes.
- "We can show the crawler a better page." Cloaking is showing different content to users and to search engines with the intent to manipulate search rankings. Google's example is a page about travel destinations shown to the crawler and a page about discount drugs shown to users.
- "A checklist is the strategy." A list of tactics describes what to do on a page. It does not say which query to win or what the searcher wants. Teams that complete every item and still get no visits usually skipped the intent step.
The popular version of SEO also overstates what is known. Google publishes guidance and ranking-system descriptions, not the full formula. Advice that claims to name exact ranking weights is a guess.
101 min
SEO vs. nearby concepts
The question that separates SEO from its neighbours is who pays for the position and when.
| Term | What it is | Is the position paid for? |
|---|---|---|
| SEO | Work on a site so it appears in organic results | No. Google says it costs nothing to appear |
| SEM (search engine marketing) | Usually paid search advertising, where you pay per click for an ad position | Yes, for each click |
| Content marketing | Creating articles, videos and guides to attract an audience through any channel | Not applicable. It can use SEO, email or social |
| Search intent | The goal behind a query | Not applicable. It is an input to SEO |
SEO and content marketing overlap but are not the same. A company can run content marketing with no SEO by sending articles to a newsletter, and it can run SEO on pages that are not content marketing, such as product documentation.
112 min
SEO questions
How long does SEO take to work?
Some changes show in a few hours and others take several months. Google suggests waiting a few weeks before judging a change. Pages that were never indexed need the access problem fixed first.
Is SEO free?
Appearing in Google's organic results costs nothing, and Google does not accept payment to rank sites. The work still costs time, writing, engineering and sometimes an agency or tools.
Do I need to hire an SEO?
Not always. Google says a small local business can probably do much of the work itself. Hire help when the problem is technical or large, check references, and do not accept a guarantee of first place.
Can I pay Google to rank higher organically?
No. Google says it does not accept payment to crawl a site more often or to rank it higher. Paid ads are a separate product and appear in their own positions.
What is a good first step in SEO?
Check that your pages are indexed by searching Google for site: followed by your domain. If your pages appear, move to matching each page to a query and its intent. If not, fix access first.
What is the difference between SEO and SEM?
SEO earns organic positions through site work and costs no per-click fee. SEM usually means paid search ads, where you pay per click. The deciding difference is whether the position is bought.
When should you not invest in SEO?
When the page should not be found, such as a private account area, or when nobody searches for what you offer yet. In that case a different channel, such as referrals or outbound contact, may reach buyers sooner.
?7 questions
Questions people ask
How long does SEO take to work?
Is SEO free?
Do I need to hire an SEO?
Can I pay Google to rank higher organically?
What is a good first step in SEO?
What is the difference between SEO and SEM?
When should you not invest in SEO?
▶3 videos
Watch
Understanding Search Engine Optimisation (SEO)
Digital Marketing and E Commerce Unit 2, SEO, search engine optimization, on page seo, off page seo
DWIVEDI GUIDANCE
How Search Engine Works? Crawling, Indexing, and Ranking - Complete Explanation
WsCube Tech
§10 sources
Sources
Show all 10 sourcesHide sources
Google Search Central. Search Engine Optimization (SEO) Starter Guide. Accessed 2026-10-04.
Google Search Central. In-Depth Guide to How Google Search Works. Updated 2025-12-18.
Google Search Central. Do You Need an SEO? Tips for Hiring an SEO. Accessed 2026-10-04.
Google Search Central. Spam Policies for Google Web Search. Accessed 2026-10-04.
Google Search Central. Creating Helpful, Reliable, People-First Content. Accessed 2026-10-04.
Google Search Central. Understanding Core Web Vitals and Google Search Results. Accessed 2026-10-04.
Google Search Console Help. Performance report (Search). Accessed 2026-10-04.
Singhal, A. (6 May 2011). More guidance on building high-quality sites. Google Search Central Blog.
Brin, S. and Page, L. (1998). The Anatomy of a Large-Scale Hypertextual Web Search Engine. Computer Networks and ISDN Systems 30. Stanford HTML copy.
Wikipedia. Search engine optimization. A summary that cites Danny Sullivan (2004), "Who Invented the Term Search Engine Optimization?".





