How search works
How search engines workThe five steps from discovery to rankingComponentsThe parts that make a search engine runCrawlingHow bots find and fetch your pagesIndexingHow a page gets stored so it can be foundCheck if indexedFour ways to confirm a page is on GoogleCrawling and indexing
Web crawlersGooglebot, Bingbot and the new AI botsGooglebotHow Google's crawler reads your siteRobots.txtRules, examples and a free testerXML sitemapCreate one, then submit it to GoogleCanonical tagPick the main version of a pageNoindex tagKeep a page out of search resultsRanking and results
Search engine rankingWhy one page appears above anotherGoogle ranking factorsWhat really matters, grouped simplyPageRankHow links pass value between pagesAlgorithmsTF-IDF, PageRank and modern rankingResults page (SERP)What each block on the page is forAI searchHow AI answers are built from the indexUnderstand
What is a search engineA plain definition with real examplesTypes of search enginesCrawler, meta, vertical, private and AIBrowser vs search engineTwo tools that people often mix upExplore
Best search enginesGoogle, Bing, DuckDuckGo and moreUses of search enginesThe everyday jobs that search handlesHistory of search enginesFrom Archie in 1990 to AI answersThis how search engines work simulator sends a web page through discovery, crawling, rendering, indexing and ranking, then shows exactly where it stops. Break a page on purpose, read the reason, then learn the fix in plain words.
Choose a scenario such as an orphan page or a forgotten noindex tag, then press Run. The simulator follows the same order real search engines use, so it always stops at the first stage that fails.
Try it
Every run follows one sample page, a hiking boots guide, from the moment it goes live to the moment it appears on a results page.
Pick a ready-made scenario or flip the switches yourself, then press Run. The simulator stops at the first problem, exactly like a real search engine.
The result of each run appears here, with the reason a page stopped plus how to fix it.
Quick guide
Five short steps take you from a healthy page to a broken one, which is the fastest way to learn what each stage actually checks.
That last step is the key lesson of this search engine simulator. A page blocked at crawling never reaches indexing, so fixing a later problem first wastes time. Treat it as an interactive search engine demo of the real search engine workflow, then apply the same order when you check your own pages.
Read the result
Most real problems with crawling and indexing fall into one of these seven patterns. Each has a clear signal in Search Console.
| Scenario | Stage that fails | What to check first |
|---|---|---|
| Orphan page | Discover | Internal links pointing to the page, plus your XML sitemap |
| Blocked by robots.txt | Crawl | Disallow lines in yoursite.com/robots.txt |
| Broken URL (404) | Crawl | The live URL, any redirects, old links |
| JavaScript only | Render | The rendered HTML in the URL Inspection tool |
| noindex left on | Index | The meta robots tag or X-Robots-Tag header |
| Duplicate page | Index | Which URL Google chose as canonical |
| Weak answer | Rank | How well the page meets search intent versus the current top results |
Google’s own URL Inspection tool reports these same stages for any page you own, which makes it the natural next step after the simulator.
For teachers
The simulator works on phones, tablets or classroom screens. Copy the link below into a lesson page, slide or chat so students can open it straight away.
FAQ
The tool itself lives on this page, so the best option is a link using the code above. If you need something inside your own page, embed the free search engine diagram instead.
No. It uses a sample page to teach the order of the stages. To test a real URL you own, use the URL Inspection tool in Google Search Console.
Real search engines work in sequence. A page that cannot be crawled is never rendered or indexed, so later checks simply never happen.
The order is realistic, while the timing is shortened for teaching. On the live web, discovery to indexing can take anywhere from hours to weeks.
Keep learning
Finished the how search engines work simulator? These guides explain each stage you just watched in full detail.