How search works
How search engines workThe five steps from discovery to rankingComponentsThe parts that make a search engine runCrawlingHow bots find and fetch your pagesIndexingHow a page gets stored so it can be foundCheck if indexedFour ways to confirm a page is on GoogleCrawling and indexing
Web crawlersGooglebot, Bingbot and the new AI botsGooglebotHow Google's crawler reads your siteRobots.txtRules, examples and a free testerXML sitemapCreate one, then submit it to GoogleCanonical tagPick the main version of a pageNoindex tagKeep a page out of search resultsRanking and results
Search engine rankingWhy one page appears above anotherGoogle ranking factorsWhat really matters, grouped simplyPageRankHow links pass value between pagesAlgorithmsTF-IDF, PageRank and modern rankingResults page (SERP)What each block on the page is forAI searchHow AI answers are built from the indexUnderstand
What is a search engineA plain definition with real examplesTypes of search enginesCrawler, meta, vertical, private and AIBrowser vs search engineTwo tools that people often mix upExplore
Best search enginesGoogle, Bing, DuckDuckGo and moreUses of search enginesThe everyday jobs that search handlesHistory of search enginesFrom Archie in 1990 to AI answersEvery guide on Search Engine Basics is written by a person who works with search engines every day. Here you can see who writes the guides, what background they bring and where to read more of their work.
The team
Search Engine Basics is a small, independent project, so for now one author researches, writes and updates every guide on the site.

I’m Usman Ali, a growth and SEO specialist with 7 years of experience helping websites get found. I write every guide on Search Engine Basics by starting with how real search engines behave, then checking each claim against Google and Bing documentation.
Read Usman’s profile →How we write
Whoever writes for the site in future will follow the same few rules that shape every guide today.
You can read the full standards in our editorial policy, or learn more about the site and why it exists. To suggest a topic or report an error, please get in touch.