Indexing

Indexing is the stage in which Google analyzes a crawled page and may add it to its index. Only indexed pages can appear in Google search results.

Indexing is the stage of Google Search that comes after crawling. Google analyzes the page it fetched, including the text, key tags such as the title element and alt attributes, images and videos, and decides whether to store it in the Google index, a large database of pages. Only an indexed page can appear in search results.

During indexing Google also deals with duplicates. It groups pages with similar content and picks the most representative one, the canonical, as the version that may be shown in results.

Indexing isn't guaranteed. Google's guide to how Search works says not every page it processes will be indexed, and names low-quality content, robots rules that block indexing and hard-to-index site designs as common reasons.

You can check a page with the URL Inspection tool in Search Console, which shows whether a URL is indexed and lets you request indexing. To keep a page out of the index, use a noindex rule. Blocking the page in robots.txt is not enough, because Google can't see a noindex rule on a page it isn't allowed to crawl.

Related terms

Sources

  1. In-depth guide to how Google Search works
  2. URL Inspection tool
  3. Block Search indexing with noindex

All terms