Duplicate content

Duplicate content is the same or very similar content at more than one URL. Why it is usually harmless, when it becomes a problem, and how to handle it.

Duplicate content is the same or very similar content available at more than one URL. On a single site it usually appears by accident: http and https versions, tracking parameters, sorting and filtering options, separate mobile pages, or a test copy of the site left open to crawlers.

Google says some duplicate content on a site is normal and not a violation of its spam policies. It groups duplicates, picks one URL as the canonical to show in results and crawls the others less often.

That doesn't make duplicates free. Google notes that the same content at many URLs can confuse people and makes it harder to track how your content performs. Telling Google which version you prefer also helps it consolidate signals, such as links, from the duplicate URLs into one. You can point Google to your preferred version with redirects, rel="canonical" link elements and consistent URLs in your sitemap and internal links.

Copying is a different matter. Google's spam policies treat scraping as spam, for example republishing content from other sites without adding original content or value.

Translations are not duplicates. Google says localized versions of a page count as duplicates only if the main content remains untranslated.

Related terms

Sources

  1. What is canonicalization
  2. How to specify a canonical URL with rel="canonical" and other methods
  3. Spam policies for Google web search
  4. Tell Google about localized versions of your page

All terms