Library·SOP·SEO

Choose between noindex, canonical URLs, redirects, and robots.txt

Choose the right setting for how Google visits and lists a WordPress page, then follow the matching guide.

Last reviewed: · Editorial review

Clarity, structure and references reviewed in this version. This is not a test in a live account.

SOP 065 · 15 min
SOPFree

Choose between noindex, canonical URLs, redirects, and robots.txt

SOP 065 · 15 min

Choose the right setting for how Google visits and lists a WordPress page, then follow the matching guide.

Scope

This SOP covers:

This does not cover:

Requirements

01. Start with what visitors need

Decide whether the page should be public and useful before choosing an SEO control. A setting that changes Search does not keep unauthorized people out of the page.

  1. First decide who should be able to read the page. If anyone without permission must not see its contents, the page needs access control, such as a login or password, or the content must be removed. Do not rely on noindex, robots.txt, a canonical URL, or a redirect for privacy: those settings do not stop a person with the page address from opening public content.

    • Warning: Noindex can keep a public page out of Google Search after Google processes the rule, but anyone with the URL can still visit it. Robots.txt is a publicly readable crawl guide, not a secret or a lock.
    • Resource: Google Search Central: Control the content you share on Search (Compare search exclusion with password protection for private content.)
  2. If you are choosing a method because a Google Search Console message surprised you, confirm the current evidence before changing a setting. For one URL, inspect that page. For several URLs grouped under a report reason, review the report first. A report label alone does not prove that the page should be excluded or changed.

    1. Follow the linked guide when one page's indexing or selected canonical URL is uncertain.

    2. Follow the linked guide when several pages share an indexing report reason or you do not know which affected pages matter.

02. Match the page's situation to one control

Ask what should happen to the original URL and what Google needs to do. Choose one clear result; the examples below show when no change is the right answer.

  1. Match the page to the situation that best describes it. If none fits cleanly, leave the controls alone until the site owner can confirm the goal and the destination.

    1. Keep as-is. Make no setting change when the page is public, useful, distinct, and meant to be found in search. For example, keep a current plumbing-service page unchanged when it is the one complete page for that service. If its canonical field points back to that page’s own URL (a self-canonical), leave it alone; that is normal.

    2. Keep public but out of search. Choose noindex when people should still be able to visit a public page, but it should not appear in search results. For example, a public form thank-you page may need to load after a successful submission without being a search landing page. Keep Google allowed to visit and read the page so it can see the noindex rule; do not block that page in robots.txt. Google must recrawl and process the page, so this is not an immediate removal guarantee.

    3. Similar pages. Choose a canonical URL when two same-site pages contain the same or very similar main content, both URLs should keep loading, and you prefer one version in search. For example, a print-friendly copy with nearly the same main text and sections as the full guide can point to the full guide. The preferred page must be a suitable, live version that can appear in search. If each page has its own useful content, keep the default canonicals that point to each page's own URL. A canonical tells Google which URL you prefer; Google may choose another. It does not redirect visitors from the duplicate URL.

    4. Moved permanently. A 301 is a permanent redirect that sends visitors from the old URL to a replacement. Choose one when the old URL has moved for good, should not return, and a live replacement serves the old page's purpose. For example, send a retired size guide to its replacement size guide. If the move is temporary, ask the site owner for a temporary redirect instead. If there is no relevant replacement, leave the old URL showing a not-found or removed page and repair links you control; do not redirect it to the homepage just to hide the error.

    5. Manage crawler visits. Choose robots.txt only when your goal is to manage which public URL paths or resources search engines try to visit, such as a large set of low-value filter combinations.

      Before following the linked procedure, ask the site owner to confirm the exact public URL path or resource to manage, such as /filter/. If the owner cannot confirm it, do not guess; leave the rule unchanged until they can.

      robots.txt manages visits, not privacy or reliable removal from search. Google may still show a blocked URL if it learns the address elsewhere. Do not block a page that Google needs to read to see its noindex rule.

03. Send the choice to the right procedure

Once the result is clear, use the procedure for the installed SEO plugin or the existing redirect or robots.txt tool. These linked guides contain the setup, live-output check, and safe undo steps.

  1. If noindex is the right result, open this page in the WordPress editor and look at its SEO panel. Use the noindex guide whose provider name matches the panel: Rank Math, Yoast SEO, All in One SEO, or SEOPress. Follow only one guide for this page. If the panel is missing, more than one panel appears to control the setting, or you cannot tell which one is in control, ask the WordPress owner before changing anything.

    1. If Rank Math controls the page's SEO settings, follow this guide.

    2. If Yoast SEO controls the page's SEO settings, follow this guide.

    3. If All in One SEO controls the page's SEO settings, follow this guide.

    4. If SEOPress controls the page's SEO settings, follow this guide.

  2. If a canonical URL is the right result, open the duplicate page in the WordPress editor and look at its SEO panel. Use the canonical guide whose provider name matches the panel: Rank Math, Yoast SEO, All in One SEO, or SEOPress. Follow only one guide for this page. If the panel is missing, more than one panel appears to control the setting, or you cannot tell which one is in control, ask the WordPress owner before changing anything.

    1. If Rank Math controls the page's SEO settings, follow this guide.

    2. If Yoast SEO controls the page's SEO settings, follow this guide.

    3. If All in One SEO controls the page's SEO settings, follow this guide.

    4. If SEOPress controls the page's SEO settings, follow this guide.

  3. For a permanent move or a confirmed crawl-management need, use the existing procedure that matches the result. It covers the actual rule, public readback, and rollback.

    1. For one URL that moved permanently to a relevant replacement, follow this guide.

    2. For a specific, justified crawler-access change managed in Rank Math, follow this guide.

  4. Write one short decision note in the existing Technical SEO action-plan row or page task. Include:

    • The exact page or public path, and what visitors should experience.
    • The selected control or No setting change, and why it fits.
    • The exact next procedure name or slug.
    • The preferred URL or replacement URL for a canonical or redirect.

    If you leave the page as-is, write No setting change in the Next procedure field too. If your team has no existing action-plan row or page task, send the same note to the WordPress owner so they can assign and track it; do not create a worksheet for one page.

    If the page must be private, write No setting change for the search control. Record who will set up access control and what task they will do.

    • Warning: If you cannot confirm the intended destination, ask the WordPress owner before editing.