Let’s talk
Field notes / practical guide

XML sitemap and robots checklist

Robots controls and XML sitemaps serve different purposes. Review them together with indexing directives and actual page availability.

Choose what belongs in search

Identify approved public pages with useful content and a clear canonical URL. Keep draft, duplicate and private material out of the public sitemap. Do not treat sitemap inclusion as a guarantee that a page will be indexed.

From a supplied report

Sitemap processing status

The submitted sitemap’s processing result and discovered-page count.

Google Search Console · Supplied report

Check access separately

Review robots.txt for crawl restrictions and page-level directives for indexing instructions. A blocked page may prevent a crawler from seeing its noindex directive. Sensitive information needs access control, not just a crawl instruction.

Verify the generated output

Check that sitemap URLs resolve correctly and match the intended domain. Remove old preview hosts and redirected destinations. After launch, use available search reports to investigate discovery or indexing issues rather than repeatedly resubmitting an unchanged file.

Put the guidance to work

Capture your starting point, assign an owner to the next action, and decide what evidence will confirm that it worked.

Discuss this with us