Searchlab XML Sitemaps: What to Include, and What to Leave Out
A sitemap is a list of the URLs you want Google to crawl. It does not force indexing, but a focused sitemap is a strong signal about which pages matter, and a bloated one actively confuses that signal.
What belongs in a sitemap
- Canonical URLs only, one per page.
- Pages that return 200 and are genuinely indexable.
- Your commercially and editorially important pages.
- An accurate
lastmoddate. Google does use it, so do not fake it by stamping today on everything.
What to leave out
- Parameter URLs such as
?lang=,?sort=or session IDs. These are the fastest way to bloat a sitemap with duplicates. - Noindexed pages. Listing a page you have told Google to ignore is a contradictory signal.
- Redirects and 404s. They waste crawl budget.
- Non-canonical duplicates.
- Thin or utility pages like internal search results and empty tag archives.
Focus beats completeness on a young site
If a large share of your pages sit at "Discovered - currently not indexed", listing even more URLs will not help. Google is already choosing not to spend crawl budget on them. Trimming the sitemap to your strongest pages concentrates that budget where it can actually produce results, then you expand as authority grows.
Important: removing a URL from the sitemap is not the same as blocking or deleting it. The page stays live and reachable through internal links. You are adjusting a hint about priority, nothing more. Never use robots.txt to "clean up" a sitemap, since blocking a URL prevents Google from seeing a noindex tag on it.