Skip to content

Glossary · Technical

Definition

An XML sitemap is a machine-readable file listing the URLs on a website that you want search engines to discover and index, optionally with the date each one last changed. It helps crawlers find pages they might miss through links, but listing a URL is a suggestion, and search engines still decide what to index.

  • Also: sitemap.xml
  • Also: sitemap
  • Also: Google sitemap
  • Also: sitemap index

How XML sitemap works

The sitemap protocol is shared by Google, Bing and other engines. One file can hold up to 50,000 URLs or 50 MB uncompressed; larger sites use a sitemap index pointing to several files, often split by type such as products, articles and locations. You tell engines where it lives with a Sitemap line in robots.txt and by submitting it in Google Search Console and Bing Webmaster Tools. Extensions exist for images, video, news and hreflang alternates.

Google has said it ignores the priority and changefreq fields and uses lastmod only when it is consistently accurate. Setting every lastmod to today's date on each build is a common habit that teaches engines to distrust the field. The file should reflect reality: canonical, indexable URLs that return a 200 status.

Misconceptions run both ways. Some owners believe a sitemap guarantees indexing; it does not, because quality and internal links still decide. Others think a small, well-linked site gains nothing from one, yet it still gives engines a clean list and a reliable signal of new content. The most damaging mistake is a sitemap full of redirected, noindexed or non-canonical URLs.

How to improve it

  1. 01Generate the sitemap automatically from your CMS or framework so new pages are added and removed pages drop out.
  2. 02Include only canonical, indexable URLs that return a 200 status.
  3. 03Update lastmod only when the content meaningfully changes.
  4. 04Split large sites into several sitemaps by section under a sitemap index.
  5. 05Reference the sitemap in robots.txt and submit it in Google Search Console and Bing Webmaster Tools.
  6. 06Review submitted URLs that are not indexed and look for patterns by section or template.
An example

A fictional recruitment agency's sitemap still lists hundreds of expired job URLs that now redirect to the jobs index. It switches to a sitemap generated from live vacancies only, with lastmod tied to each listing's real update time, and puts jobs, sector guides and service pages in separate files so problems in one section are easy to spot.

Questions

Questions about XML sitemap

Still unsure? Ask the team or write to support@deylaxy.com.

Does every website need an XML sitemap?

Most websites benefit from one, including small ones. Google says sitemaps are especially useful for large sites, new sites with few external links, and sites whose pages are not well linked internally. For a small, well-linked site it matters less, but an automatically generated sitemap costs almost nothing to maintain and gives you sitemap reports in Search Console that help diagnose pages submitted but not indexed.

What is the difference between an XML sitemap and an HTML sitemap?

An XML sitemap is written for search engines: a structured file of URLs and optional dates that crawlers read. An HTML sitemap is an ordinary web page of links for people, which also passes internal links to the pages it lists. They serve different audiences. Most sites need the XML version, while an HTML sitemap is optional and mainly useful on large sites with deep navigation.

Related

Related terms

Get your free Visibility Intelligence Audit

A concise reading of verified signals across search engines and AI answers, enough to recognise the gaps, not a playbook for competitors.