Sitemaps and Robots.txt — Study Resources & PYQs
Curated resources, past papers and PYQs for Sitemaps and Robots.txt.
Study resources
- XML Sitemaps: Everything You Need to Know (Article) — Ahrefs' widely-referenced guide to XML sitemaps and robots.txt.
- Sitemaps and Robots.txt Explained (Video) — Covers guiding search engine crawlers with sitemaps and robots.txt.