Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
Scanned 9/3/2026
Install to Claude Code
npx -y skills add aiskillstore/marketplace --skill robots-sitemap-validator --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Robots Sitemap Validator?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/aiskillstore-robots-sitemap-validator)More formats (shields.io, HTML) on the badges page.
---
name: robots-sitemap-validator
description: Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
metadata:
author: JustHandled Labs
version: 1.0.0
price: $0
credits: 0
triggers:
- check my robots.txt
- validate my sitemap
- is my site crawlable
---
# Robots Sitemap Validator
Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.
## Workflow
1. Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
2. Review findings by rule id, severity, file, and line.
3. Treat missing sibling sitemap files as review flags when robots.txt references them.
## Guardrails
- Read local files or stdin only.
- Do not fetch live URLs or submit sitemaps.
- Do not modify robots.txt or sitemap files.
## Verification
Run tests/test_robots_sitemap.py. Risky fixture must produce findings and clean fixture must produce zero findings.
## Commercial Terms
Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!