Skip to content
Back to skills

Crawl Docs Skill

ASecurity

Run a Crawl4AI-based doc crawler and save internal pages as Markdown using page titles as filenames. Use when the user provides a docs URL and wants all internal subpages saved as .md files. Environment setup should only use uv.

  • 57 stars
  • 0 votes
  • 0 copies
  • 0 views
  • Added October 17, 2026
toolsbash

Security analysis

A100/100

Scanned October 17, 2026

npx -y skills add diegosouzapw/awesome-omni-skill --skill crawl-docs-skill --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Crawl Docs Skill?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Crawl Docs Skill
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/diegosouzapw-crawl-docs-skill/badge)](https://www.skillsdirectory.com/skills/diegosouzapw-crawl-docs-skill)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: crawl-docs-skill
description: "Run a Crawl4AI-based doc crawler and save internal pages as Markdown using page titles as filenames. Use when the user provides a docs URL and wants all internal subpages saved as .md files. Environment setup should only use uv."
---

# Crawl Docs Skill

## One-shot (Direct Run)

- Run directly: `bash "<path-to-skill>/scripts/crawl_docs.sh" <URL> --out "$PWD/docs"`
- Do NOT install dependencies or scaffold files first; run immediately. The script will bootstrap uv + venv only if needed.
- Do NOT run tests or create plans; just execute the script and let it fail if the system is missing prerequisites (e.g. curl).
- Default output dir (skill convention): `"$PWD/docs"` (absolute path to `./docs` under the current working directory); always pass it via `--out` unless the user specifies otherwise.
- Optional flags: `--out <dir>`, `--max-pages <int>`

## Correct Usage (from real run)

- First run: execute the one-shot command exactly once with no extra steps.
- If it fails: fix the missing system prerequisite (most commonly `curl`) and re-run the same command.
- Do not probe versions or add max-pages unless the user asks.

## Notes

- Use page title (tab name) as the output filename; auto-deduplicate with numeric suffixes.
- Default behavior has no max pages unless `--max-pages` is provided.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.