Crawlee Web Crawling And Scraping Sdk

Name: Crawlee Web Crawling And Scraping Sdk
Author: agentskillexchange

ASecurity

Crawlee is Apify's open source web crawling and scraping library for Node.js. It combines request queueing, browser automation, proxy support, and storage primitives so agents can build reliable Playwright, Puppeteer, Cheerio, or HTTP crawlers from one toolkit.

36 stars
0 votes
0 copies
2 views
Added June 8, 2026

ai-agentsjavascriptpythongojavanodedockergitapisecuritydocumentation

Works with

Security analysis

A92/100

mediumInstalls packages at runtime which could introduce malicious dependencies

Pro shows the line behind each finding and how to fix it

Scanned June 8, 2026

npx -y skills add agentskillexchange/skills --skill crawlee-web-crawling-and-scraping-sdk --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Crawlee Web Crawling And Scraping Sdk?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Crawlee Web Crawling And Scraping Sdk

[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/agentskillexchange-crawlee-web-crawling-and-scraping-sdk/badge)](https://www.skillsdirectory.com/skills/agentskillexchange-crawlee-web-crawling-and-scraping-sdk)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro

SKILL.md

---
name: "Crawlee Web Crawling and Scraping SDK"
slug: "crawlee-web-crawling-and-scraping-sdk"
description: "Crawlee is Apify's open source web crawling and scraping library for Node.js. It combines request queueing, browser automation, proxy support, and storage primitives so agents can build reliable Playwright, Puppeteer, Cheerio, or HTTP crawlers from one toolkit."
github_stars: 22762
verification: "security_reviewed"
source: "https://github.com/apify/crawlee"
author: "apify"
publisher_type: "Company"
category: "Research & Scraping"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "apify/crawlee"
  github_stars: 22762
  npm_package: "crawlee"
  npm_weekly_downloads: 80765
---

# Crawlee Web Crawling and Scraping SDK

Crawlee is Apify's open source web crawling and scraping library for Node.js. It combines request queueing, browser automation, proxy support, and storage primitives so agents can build reliable Playwright, Puppeteer, Cheerio, or HTTP crawlers from one toolkit.

## Prerequisites

node.js, npm, bun, python, docker, java

## Installation

Use the upstream install or setup path that matches your environment:
- npx crawlee create my-crawler
- npm start
- npm install crawlee playwright
- npm install crawlee@next

Requirements and caveats from upstream:
- Do you prefer 🐍 Python instead of JavaScript? [👉 Checkout Crawlee for Python 👈](https://github.com/apify/crawlee-python).
- Crawlee requires **Node.js 16 or higher**.

Basic usage or getting-started notes:
- We recommend visiting the [Introduction tutorial](https://crawlee.dev/js/docs/introduction) in Crawlee documentation for more information.
- ### With Crawlee CLI
- The fastest way to try Crawlee out is to use the **Crawlee CLI** and choose the **Getting started example**. The CLI will install all the necessary dependencies and add boilerplate code for you to play with.

- Source: https://github.com/apify/crawlee
- Extracted from upstream docs: https://raw.githubusercontent.com/apify/crawlee/HEAD/README.md

## Documentation

- https://crawlee.dev/js/docs/guides/configuration

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawlee-web-crawling-and-scraping-sdk/)