Crawlee Web Crawling And Scraping Sdk

---
name: "Crawlee Web Crawling and Scraping SDK"
slug: "crawlee-web-crawling-and-scraping-sdk"
description: "Crawlee is Apify's open source web crawling and scraping library for Node.js. It combines request queueing, browser automation, proxy support, and storage primitives so agents can build reliable Playwright, Puppeteer, Cheerio, or HTTP crawlers from one toolkit."
github_stars: 22762
verification: "security_reviewed"
source: "https://github.com/apify/crawlee"
author: "apify"
publisher_type: "Company"
category: "Research & Scraping"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "apify/crawlee"
  github_stars: 22762
  npm_package: "crawlee"
  npm_weekly_downloads: 80765
---

# Crawlee Web Crawling and Scraping SDK

Crawlee is Apify's open source web crawling and scraping library for Node.js. It combines request queueing, browser automation, proxy support, and storage primitives so agents can build reliable Playwright, Puppeteer, Cheerio, or HTTP crawlers from one toolkit.

## Prerequisites

node.js, npm, bun, python, docker, java

## Installation

Use the upstream install or setup path that matches your environment:
- npx crawlee create my-crawler
- npm start
- npm install crawlee playwright
- npm install crawlee@next

Requirements and caveats from upstream:
- Do you prefer 🐍 Python instead of JavaScript? [👉 Checkout Crawlee for Python 👈](https://github.com/apify/crawlee-python).
- Crawlee requires **Node.js 16 or higher**.

Basic usage or getting-started notes:
- We recommend visiting the [Introduction tutorial](https://crawlee.dev/js/docs/introduction) in Crawlee documentation for more information.
- ### With Crawlee CLI
- The fastest way to try Crawlee out is to use the **Crawlee CLI** and choose the **Getting started example**. The CLI will install all the necessary dependencies and add boilerplate code for you to play with.

- Source: https://github.com/apify/crawlee
- Extracted from upstream docs: https://raw.githubusercontent.com/apify/crawlee/HEAD/README.md

## Documentation

- https://crawlee.dev/js/docs/guides/configuration

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawlee-web-crawling-and-scraping-sdk/)