Apify Actor Web Crawler

---
name: "Apify Actor Web Crawler"
slug: "apify-actor-web-crawler"
description: "Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale."
github_stars: 173
verification: "security_reviewed"
source: "https://github.com/apify/apify-sdk-js"
category: "Research & Scraping"
framework: "Claude Agents"
tool_ecosystem:
  github_repo: "apify/apify-sdk-js"
  github_stars: 173
  npm_package: "apify"
  npm_weekly_downloads: 34097
---

# Apify Actor Web Crawler

Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale.

## Installation

Use the upstream install or setup path that matches your environment:
- npm install apify

Requirements and caveats from upstream:
- Apify SDK requires [Node.js](https://nodejs.org/en/) 16 or later. Add Apify SDK to any Node.js project by running:

Basic usage or getting-started notes:
- This short tutorial will set you up to start using Apify SDK in a minute or two.
- If you want to learn more, proceed to the [Apify Platform](https://docs.apify.com/sdk/js/docs/concepts/actor-lifecycle)
- guide that will take you step by step through running your Actor on Apify's platform.

- Source: https://github.com/apify/apify-sdk-js
- Extracted from upstream docs: https://raw.githubusercontent.com/apify/apify-sdk-js/HEAD/README.md

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/apify-actor-web-crawler/)