Back to skills
SKILL.md
Context Scrapers
ASecurityWeb scraping spiders (Scrapy), parsers, and source management.
- 666 stars
- 0 votes
- 0 copies
- 2 views
- Added February 8, 2026
Works with
Security analysis
100/100npx -y skills add majiayu000/claude-skill-registry --skill context-scrapers --agent claude-codeAre you the author of Context Scrapers?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/majiayu000-context-scrapers)---
name: context-scrapers
description: Web scraping spiders (Scrapy), parsers, and source management.
tags: [backend, data, scrapers]
---
# Scrapers Context
## Overview
Web scraping infrastructure using Scrapy. Handles data acquisition from city councils (Legistar) and municipal codes (Municode).
## Active Files
### Spiders
- `backend/affordabot_scraper/affordabot_scraper/spiders/sanjose_meetings.py` - Legistar meeting scraper
- `backend/affordabot_scraper/affordabot_scraper/spiders/sanjose_municode.py` - Municode scraper
### Configuration
- `backend/affordabot_scraper/affordabot_scraper/pipelines.py` - Item pipelines (DB storage)
- `backend/affordabot_scraper/affordabot_scraper/settings.py` - Scrapy settings
### Verification Scripts
- `scripts/verify_raw_scrapes.py` - Check raw_scrapes table
- `scripts/verify_municode_discovery.py` - Verify discovery logic
## Usage
Use this skill when modifying scrapers, adding new jurisdictions, or debugging ingestion.
Attribution
Comments
Loading comments…
Newsletter
Get the weekly list of safe new skills, and the ones we pulled.