Big Data Processing Fundamentals

---
name: big-data-processing-fundamentals
description: "Use when for big data processing fundamentals."
version: 1.0.0
author: Hermes Agent
license: MIT
platforms: [linux, macos, windows]
metadata:
  hermes:
    tags: [big-data, spark, hadoop, processing]
    related_skills: [general]
---

## Overview
Process big data.

## When to Use
- "Big Data Processing Fundamentals design"
- "Best practices"
- "Optimization"
- "Troubleshooting"

## Key Approaches
1. Requirements
2. Tools
3. Implementation
4. Testing
5. Docs
6. Monitoring

## Common Pitfalls
1. Ignoring constraints
2. Skipping standards
3. Poor alignment
4. Inadequate testing
5. No docs
6. Over-engineering
7. No rollback
8. No monitoring
9. No scaling
10. No validation

## Verification Checklist
- [ ] Requirements verified
- [ ] Standards applied
- [ ] Design reviewed
- [ ] Tests defined
- [ ] Docs complete
- [ ] Monitoring set
- [ ] Rollback planned
- [ ] Security checked
- [ ] Deploy verified
- [ ] Stakeholder approved